[2024-09-11 15:49:19.548697] INFO [SERVER] main (main.cpp:564) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] succ to init logger(default file="log/observer.log", rs file="log/rootservice.log", election file="log/election.log", trace file="log/trace.log", audit_file="audit/observer_74199_20240911154919-60244592.aud", alert file="log/alert/alert.log", max_log_file_size=268435456, enable_async_log=true) [2024-09-11 15:49:19.548783] INFO [SERVER] main (main.cpp:568) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=84] Virtual memory : 722,010,112 byte [2024-09-11 15:49:19.548791] INFO [SERVER] main (main.cpp:571) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] Build basic information for each syslog file(info="address: , observer version: OceanBase_CE 4.2.4.0, revision: 100000082024070810-556a8f594436d32a23ee92289717913cf503184b, sysname: Linux, os release: 4.18.0-425.3.1.el8.x86_64, machine: x86_64, tz GMT offset: 08:00") /data/rtdob/oceanbase/bin/observer -I 10.31.35.7 -p 2881 -P 2882 -n linkrtd -z zone2 -d /data/oceanbase -l info -orootservice_list=10.31.35.6:2882:2881,config_additional_dir=/oceanbase/redo/etc2;/data/oceanbase/etc3,cluster_id=1719994443,large_query_threshold=1s,log_disk_percentage=85,system_cpu_quota=1,memory_limit_percentage=85,system_memory=4G,datafile_disk_percentage=85,cpu_count=6 observer (OceanBase_CE 4.2.4.0) REVISION: 100000082024070810-556a8f594436d32a23ee92289717913cf503184b BUILD_BRANCH: HEAD BUILD_TIME: Jul 8 2024 11:05:25 BUILD_FLAGS: RelWithDebInfo BUILD_INFO: Copyright (c) 2011-present OceanBase Inc. [2024-09-11 15:49:19.548849] INFO print_all_limits (main.cpp:368) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] ============= *begin server limit report * ============= [2024-09-11 15:49:19.548855] INFO print_limit (main.cpp:356) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [operator()] RLIMIT_CORE = unlimited [2024-09-11 15:49:19.548862] INFO print_limit (main.cpp:356) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [operator()] RLIMIT_CPU = unlimited [2024-09-11 15:49:19.548866] INFO print_limit (main.cpp:356) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] [operator()] RLIMIT_DATA = unlimited [2024-09-11 15:49:19.548871] INFO print_limit (main.cpp:356) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] [operator()] RLIMIT_FSIZE = unlimited [2024-09-11 15:49:19.548876] INFO print_limit (main.cpp:356) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [operator()] RLIMIT_LOCKS = unlimited [2024-09-11 15:49:19.548881] INFO print_limit (main.cpp:358) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [operator()] RLIMIT_MEMLOCK = 65536 [2024-09-11 15:49:19.548885] INFO print_limit (main.cpp:358) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] [operator()] RLIMIT_NOFILE = 655350 [2024-09-11 15:49:19.548890] INFO print_limit (main.cpp:358) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [operator()] RLIMIT_NPROC = 655350 [2024-09-11 15:49:19.548895] INFO print_limit (main.cpp:358) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [operator()] RLIMIT_STACK = 10485760 [2024-09-11 15:49:19.548899] INFO print_all_limits (main.cpp:378) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ============= *stop server limit report* =============== name= (11 segments) header 0: address=0x55eef0b33040 header 1: address=0x55eef0b332a8 header 2: address=0x55eef0b33000 header 3: address=0x55ef059e0dc0 header 4: address=0x55ef05ecbcc0 header 5: address=0x55ef059e0dc0 header 6: address=0x55ef05ec71c8 header 7: address=0x55ef059e0dc0 header 8: address=0x55ef188e2098 header 9: address=0x55ef15733000 header 10: address=0x55eef0b332c4 name=linux-vdso.so.1 (4 segments) header 0: address=0x7ffdc0132000 header 1: address=0x7ffdc01323e0 header 2: address=0x7ffdc01324f0 header 3: address=0x7ffdc013252c name=/lib64/librt.so.1 (9 segments) header 0: address=0x7f529e8ba000 header 1: address=0x7f529eac0d80 header 2: address=0x7f529eac0da0 header 3: address=0x7f529e8ba238 header 4: address=0x7f529e8ba280 header 5: address=0x7f529e8ba280 header 6: address=0x7f529e8bfb30 header 7: address=0x7f529e8ba000 header 8: address=0x7f529eac0d80 name=/lib64/libdl.so.2 (9 segments) header 0: address=0x7f529e6b6000 header 1: address=0x7f529e8b8d68 header 2: address=0x7f529e8b8d88 header 3: address=0x7f529e6b6238 header 4: address=0x7f529e6b6280 header 5: address=0x7f529e6b6280 header 6: address=0x7f529e6b7b3c header 7: address=0x7f529e6b6000 header 8: address=0x7f529e8b8d68 name=/lib64/libm.so.6 (9 segments) header 0: address=0x7f529e334000 header 1: address=0x7f529e6b4d60 header 2: address=0x7f529e6b4d78 header 3: address=0x7f529e334238 header 4: address=0x7f529e334280 header 5: address=0x7f529e334280 header 6: address=0x7f529e4a6e88 header 7: address=0x7f529e334000 header 8: address=0x7f529e6b4d60 name=/data/rtdob/oceanbase/lib/libmariadb.so.3 (7 segments) header 0: address=0x7f529e0d1000 header 1: address=0x7f529e329270 header 2: address=0x7f529e32fdb0 header 3: address=0x7f529e0d11c8 header 4: address=0x7f529e11ebd4 header 5: address=0x7f529e0d1000 header 6: address=0x7f529e329270 name=/data/rtdob/oceanbase/lib/libaio.so.1 (7 segments) header 0: address=0x7f529decf000 header 1: address=0x7f529e0cfed0 header 2: address=0x7f529e0cfed0 header 3: address=0x7f529decf1c8 header 4: address=0x7f529decfa6c header 5: address=0x7f529decf000 header 6: address=0x7f529e0cfed0 name=/lib64/libpthread.so.0 (11 segments) header 0: address=0x7f529dcaf040 header 1: address=0x7f529dcc48a0 header 2: address=0x7f529dcaf000 header 3: address=0x7f529dec9ba8 header 4: address=0x7f529dec9d80 header 5: address=0x7f529dcaf2a8 header 6: address=0x7f529dcaf2f0 header 7: address=0x7f529dcaf2f0 header 8: address=0x7f529dcc48c0 header 9: address=0x7f529dcaf000 header 10: address=0x7f529dec9ba8 name=/lib64/libc.so.6 (12 segments) header 0: address=0x7f529d8e9040 header 1: address=0x7f529da7a1f0 header 2: address=0x7f529d8e9000 header 3: address=0x7f529dca5750 header 4: address=0x7f529dca8b60 header 5: address=0x7f529d8e92e0 header 6: address=0x7f529d8e9328 header 7: address=0x7f529dca5750 header 8: address=0x7f529d8e9328 header 9: address=0x7f529da7a20c header 10: address=0x7f529d8e9000 header 11: address=0x7f529dca5750 name=/lib64/ld-linux-x86-64.so.2 (9 segments) header 0: address=0x7f529eac2000 header 1: address=0x7f529ecef3c0 header 2: address=0x7f529ecefe30 header 3: address=0x7f529eac2238 header 4: address=0x7f529eaeef88 header 5: address=0x7f529eaeef88 header 6: address=0x7f529eaeb4e4 header 7: address=0x7f529eac2000 header 8: address=0x7f529ecef3c0 [2024-09-11 15:49:19.555601] INFO [LIB] ObSliceAlloc (ob_slice_alloc.h:321) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=18] ObSliceAlloc init finished(bsize_=7936, isize_=40, slice_limit_=7536, tmallocator_=NULL) [2024-09-11 15:49:19.555647] INFO [LIB] ObSliceAlloc (ob_slice_alloc.h:321) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=23] ObSliceAlloc init finished(bsize_=7936, isize_=160, slice_limit_=7536, tmallocator_=NULL) [2024-09-11 15:49:19.555774] INFO [SERVER] main (main.cpp:593) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] observer starts(observer_version="OceanBase_CE 4.2.4.0") [2024-09-11 15:49:19.555786] INFO [SERVER] init (ob_server.cpp:261) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] [OBSERVER_NOTICE] start to init observer [2024-09-11 15:49:19.555793] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.555845] INFO [SERVER] init (ob_server.cpp:265) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=41] [server_start 1/18] observer init begin. [2024-09-11 15:49:19.555959] INFO [SHARE] load_config (ob_config_manager.cpp:129) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] Config file doesn't exist, read from command line(path="etc/observer.config.bin", ret=-4027) [2024-09-11 15:49:19.555991] INFO [SERVER] parse_mode (ob_server.cpp:231) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13] set normal mode [2024-09-11 15:49:19.556009] INFO [SHARE] operator() (ob_common_config.cpp:370) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Load config succ(name="rootservice_list", value="10.31.35.6:2882:2881") [2024-09-11 15:49:19.556018] INFO [SHARE] operator() (ob_common_config.cpp:370) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] Load config succ(name="config_additional_dir", value="/oceanbase/redo/etc2;/data/oceanbase/etc3") [2024-09-11 15:49:19.556024] INFO [SHARE] operator() (ob_common_config.cpp:370) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Load config succ(name="cluster_id", value="1719994443") [2024-09-11 15:49:19.556031] INFO [SHARE] operator() (ob_common_config.cpp:370) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Load config succ(name="large_query_threshold", value="1s") [2024-09-11 15:49:19.556036] INFO [SHARE] operator() (ob_common_config.cpp:370) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Load config succ(name="log_disk_percentage", value="85") [2024-09-11 15:49:19.556043] WDIAG [SHARE] operator() (ob_common_config.cpp:346) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4][errcode=0] Invalid config string, no such config item(name="system_cpu_quota", value="1", ret=0) [2024-09-11 15:49:19.556050] INFO [SHARE] operator() (ob_common_config.cpp:370) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Load config succ(name="memory_limit_percentage", value="85") [2024-09-11 15:49:19.556057] INFO [SHARE] operator() (ob_common_config.cpp:370) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Load config succ(name="system_memory", value="4G") [2024-09-11 15:49:19.556063] INFO [SHARE] operator() (ob_common_config.cpp:370) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Load config succ(name="datafile_disk_percentage", value="85") [2024-09-11 15:49:19.556069] INFO [SHARE] operator() (ob_common_config.cpp:370) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Load config succ(name="cpu_count", value="6") [2024-09-11 15:49:19.556080] INFO [SERVER] calc_cluster_name_hash (ob_server_reload_config.cpp:73) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] calc cluster_name_hash for rpc(cluster_name=linkrtd, cluster_name_hash=18081952708213727581) [2024-09-11 15:49:19.556090] INFO [SERVER] set_cluster_name_hash (ob_server_reload_config.cpp:58) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set cluster_name_hash(ret=0, ret="OB_SUCCESS", cluster_name=linkrtd, cluster_name_hash=18081952708213727581) [2024-09-11 15:49:19.556099] INFO [SERVER] init_config (ob_server.cpp:1933) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set CLUSTER_ID for rpc(cluster_id=1719994443) [2024-09-11 15:49:19.556104] INFO print (ob_server_config.cpp:158) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ===================== *begin server config report * ===================== [2024-09-11 15:49:19.556109] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] | _ob_pl_compile_max_concurrency = 4 [2024-09-11 15:49:19.556113] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_dbms_job_package = True [2024-09-11 15:49:19.556116] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_memleak_light_backtrace = True [2024-09-11 15:49:19.556120] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _faststack_min_interval = 30m [2024-09-11 15:49:19.556123] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _faststack_req_queue_size_threshold = 0 [2024-09-11 15:49:19.556130] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] | strict_check_os_params = False [2024-09-11 15:49:19.556134] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ha_diagnose_history_recycle_interval = 7d [2024-09-11 15:49:19.556137] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _obkv_feature_mode = [2024-09-11 15:49:19.556140] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | sql_protocol_min_tls_version = none [2024-09-11 15:49:19.556144] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_persistent_compiled_routine = True [2024-09-11 15:49:19.556147] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_ash_enable = True [2024-09-11 15:49:19.556151] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_ash_size = 0 [2024-09-11 15:49:19.556154] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _force_malloc_for_absent_tenant = False [2024-09-11 15:49:19.556157] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _schema_memory_recycle_interval = 15m [2024-09-11 15:49:19.556160] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _force_explict_500_malloc = False [2024-09-11 15:49:19.556164] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_backtrace_function = True [2024-09-11 15:49:19.556167] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | rpc_server_authentication_method = ALL [2024-09-11 15:49:19.556170] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | rpc_client_authentication_method = NONE [2024-09-11 15:49:19.556174] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_reserved_user_dcl_restriction = False [2024-09-11 15:49:19.556177] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_px_fast_reclaim = True [2024-09-11 15:49:19.556180] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | observer_id = 0 [2024-09-11 15:49:19.556183] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | local_ip = 10.31.35.7 [2024-09-11 15:49:19.556187] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _load_tde_encrypt_engine = NONE [2024-09-11 15:49:19.556190] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_protocol_diagnose = True [2024-09-11 15:49:19.556193] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _display_mysql_version = 5.7.25 [2024-09-11 15:49:19.556196] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_dblink = True [2024-09-11 15:49:19.556200] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_enable_direct_load = True [2024-09-11 15:49:19.556203] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_plan_cache_auto_flush_interval = 0s [2024-09-11 15:49:19.556207] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | global_background_cpu_quota = -1 [2024-09-11 15:49:19.556210] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_global_background_resource_isolation = False [2024-09-11 15:49:19.556215] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] | enable_cgroup = True [2024-09-11 15:49:19.556219] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _advance_checkpoint_timeout = 30m [2024-09-11 15:49:19.556222] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _endpoint_tenant_mapping = [2024-09-11 15:49:19.556226] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_tenant_sql_net_thread = True [2024-09-11 15:49:19.556229] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] | sql_net_thread_count = 0 [2024-09-11 15:49:19.556232] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | sql_login_thread_count = 0 [2024-09-11 15:49:19.556236] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ignore_system_memory_over_limit_error = False [2024-09-11 15:49:19.556240] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] | _enable_new_sql_nio = True [2024-09-11 15:49:19.556244] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _session_context_size = 10000 [2024-09-11 15:49:19.556247] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_newsort = True [2024-09-11 15:49:19.556250] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_obj_dep_maint_task_interval = 1ms [2024-09-11 15:49:19.556254] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_enable_fast_parser = True [2024-09-11 15:49:19.556257] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_trace_session_leak = False [2024-09-11 15:49:19.556260] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_block_file_punch_hole = False [2024-09-11 15:49:19.556263] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _resource_limit_spec = auto [2024-09-11 15:49:19.556267] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_resource_limit_spec = False [2024-09-11 15:49:19.556270] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_px_ordered_coord = False [2024-09-11 15:49:19.556273] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _send_bloom_filter_size = 1024 [2024-09-11 15:49:19.556277] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | tcp_keepcnt = 10 [2024-09-11 15:49:19.556280] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | tcp_keepintvl = 6s [2024-09-11 15:49:19.556283] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | tcp_keepidle = 7200s [2024-09-11 15:49:19.556287] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_tcp_keepalive = True [2024-09-11 15:49:19.556290] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | ob_ratelimit_stat_period = 1s [2024-09-11 15:49:19.556293] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_ob_ratelimit = False [2024-09-11 15:49:19.556299] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] | _enable_easy_keepalive = True [2024-09-11 15:49:19.556302] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _xa_gc_interval = 1h [2024-09-11 15:49:19.556306] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _xa_gc_timeout = 24h [2024-09-11 15:49:19.556309] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_ssl_invited_nodes = NONE [2024-09-11 15:49:19.556312] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | ssl_external_kms_info = [2024-09-11 15:49:19.556315] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | use_large_pages = false [2024-09-11 15:49:19.556319] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_oracle_priv_check = True [2024-09-11 15:49:19.556322] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | schema_history_recycle_interval = 10m [2024-09-11 15:49:19.556325] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_plan_cache_mem_diagnosis = False [2024-09-11 15:49:19.556328] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_plan_cache_gc_strategy = REPORT [2024-09-11 15:49:19.556332] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _upgrade_stage = NONE [2024-09-11 15:49:19.556335] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_enable_prepared_statement = True [2024-09-11 15:49:19.556338] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _backup_idle_time = 5m [2024-09-11 15:49:19.556342] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _restore_idle_time = 1m [2024-09-11 15:49:19.556345] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _bloom_filter_ratio = 35 [2024-09-11 15:49:19.556348] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_ddl_timeout = 1000s [2024-09-11 15:49:19.556352] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | use_ipv6 = False [2024-09-11 15:49:19.556355] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | ssl_client_authentication = False [2024-09-11 15:49:19.556358] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _px_max_pipeline_depth = 2 [2024-09-11 15:49:19.556362] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | __easy_memory_reserved_percentage = 0 [2024-09-11 15:49:19.556365] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | stack_size = 512K [2024-09-11 15:49:19.556369] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | __easy_memory_limit = 4G [2024-09-11 15:49:19.556372] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _max_elr_dependent_trx_count = 0 [2024-09-11 15:49:19.556375] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | px_task_size = 2M [2024-09-11 15:49:19.556378] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | dtl_buffer_size = 64K [2024-09-11 15:49:19.556384] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] | _cache_wash_interval = 200ms [2024-09-11 15:49:19.556388] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _migrate_block_verify_level = 1 [2024-09-11 15:49:19.556391] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | micro_block_merge_verify_level = 2 [2024-09-11 15:49:19.556394] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | builtin_db_data_verify_cycle = 20 [2024-09-11 15:49:19.556397] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | tablet_size = 128M [2024-09-11 15:49:19.556401] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] | sys_bkgd_migration_change_member_list_timeout = 20s [2024-09-11 15:49:19.556404] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | sys_bkgd_migration_retry_num = 3 [2024-09-11 15:49:19.556407] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_elr_fast_freeze_threshold = 500000 [2024-09-11 15:49:19.556411] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _fast_commit_callback_count = 10000 [2024-09-11 15:49:19.556414] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _private_buffer_size = 16K [2024-09-11 15:49:19.556417] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _force_skip_encoding_partition_id = [2024-09-11 15:49:19.556420] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_compaction_diagnose = False [2024-09-11 15:49:19.556424] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | disk_io_thread_count = 8 [2024-09-11 15:49:19.556427] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | sys_bkgd_net_percentage = 60 [2024-09-11 15:49:19.556430] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | data_disk_usage_limit_percentage = 90 [2024-09-11 15:49:19.556434] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | data_storage_error_tolerance_time = 300s [2024-09-11 15:49:19.556437] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | data_storage_warning_tolerance_time = 5s [2024-09-11 15:49:19.556440] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _data_storage_io_timeout = 10s [2024-09-11 15:49:19.556443] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | storage_meta_cache_priority = 10 [2024-09-11 15:49:19.556447] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | fuse_row_cache_priority = 1 [2024-09-11 15:49:19.556450] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | bf_cache_miss_count_threshold = 100 [2024-09-11 15:49:19.556453] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | bf_cache_priority = 1 [2024-09-11 15:49:19.556457] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | user_row_cache_priority = 1 [2024-09-11 15:49:19.556460] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | user_block_cache_priority = 1 [2024-09-11 15:49:19.556465] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] | index_block_cache_priority = 10 [2024-09-11 15:49:19.556469] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] | opt_tab_stat_cache_priority = 1 [2024-09-11 15:49:19.556472] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | tablet_ls_cache_priority = 1000 [2024-09-11 15:49:19.556475] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _auto_broadcast_tablet_location_rate_limit = 10000 [2024-09-11 15:49:19.556479] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _auto_refresh_tablet_location_interval = 10m [2024-09-11 15:49:19.556482] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | location_cache_refresh_sql_timeout = 1s [2024-09-11 15:49:19.556485] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | location_cache_refresh_rpc_timeout = 500ms [2024-09-11 15:49:19.556489] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | all_server_list = [2024-09-11 15:49:19.556492] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] | location_cache_refresh_min_interval = 100ms [2024-09-11 15:49:19.556495] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | location_fetch_concurrency = 20 [2024-09-11 15:49:19.556499] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | location_refresh_thread_count = 2 [2024-09-11 15:49:19.556502] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | virtual_table_location_cache_expire_time = 8s [2024-09-11 15:49:19.556505] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _server_standby_fetch_log_bandwidth_limit = 0MB [2024-09-11 15:49:19.556508] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | standby_fetch_log_bandwidth_limit = 0MB [2024-09-11 15:49:19.556512] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _max_rpc_packet_size = 2047MB [2024-09-11 15:49:19.556515] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_pkt_nio = True [2024-09-11 15:49:19.556519] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | rpc_timeout = 2s [2024-09-11 15:49:19.556522] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_get_gts_ahead_interval = 0s [2024-09-11 15:49:19.556525] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _parallel_redo_logging_trigger = 16M [2024-09-11 15:49:19.556529] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_parallel_redo_logging = True [2024-09-11 15:49:19.556532] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_trans_rpc_timeout = 3s [2024-09-11 15:49:19.556535] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _rpc_checksum = Force [2024-09-11 15:49:19.556539] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | ignore_replay_checksum_error = False [2024-09-11 15:49:19.556542] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | row_compaction_update_limit = 6 [2024-09-11 15:49:19.556545] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | clog_sync_time_warn_threshold = 100ms [2024-09-11 15:49:19.556551] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] | trx_2pc_retry_interval = 100ms [2024-09-11 15:49:19.556554] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_sys_unit_standalone = False [2024-09-11 15:49:19.556558] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _lcl_op_interval = 30ms [2024-09-11 15:49:19.556561] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | server_balance_cpu_mem_tolerance_percent = 5 [2024-09-11 15:49:19.556564] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | server_balance_disk_tolerance_percent = 1 [2024-09-11 15:49:19.556568] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | server_balance_critical_disk_waterlevel = 80 [2024-09-11 15:49:19.556571] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | __min_full_resource_pool_memory = 5368709120 [2024-09-11 15:49:19.556574] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | __balance_controller = [2024-09-11 15:49:19.556577] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | balancer_log_interval = 1m [2024-09-11 15:49:19.556581] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | balancer_task_timeout = 20m [2024-09-11 15:49:19.556584] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | balancer_tolerance_percentage = 10 [2024-09-11 15:49:19.556587] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_rereplication = True [2024-09-11 15:49:19.556590] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | resource_hard_limit = 100 [2024-09-11 15:49:19.556594] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | log_storage_warning_tolerance_time = 5s [2024-09-11 15:49:19.556597] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | log_disk_percentage = 85 [2024-09-11 15:49:19.556600] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | log_disk_size = 0M [2024-09-11 15:49:19.556604] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | recyclebin_object_expire_time = 0s [2024-09-11 15:49:19.556607] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _recyclebin_object_purge_frequency = 10m [2024-09-11 15:49:19.556610] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | ob_event_history_recycle_interval = 7d [2024-09-11 15:49:19.556613] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_major_freeze = True [2024-09-11 15:49:19.556617] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_ddl = True [2024-09-11 15:49:19.556620] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | min_observer_version = 4.2.4.0 [2024-09-11 15:49:19.556624] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | tablet_meta_table_check_interval = 30m [2024-09-11 15:49:19.556627] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | ls_meta_table_check_interval = 1s [2024-09-11 15:49:19.556633] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] | tablet_meta_table_scan_batch_count = 999 [2024-09-11 15:49:19.556636] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | rootservice_ready_check_interval = 3s [2024-09-11 15:49:19.556640] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | server_check_interval = 30s [2024-09-11 15:49:19.556643] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] | migration_disable_time = 3600s [2024-09-11 15:49:19.556646] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | server_permanent_offline_time = 3600s [2024-09-11 15:49:19.556650] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_sys_table_ddl = False [2024-09-11 15:49:19.556653] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | rootservice_async_task_queue_size = 16384 [2024-09-11 15:49:19.556656] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | rootservice_async_task_thread_count = 4 [2024-09-11 15:49:19.556659] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | lease_time = 10s [2024-09-11 15:49:19.556663] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _px_chunklist_count_ratio = 1 [2024-09-11 15:49:19.556666] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | plan_cache_evict_interval = 5s [2024-09-11 15:49:19.556669] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | data_disk_write_limit_percentage = 0 [2024-09-11 15:49:19.556673] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | memstore_limit_percentage = 0 [2024-09-11 15:49:19.556676] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _ob_max_thread_num = 0 [2024-09-11 15:49:19.556679] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | large_query_threshold = 1s [2024-09-11 15:49:19.556682] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | large_query_worker_percentage = 30 [2024-09-11 15:49:19.556686] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | workers_per_cpu_quota = 10 [2024-09-11 15:49:19.556689] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | location_cache_cpu_quota = 5 [2024-09-11 15:49:19.556692] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _hidden_sys_tenant_memory = 0M [2024-09-11 15:49:19.556695] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | server_cpu_quota_max = 0 [2024-09-11 15:49:19.556699] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | server_cpu_quota_min = 0 [2024-09-11 15:49:19.556702] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_values_table_folding = True [2024-09-11 15:49:19.556705] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _max_malloc_sample_interval = 256 [2024-09-11 15:49:19.556708] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _min_malloc_sample_interval = 16 [2024-09-11 15:49:19.556712] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _auto_drop_recovering_auxiliary_tenant = True [2024-09-11 15:49:19.556718] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] | _sql_insert_multi_values_split_opt = True [2024-09-11 15:49:19.556721] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _delay_resource_recycle_after_correctness_issue = False [2024-09-11 15:49:19.556724] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_defensive_check = 1 [2024-09-11 15:49:19.556728] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _enable_partition_level_retry = True [2024-09-11 15:49:19.556731] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _chunk_row_store_mem_limit = 0M [2024-09-11 15:49:19.556734] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_sql_operator_dump = True [2024-09-11 15:49:19.556737] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | autoinc_cache_refresh_interval = 3600s [2024-09-11 15:49:19.556740] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | memory_chunk_cache_size = 0M [2024-09-11 15:49:19.556744] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | cache_wash_threshold = 4GB [2024-09-11 15:49:19.556747] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | memory_limit_percentage = 85 [2024-09-11 15:49:19.556750] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | syslog_file_uncompressed_count = 0 [2024-09-11 15:49:19.556753] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | syslog_compress_func = none [2024-09-11 15:49:19.556757] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | syslog_disk_size = 0M [2024-09-11 15:49:19.556760] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_syslog_recycle = False [2024-09-11 15:49:19.556764] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_syslog_wf = True [2024-09-11 15:49:19.556767] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_async_syslog = True [2024-09-11 15:49:19.556770] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | max_syslog_file_count = 0 [2024-09-11 15:49:19.556773] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | diag_syslog_per_error_limit = 200 [2024-09-11 15:49:19.556777] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | syslog_io_bandwidth_limit = 30MB [2024-09-11 15:49:19.556780] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | alert_log_level = INFO [2024-09-11 15:49:19.556783] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | syslog_level = WDIAG [2024-09-11 15:49:19.556786] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | obconfig_url = [2024-09-11 15:49:19.556790] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | cluster_id = 1719994443 [2024-09-11 15:49:19.556793] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | cluster = linkrtd [2024-09-11 15:49:19.556799] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] | rootservice_list = 10.31.35.6:2882:2881 [2024-09-11 15:49:19.556802] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | weak_read_version_refresh_interval = 100ms [2024-09-11 15:49:19.556805] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | default_compress = archive [2024-09-11 15:49:19.556809] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | default_row_format = dynamic [2024-09-11 15:49:19.556812] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | default_compress_func = zstd_1.3.8 [2024-09-11 15:49:19.556815] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | schema_history_expire_time = 7d [2024-09-11 15:49:19.556819] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_upgrade_mode = False [2024-09-11 15:49:19.556824] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] | enable_perf_event = True [2024-09-11 15:49:19.556827] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | dead_socket_detection_timeout = 3s [2024-09-11 15:49:19.556830] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | debug_sync_timeout = 0 [2024-09-11 15:49:19.556834] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_rich_error_msg = False [2024-09-11 15:49:19.556837] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_record_trace_id = False [2024-09-11 15:49:19.556840] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | enable_sql_audit = True [2024-09-11 15:49:19.556844] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | max_string_print_length = 500 [2024-09-11 15:49:19.556847] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] | enable_record_trace_log = True [2024-09-11 15:49:19.556850] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | trace_log_slow_query_watermark = 1s [2024-09-11 15:49:19.556853] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | cpu_count = 6 [2024-09-11 15:49:19.556856] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | system_memory = 4G [2024-09-11 15:49:19.556859] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | memory_limit = 0M [2024-09-11 15:49:19.556863] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | tenant_task_queue_size = 16384 [2024-09-11 15:49:19.556866] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | high_priority_net_thread_count = 0 [2024-09-11 15:49:19.556869] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | net_thread_count = 0 [2024-09-11 15:49:19.556872] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | internal_sql_execute_timeout = 30s [2024-09-11 15:49:19.556876] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | ob_startup_mode = NORMAL [2024-09-11 15:49:19.556882] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] | zone = zone2 [2024-09-11 15:49:19.556885] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | devname = bond0 [2024-09-11 15:49:19.556888] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | mysql_port = 2881 [2024-09-11 15:49:19.556891] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | rpc_port = 2882 [2024-09-11 15:49:19.556895] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | leak_mod_to_check = NONE [2024-09-11 15:49:19.556898] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | config_additional_dir = /oceanbase/redo/etc2;/data/oceanbase/etc3 [2024-09-11 15:49:19.556916] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=17] | memory_reserved = 500M [2024-09-11 15:49:19.556920] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] | _datafile_usage_lower_bound_percentage = 10 [2024-09-11 15:49:19.556923] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | _datafile_usage_upper_bound_percentage = 90 [2024-09-11 15:49:19.556927] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | datafile_disk_percentage = 85 [2024-09-11 15:49:19.556930] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | datafile_maxsize = 0 [2024-09-11 15:49:19.556933] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | datafile_next = 0 [2024-09-11 15:49:19.556937] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | datafile_size = 0M [2024-09-11 15:49:19.556940] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | redundancy_level = NORMAL [2024-09-11 15:49:19.556944] INFO print (ob_server_config.cpp:164) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] | data_dir = /data/oceanbase [2024-09-11 15:49:19.556950] INFO print (ob_server_config.cpp:167) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ===================== *stop server config report* ======================= [2024-09-11 15:49:19.557056] WARN [SERVER] init_config (ob_server.cpp:1963) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3][errcode=-4187] Item not match(the devname has been rewritten, and the new value comes from local_ip, old value="eth0", new value="eth0", local_ip="10.31.35.7") [2024-09-11 15:49:19.557086] INFO [SHARE.CONFIG] reload_config (ob_server_config.cpp:361) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=19] update observer memory config success(memory_limit=57127770931, system_memory=4294967296, hidden_sys_memory=1073741824) [2024-09-11 15:49:19.557092] INFO set_running_mode (ob_server.cpp:2085) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] mini mode: false [2024-09-11 15:49:19.557107] INFO [SERVER] init_config (ob_server.cpp:2017) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Build basic information for each syslog file(info="address: "10.31.35.7:2882", observer version: OceanBase_CE 4.2.4.0, revision: 100000082024070810-556a8f594436d32a23ee92289717913cf503184b, sysname: Linux, os release: 4.18.0-425.3.1.el8.x86_64, machine: x86_64, tz GMT offset: 08:00") [2024-09-11 15:49:19.557113] INFO [SERVER] init_config (ob_server.cpp:2021) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] my addr(self_addr="10.31.35.7:2882") [2024-09-11 15:49:19.557948] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=0, tg=0x7f529d275e40, thread_cnt=1, tg->attr_={name:test1, type:3}) [2024-09-11 15:49:19.557971] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=19] create tg succeed(tg_id=1, tg=0x7f529d204570, thread_cnt=1, tg->attr_={name:test2, type:4}) [2024-09-11 15:49:19.557979] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] create tg succeed(tg_id=2, tg=0x7f529d204770, thread_cnt=1, tg->attr_={name:test3, type:5}) [2024-09-11 15:49:19.557984] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=3, tg=0x7f529d205e90, thread_cnt=1, tg->attr_={name:test4, type:2}) [2024-09-11 15:49:19.557991] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=4, tg=0x7f529d290030, thread_cnt=1, tg->attr_={name:test5, type:6}) [2024-09-11 15:49:19.558000] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=5, tg=0x7f529d292030, thread_cnt=2, tg->attr_={name:test6, type:7}) [2024-09-11 15:49:19.558005] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=6, tg=0x7f529d290b70, thread_cnt=10, tg->attr_={name:test7, type:4}) [2024-09-11 15:49:19.558009] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=7, tg=0x7f529d290d70, thread_cnt=1, tg->attr_={name:test8, type:1}) [2024-09-11 15:49:19.558013] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=8, tg=0x7f529d290eb0, thread_cnt=1, tg->attr_={name:memDump, type:2}) [2024-09-11 15:49:19.558023] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=9, tg=0x7f529d2aa030, thread_cnt=1, tg->attr_={name:SchemaRefTask, type:5}) [2024-09-11 15:49:19.558028] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=10, tg=0x7f529d2ab750, thread_cnt=1, tg->attr_={name:ReqMemEvict, type:3}) [2024-09-11 15:49:19.558032] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=11, tg=0x7f529d2ab8c0, thread_cnt=1, tg->attr_={name:replica_control, type:2}) [2024-09-11 15:49:19.558036] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=12, tg=0x7f529d2ab980, thread_cnt=1, tg->attr_={name:SyslogCompress, type:2}) [2024-09-11 15:49:19.558041] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=13, tg=0x7f529d2aba40, thread_cnt=1, tg->attr_={name:testObTh, type:2}) [2024-09-11 15:49:19.558045] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=14, tg=0x7f529d2abb00, thread_cnt=1, tg->attr_={name:ComTh, type:2}) [2024-09-11 15:49:19.558053] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=15, tg=0x7f529d2abbc0, thread_cnt=1, tg->attr_={name:ComQueueTh, type:4}) [2024-09-11 15:49:19.558061] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] create tg succeed(tg_id=16, tg=0x7f529d2abdc0, thread_cnt=1, tg->attr_={name:ComTimerTh, type:3}) [2024-09-11 15:49:19.558069] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=17, tg=0x7f529d2abf30, thread_cnt=1, tg->attr_={name:Blacklist, type:2}) [2024-09-11 15:49:19.558075] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=18, tg=0x7f529d205f50, thread_cnt=1, tg->attr_={name:PartSerMigRetryQt, type:2}) [2024-09-11 15:49:19.558109] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=19, tg=0x7f529d290f70, thread_cnt=1, tg->attr_={name:TransMigrate, type:4}) [2024-09-11 15:49:19.558120] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] create tg succeed(tg_id=20, tg=0x7f529d291170, thread_cnt=1, tg->attr_={name:StandbyTimestampService, type:2}) [2024-09-11 15:49:19.558124] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=21, tg=0x7f529d291230, thread_cnt=1, tg->attr_={name:WeakRdSrv, type:2}) [2024-09-11 15:49:19.558132] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=22, tg=0x7f529d2912f0, thread_cnt=1, tg->attr_={name:TransTaskWork, type:4}) [2024-09-11 15:49:19.558136] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=23, tg=0x7f529d2914f0, thread_cnt=8, tg->attr_={name:DDLTaskExecutor3, type:2}) [2024-09-11 15:49:19.558143] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=24, tg=0x7f529d2915b0, thread_cnt=1, tg->attr_={name:TSWorker, type:4}) [2024-09-11 15:49:19.558150] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=25, tg=0x7f529d2917b0, thread_cnt=8, tg->attr_={name:BRPC, type:2}) [2024-09-11 15:49:19.558155] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=26, tg=0x7f529d291870, thread_cnt=1, tg->attr_={name:RLMGR, type:2}) [2024-09-11 15:49:19.558163] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=27, tg=0x7f529d291930, thread_cnt=3, tg->attr_={name:LeaseQueueTh, type:2}) [2024-09-11 15:49:19.558167] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=28, tg=0x7f529d2919f0, thread_cnt=1, tg->attr_={name:DDLQueueTh, type:2}) [2024-09-11 15:49:19.558171] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=29, tg=0x7f529d291ab0, thread_cnt=6, tg->attr_={name:MysqlQueueTh, type:2}) [2024-09-11 15:49:19.558176] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=30, tg=0x7f529d291b70, thread_cnt=4, tg->attr_={name:DDLPQueueTh, type:2}) [2024-09-11 15:49:19.558180] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=31, tg=0x7f529d291c30, thread_cnt=2, tg->attr_={name:DiagnoseQueueTh, type:2}) [2024-09-11 15:49:19.558186] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=32, tg=0x7f529d2ac030, thread_cnt=16, tg->attr_={name:DdlBuild, type:6}) [2024-09-11 15:49:19.558193] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=33, tg=0x7f529d2acb70, thread_cnt=2, tg->attr_={name:LSService, type:1}) [2024-09-11 15:49:19.558200] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=34, tg=0x7f529d2accb0, thread_cnt=1, tg->attr_={name:ObCreateStandbyFromNetActor, type:1}) [2024-09-11 15:49:19.558204] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=35, tg=0x7f529d2acdf0, thread_cnt=1, tg->attr_={name:SimpleLSService, type:1}) [2024-09-11 15:49:19.558213] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=36, tg=0x7f529d2acf30, thread_cnt=1, tg->attr_={name:IntermResGC, type:3}) [2024-09-11 15:49:19.558217] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=37, tg=0x7f529d2ad0a0, thread_cnt=1, tg->attr_={name:ServerGTimer, type:3}) [2024-09-11 15:49:19.558224] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=38, tg=0x7f529d2ad210, thread_cnt=1, tg->attr_={name:FreezeTimer, type:3}) [2024-09-11 15:49:19.558228] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=39, tg=0x7f529d2ad380, thread_cnt=1, tg->attr_={name:SqlMemTimer, type:3}) [2024-09-11 15:49:19.558232] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=40, tg=0x7f529d2ad4f0, thread_cnt=1, tg->attr_={name:ServerTracerTimer, type:3}) [2024-09-11 15:49:19.558239] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=41, tg=0x7f529d2ad660, thread_cnt=1, tg->attr_={name:RSqlPool, type:3}) [2024-09-11 15:49:19.558246] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=42, tg=0x7f529d2ad7d0, thread_cnt=1, tg->attr_={name:KVCacheWash, type:3}) [2024-09-11 15:49:19.558250] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=43, tg=0x7f529d2ad940, thread_cnt=1, tg->attr_={name:KVCacheRep, type:3}) [2024-09-11 15:49:19.558255] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=44, tg=0x7f529d2adab0, thread_cnt=1, tg->attr_={name:ObHeartbeat, type:3}) [2024-09-11 15:49:19.558262] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=45, tg=0x7f529d2adc20, thread_cnt=1, tg->attr_={name:PlanCacheEvict, type:3}) [2024-09-11 15:49:19.558266] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=46, tg=0x7f529d2add90, thread_cnt=1, tg->attr_={name:TabletStatRpt, type:3}) [2024-09-11 15:49:19.558272] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=47, tg=0x7f529d209ea0, thread_cnt=1, tg->attr_={name:PsCacheEvict, type:3}) [2024-09-11 15:49:19.558277] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=48, tg=0x7f529d231ea0, thread_cnt=1, tg->attr_={name:MergeLoop, type:3}) [2024-09-11 15:49:19.558281] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=49, tg=0x7f529d233ea0, thread_cnt=1, tg->attr_={name:SSTableGC, type:3}) [2024-09-11 15:49:19.558285] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=50, tg=0x7f529d235ea0, thread_cnt=1, tg->attr_={name:MediumLoop, type:3}) [2024-09-11 15:49:19.558293] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=51, tg=0x7f529d269e40, thread_cnt=1, tg->attr_={name:WriteCkpt, type:3}) [2024-09-11 15:49:19.558297] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=52, tg=0x7f529d26be40, thread_cnt=1, tg->attr_={name:EXTLogWash, type:3}) [2024-09-11 15:49:19.558304] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=53, tg=0x7f529d26de40, thread_cnt=1, tg->attr_={name:LineCache, type:3}) [2024-09-11 15:49:19.558309] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=54, tg=0x7f529d26fe40, thread_cnt=1, tg->attr_={name:LocalityReload, type:3}) [2024-09-11 15:49:19.558313] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=55, tg=0x7f529d271e40, thread_cnt=1, tg->attr_={name:MemstoreGC, type:3}) [2024-09-11 15:49:19.558317] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=56, tg=0x7f529d273e40, thread_cnt=1, tg->attr_={name:DiskUseReport, type:3}) [2024-09-11 15:49:19.558324] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=57, tg=0x7f529d291cf0, thread_cnt=1, tg->attr_={name:CLOGReqMinor, type:3}) [2024-09-11 15:49:19.558331] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=58, tg=0x7f529d291e60, thread_cnt=1, tg->attr_={name:PGArchiveLog, type:3}) [2024-09-11 15:49:19.558338] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=59, tg=0x7f529d2ae030, thread_cnt=1, tg->attr_={name:CKPTLogRep, type:3}) [2024-09-11 15:49:19.558345] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=60, tg=0x7f529d2ae1a0, thread_cnt=1, tg->attr_={name:RebuildRetry, type:3}) [2024-09-11 15:49:19.558349] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=61, tg=0x7f529d2ae310, thread_cnt=1, tg->attr_={name:TableMgrGC, type:3}) [2024-09-11 15:49:19.558353] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=62, tg=0x7f529d2ae480, thread_cnt=1, tg->attr_={name:IndexSche, type:3}) [2024-09-11 15:49:19.558357] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=63, tg=0x7f529d2ae5f0, thread_cnt=1, tg->attr_={name:FreInfoReload, type:3}) [2024-09-11 15:49:19.558361] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=64, tg=0x7f529d2ae760, thread_cnt=1, tg->attr_={name:HAGtsMgr, type:3}) [2024-09-11 15:49:19.558365] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=65, tg=0x7f529d2ae8d0, thread_cnt=1, tg->attr_={name:HAGtsHB, type:3}) [2024-09-11 15:49:19.558369] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=66, tg=0x7f529d2aea40, thread_cnt=1, tg->attr_={name:RebuildTask, type:3}) [2024-09-11 15:49:19.558373] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=67, tg=0x7f529d2aebb0, thread_cnt=1, tg->attr_={name:LogDiskMon, type:3}) [2024-09-11 15:49:19.558377] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=68, tg=0x7f529d2aed20, thread_cnt=1, tg->attr_={name:ILOGFlush, type:3}) [2024-09-11 15:49:19.558381] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=69, tg=0x7f529d2aee90, thread_cnt=1, tg->attr_={name:ILOGPurge, type:3}) [2024-09-11 15:49:19.558388] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=70, tg=0x7f529d2af000, thread_cnt=1, tg->attr_={name:RLogClrCache, type:3}) [2024-09-11 15:49:19.558393] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=71, tg=0x7f529d2af170, thread_cnt=1, tg->attr_={name:TableStatRpt, type:3}) [2024-09-11 15:49:19.558397] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=72, tg=0x7f529d2af2e0, thread_cnt=1, tg->attr_={name:MacroMetaMgr, type:3}) [2024-09-11 15:49:19.558401] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=73, tg=0x7f529d2af450, thread_cnt=1, tg->attr_={name:StoreFileGC, type:3}) [2024-09-11 15:49:19.558405] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=74, tg=0x7f529d2af5c0, thread_cnt=1, tg->attr_={name:LeaseHB, type:3}) [2024-09-11 15:49:19.558409] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=75, tg=0x7f529d2af730, thread_cnt=1, tg->attr_={name:ClusterTimer, type:3}) [2024-09-11 15:49:19.558416] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=76, tg=0x7f529d2af8a0, thread_cnt=1, tg->attr_={name:MergeTimer, type:3}) [2024-09-11 15:49:19.558421] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=77, tg=0x7f529d2afa10, thread_cnt=1, tg->attr_={name:CFC, type:3}) [2024-09-11 15:49:19.558425] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=78, tg=0x7f529d2afb80, thread_cnt=1, tg->attr_={name:CCDF, type:3}) [2024-09-11 15:49:19.558429] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=79, tg=0x7f529d2afcf0, thread_cnt=1, tg->attr_={name:LogMysqlPool, type:3}) [2024-09-11 15:49:19.558434] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=80, tg=0x7f529d2afe60, thread_cnt=1, tg->attr_={name:TblCliSqlPool, type:3}) [2024-09-11 15:49:19.558438] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=81, tg=0x7f529d2adf00, thread_cnt=1, tg->attr_={name:QueryExecCtxGC, type:2}) [2024-09-11 15:49:19.558444] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=82, tg=0x7f529d2b0030, thread_cnt=1, tg->attr_={name:DtlDfc, type:3}) [2024-09-11 15:49:19.558449] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=83, tg=0x7f529d2b01a0, thread_cnt=1, tg->attr_={name:LogIOCb, type:4}) [2024-09-11 15:49:19.558453] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=84, tg=0x7f529d2b03a0, thread_cnt=1, tg->attr_={name:LogSharedQueueThread, type:4}) [2024-09-11 15:49:19.558460] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=85, tg=0x7f529d2b05a0, thread_cnt=1, tg->attr_={name:ReplaySrv, type:4}) [2024-09-11 15:49:19.558464] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=86, tg=0x7f529d2b07a0, thread_cnt=1, tg->attr_={name:LogRouteSrv, type:4}) [2024-09-11 15:49:19.558469] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=87, tg=0x7f529d2b09a0, thread_cnt=1, tg->attr_={name:LogRouterTimer, type:3}) [2024-09-11 15:49:19.558476] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=88, tg=0x7f529d2b2030, thread_cnt=4, tg->attr_={name:LSWorker, type:7}) [2024-09-11 15:49:19.558485] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=89, tg=0x7f529d2ca030, thread_cnt=1, tg->attr_={name:LSIdlePool, type:7}) [2024-09-11 15:49:19.558492] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=90, tg=0x7f529d2e2030, thread_cnt=1, tg->attr_={name:LSDeadPool, type:7}) [2024-09-11 15:49:19.558499] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=91, tg=0x7f529d2b0b10, thread_cnt=1, tg->attr_={name:LSTimer, type:3}) [2024-09-11 15:49:19.558504] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=92, tg=0x7f529d2b0c80, thread_cnt=1, tg->attr_={name:PalfGC, type:3}) [2024-09-11 15:49:19.558508] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=93, tg=0x7f529d2b0df0, thread_cnt=3, tg->attr_={name:LSFreeze, type:4}) [2024-09-11 15:49:19.558514] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=94, tg=0x7f529d2b0ff0, thread_cnt=1, tg->attr_={name:FetchLog, type:4}) [2024-09-11 15:49:19.558520] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=95, tg=0x7f529d2b11f0, thread_cnt=1, tg->attr_={name:DagScheduler, type:2}) [2024-09-11 15:49:19.558525] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=96, tg=0x7f529d2b12b0, thread_cnt=1, tg->attr_={name:DagWorker, type:2}) [2024-09-11 15:49:19.558532] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=97, tg=0x7f529d2b1370, thread_cnt=1, tg->attr_={name:RCSrv, type:4}) [2024-09-11 15:49:19.558536] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=98, tg=0x7f529d2b1570, thread_cnt=1, tg->attr_={name:ApplySrv, type:4}) [2024-09-11 15:49:19.558540] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=99, tg=0x7f529d2b1770, thread_cnt=1, tg->attr_={name:GlobalCtxTimer, type:3}) [2024-09-11 15:49:19.558544] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=100, tg=0x7f529d2b18e0, thread_cnt=1, tg->attr_={name:StorageLogWriter, type:2}) [2024-09-11 15:49:19.558548] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=101, tg=0x7f529d2b19a0, thread_cnt=1, tg->attr_={name:ReplayProcessStat, type:3}) [2024-09-11 15:49:19.558553] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=102, tg=0x7f529d2b1b10, thread_cnt=1, tg->attr_={name:ActiveSessHist, type:3}) [2024-09-11 15:49:19.558557] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=103, tg=0x7f529d2b1c80, thread_cnt=1, tg->attr_={name:CTASCleanUpTimer, type:3}) [2024-09-11 15:49:19.558561] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=104, tg=0x7f529d2b1df0, thread_cnt=1, tg->attr_={name:DDLScanTask, type:3}) [2024-09-11 15:49:19.558567] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=105, tg=0x7f529d2fa030, thread_cnt=1, tg->attr_={name:LSMetaCh, type:3}) [2024-09-11 15:49:19.558571] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=106, tg=0x7f529d2fa1a0, thread_cnt=1, tg->attr_={name:TbMetaCh, type:3}) [2024-09-11 15:49:19.558575] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=107, tg=0x7f529d2fa310, thread_cnt=1, tg->attr_={name:SvrMetaCh, type:3}) [2024-09-11 15:49:19.558579] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=108, tg=0x7f529d2fa480, thread_cnt=1, tg->attr_={name:ArbGCTimerP, type:3}) [2024-09-11 15:49:19.558583] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=109, tg=0x7f529d2fa5f0, thread_cnt=1, tg->attr_={name:DataDictTimer, type:3}) [2024-09-11 15:49:19.558587] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=110, tg=0x7f529d2fa760, thread_cnt=1, tg->attr_={name:CDCSrv, type:2}) [2024-09-11 15:49:19.558591] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=111, tg=0x7f529d2fa820, thread_cnt=1, tg->attr_={name:LogUpdater, type:3}) [2024-09-11 15:49:19.558596] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=112, tg=0x7f529d2fa990, thread_cnt=1, tg->attr_={name:HeartBeatCheckTask, type:3}) [2024-09-11 15:49:19.558600] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=113, tg=0x7f529d2fab00, thread_cnt=1, tg->attr_={name:RedefHeartBeatTask, type:3}) [2024-09-11 15:49:19.558607] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=114, tg=0x7f529d2fac70, thread_cnt=1, tg->attr_={name:SSTableDefragment, type:3}) [2024-09-11 15:49:19.558611] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=115, tg=0x7f529d2fade0, thread_cnt=1, tg->attr_={name:TenantMetaMemMgr, type:3}) [2024-09-11 15:49:19.558617] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=116, tg=0x7f529d2faf50, thread_cnt=1, tg->attr_={name:IngressService, type:3}) [2024-09-11 15:49:19.558621] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=117, tg=0x7f529d2fb0c0, thread_cnt=2, tg->attr_={name:HeartbeatService, type:1}) [2024-09-11 15:49:19.558629] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=118, tg=0x7f529d2fb200, thread_cnt=1, tg->attr_={name:DetectManager, type:2}) [2024-09-11 15:49:19.558633] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=119, tg=0x7f529d2fb2c0, thread_cnt=1, tg->attr_={name:ConfigMgr, type:3}) [2024-09-11 15:49:19.558637] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=120, tg=0x7f529d2fb430, thread_cnt=1, tg->attr_={name:IO_TUNING, type:2}) [2024-09-11 15:49:19.558641] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=121, tg=0x7f529d2fb4f0, thread_cnt=1, tg->attr_={name:IO_SCHEDULE, type:2}) [2024-09-11 15:49:19.558645] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=122, tg=0x7f529d2fb5b0, thread_cnt=1, tg->attr_={name:IO_CALLBACK, type:2}) [2024-09-11 15:49:19.558649] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=123, tg=0x7f529d2fb670, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.558653] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=124, tg=0x7f529d2fb730, thread_cnt=1, tg->attr_={name:IO_HEALTH, type:4}) [2024-09-11 15:49:19.558658] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=125, tg=0x7f529d2fb930, thread_cnt=1, tg->attr_={name:IO_BENCHMARK, type:2}) [2024-09-11 15:49:19.558662] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=126, tg=0x7f529d2fb9f0, thread_cnt=1, tg->attr_={name:TimezoneMgr, type:3}) [2024-09-11 15:49:19.558666] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] create tg succeed(tg_id=127, tg=0x7f529d2fbb60, thread_cnt=1, tg->attr_={name:MasterKeyMgr, type:4}) [2024-09-11 15:49:19.558670] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=128, tg=0x7f529d2fbd60, thread_cnt=1, tg->attr_={name:SrsMgr, type:3}) [2024-09-11 15:49:19.558676] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=129, tg=0x7f529d2fc030, thread_cnt=1, tg->attr_={name:InfoPoolResize, type:3}) [2024-09-11 15:49:19.558680] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=130, tg=0x7f529d2fc1a0, thread_cnt=1, tg->attr_={name:MinorScan, type:3}) [2024-09-11 15:49:19.558685] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=131, tg=0x7f529d2fc310, thread_cnt=1, tg->attr_={name:MajorScan, type:3}) [2024-09-11 15:49:19.558694] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] create tg succeed(tg_id=132, tg=0x7f529d2fc480, thread_cnt=4, tg->attr_={name:TransferSrv, type:1}) [2024-09-11 15:49:19.558698] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=133, tg=0x7f529d2fc5c0, thread_cnt=1, tg->attr_={name:WrTimer, type:3}) [2024-09-11 15:49:19.558706] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=134, tg=0x7f529d2fc730, thread_cnt=6, tg->attr_={name:SvrStartupHandler, type:4}) [2024-09-11 15:49:19.558710] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=135, tg=0x7f529d2fc930, thread_cnt=1, tg->attr_={name:TTLManager, type:3}) [2024-09-11 15:49:19.558714] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=136, tg=0x7f529d2fcaa0, thread_cnt=1, tg->attr_={name:TTLTabletMgr, type:3}) [2024-09-11 15:49:19.558718] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=137, tg=0x7f529d2fcc10, thread_cnt=1, tg->attr_={name:TntSharedTimer, type:3}) [2024-09-11 15:49:19.558722] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=138, tg=0x7f529d2fcd80, thread_cnt=1, tg->attr_={name:LogFetcherBGW, type:3}) [2024-09-11 15:49:19.558729] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=139, tg=0x7f529d2fcef0, thread_cnt=1, tg->attr_={name:TableGroupCommitMgr, type:3}) [2024-09-11 15:49:19.558737] INFO init_config (ob_server.cpp:2042) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] start tg(lib::TGDefIDs::ServerGTimer=37, tg_name=ServerGTimer) [2024-09-11 15:49:19.558989] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74201][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=12884901888) [2024-09-11 15:49:19.559103] INFO register_pm (ob_page_manager.cpp:40) [74201][][T0][Y0-0000000000000000-0-0] [lt=33] register pm finish(ret=0, &pm=0x7f529b256380, pm.get_tid()=74201, tenant_id=500) [2024-09-11 15:49:19.559138] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74201][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.559161] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74201][][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.559263] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ObTimer create success(this=0x7f529d2ad0c0, thread_id=74201, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0xb8d7529 0xb8cbd4c 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:19.559277] INFO init_config (ob_server.cpp:2044) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13] start tg(lib::TGDefIDs::FreezeTimer=38, tg_name=FreezeTimer) [2024-09-11 15:49:19.559434] INFO run1 (ob_timer.cpp:361) [74201][][T0][Y0-0000000000000000-0-0] [lt=5] timer thread started(this=0x7f529d2ad0c0, tid=74201, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:19.559439] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74202][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=17179869184) [2024-09-11 15:49:19.559465] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74201][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.559474] INFO run1 (ob_timer.cpp:374) [74201][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=8] dump timer info(this=0x7f529d2ad0c0, tasks_num=0, wakeup_time=0) [2024-09-11 15:49:19.559508] INFO register_pm (ob_page_manager.cpp:40) [74202][][T0][Y0-0000000000000000-0-0] [lt=32] register pm finish(ret=0, &pm=0x7f529b2d4380, pm.get_tid()=74202, tenant_id=500) [2024-09-11 15:49:19.559527] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74202][][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.559562] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimer create success(this=0x7f529d2ad230, thread_id=74202, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0xb8d75ab 0xb8cbd4c 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:19.559569] INFO init_config (ob_server.cpp:2046) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] start tg(lib::TGDefIDs::SqlMemTimer=39, tg_name=SqlMemTimer) [2024-09-11 15:49:19.559710] INFO run1 (ob_timer.cpp:361) [74202][][T0][Y0-0000000000000000-0-0] [lt=5] timer thread started(this=0x7f529d2ad230, tid=74202, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:19.559713] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74203][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=21474836480) [2024-09-11 15:49:19.559725] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74202][FreezeTimer][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.559766] INFO register_pm (ob_page_manager.cpp:40) [74203][][T0][Y0-0000000000000000-0-0] [lt=11] register pm finish(ret=0, &pm=0x7f529b352380, pm.get_tid()=74203, tenant_id=500) [2024-09-11 15:49:19.559776] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74203][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.559805] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer create success(this=0x7f529d2ad3a0, thread_id=74203, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0xb8d762d 0xb8cbd4c 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:19.559811] INFO init_config (ob_server.cpp:2048) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] start tg(lib::TGDefIDs::ServerTracerTimer=40, tg_name=ServerTracerTimer) [2024-09-11 15:49:19.559962] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74204][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=25769803776) [2024-09-11 15:49:19.559988] INFO run1 (ob_timer.cpp:361) [74203][][T0][Y0-0000000000000000-0-0] [lt=5] timer thread started(this=0x7f529d2ad3a0, tid=74203, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:19.560004] INFO register_pm (ob_page_manager.cpp:40) [74204][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f529b3d0380, pm.get_tid()=74204, tenant_id=500) [2024-09-11 15:49:19.560007] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74203][SqlMemTimer][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.560013] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74204][][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.560038] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer create success(this=0x7f529d2ad510, thread_id=74204, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0xb8d76af 0xb8cbd4c 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:19.560044] INFO init_config (ob_server.cpp:2050) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] start tg(lib::TGDefIDs::CTASCleanUpTimer=103, tg_name=CTASCleanUpTimer) [2024-09-11 15:49:19.560196] INFO run1 (ob_timer.cpp:361) [74204][][T0][Y0-0000000000000000-0-0] [lt=5] timer thread started(this=0x7f529d2ad510, tid=74204, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:19.560212] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74204][ServerTracerTim][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.560238] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74205][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=30064771072) [2024-09-11 15:49:19.560291] INFO register_pm (ob_page_manager.cpp:40) [74205][][T0][Y0-0000000000000000-0-0] [lt=15] register pm finish(ret=0, &pm=0x7f529b056380, pm.get_tid()=74205, tenant_id=500) [2024-09-11 15:49:19.560303] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74205][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.560335] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer create success(this=0x7f529d2b1ca0, thread_id=74205, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0xb8d7738 0xb8cbd4c 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:19.560359] INFO init (ob_config_manager.cpp:68) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] start tg(lib::TGDefIDs::CONFIG_MGR=119, tg_name=ConfigMgr) [2024-09-11 15:49:19.560504] INFO run1 (ob_timer.cpp:361) [74205][][T0][Y0-0000000000000000-0-0] [lt=5] timer thread started(this=0x7f529d2b1ca0, tid=74205, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:19.560506] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74206][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=34359738368) [2024-09-11 15:49:19.560523] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74205][CTASCleanUpTime][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.560563] INFO register_pm (ob_page_manager.cpp:40) [74206][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f529b0d4380, pm.get_tid()=74206, tenant_id=500) [2024-09-11 15:49:19.560571] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74206][][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.560598] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer create success(this=0x7f529d2fb2e0, thread_id=74206, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0x12689969 0xb8d7799 0xb8cbd4c 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:19.560725] INFO run1 (ob_timer.cpp:361) [74206][][T0][Y0-0000000000000000-0-0] [lt=4] timer thread started(this=0x7f529d2fb2e0, tid=74206, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:19.560739] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74206][ConfigMgr][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.560752] INFO [SERVER] check_vm_max_map_count (ob_check_params.cpp:75) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] [check OS params]:vm.max_map_count is within the range(max_map_count=655360) [2024-09-11 15:49:19.560768] INFO [SERVER] check_vm_min_free_kbytes (ob_check_params.cpp:100) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] [check OS params]:vm.min_free_kbytes is within the range(vm_min_free_kbytes=2097152) [2024-09-11 15:49:19.560801] INFO [SERVER] check_vm_overcommit_memory (ob_check_params.cpp:127) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] [check OS params]:vm.overcommit_memory is equal to 0(vm_overcommit_memory=0) [2024-09-11 15:49:19.560954] INFO [SERVER] check_fs_file_max (ob_check_params.cpp:151) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [check OS params]:fs.file-max is greater than or equal to 6573688(fs_file_max=6573688) [2024-09-11 15:49:19.560961] INFO [SERVER] check_ulimit_open_files (ob_check_params.cpp:173) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] [check OS params]:open files limit is greater than or equal to 655300(rlim.rlim_cur=655350, rlim.rlim_max=655350) [2024-09-11 15:49:19.560966] INFO [SERVER] check_ulimit_max_user_processes (ob_check_params.cpp:200) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] [check OS params]:ulimit.max_user_processes is greater than or equal to 655300(rlim.rlim_cur=655350, rlim.rlim_max=655350) [2024-09-11 15:49:19.560977] INFO [SERVER] check_ulimit_core_file_size (ob_check_params.cpp:227) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] [check OS params]:core file size limit is unlimited [2024-09-11 15:49:19.560982] INFO [SERVER] check_ulimit_stack_size (ob_check_params.cpp:245) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [check OS params]:stack size limit is larger than 1M(rlim.rlim_cur=10485760, rlim.rlim_max=10485760) [2024-09-11 15:49:19.561015] WDIAG [SERVER] check_current_clocksource (ob_check_params.cpp:300) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4][errcode=0] [check OS params]:current_clocksource is not [tsc], [kvm-clock], [arch_sys_counter](clocksource="hyperv_clocksource_tsc_page", ret=0) [2024-09-11 15:49:19.561022] INFO [LIB] set_param (achunk_mgr.cpp:42) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set large page param(large_page_type_=0) [2024-09-11 15:49:19.561027] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.561046] INFO [LIB] init (ob_log.cpp:1491) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13] [server_start 2/18] observer syslog service init begin. [2024-09-11 15:49:19.563370] INFO ob_pthread_create (ob_pthread.cpp:26) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ob_pthread_create start [2024-09-11 15:49:19.563542] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74207][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=38654705664) [2024-09-11 15:49:19.563600] INFO register_pm (ob_page_manager.cpp:40) [74207][][T0][Y0-0000000000000000-0-0] [lt=24] register pm finish(ret=0, &pm=0x7f529b152380, pm.get_tid()=74207, tenant_id=500) [2024-09-11 15:49:19.563605] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74207][][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.563613] INFO ob_pthread_create (ob_pthread.cpp:39) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=18] ob_pthread_create succeed(thread=0x7f529d331750) [2024-09-11 15:49:19.563618] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.563626] INFO [LIB] init (ob_log.cpp:1565) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] [server_start 3/18] observer syslog service init success. [2024-09-11 15:49:19.563632] INFO init (ob_log_compressor.cpp:54) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] start tg(TGDefIDs::SYSLOG_COMPRESS=12, tg_name=SyslogCompress) [2024-09-11 15:49:19.563757] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74208][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=42949672960) [2024-09-11 15:49:19.563802] INFO register_pm (ob_page_manager.cpp:40) [74208][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f529b1d0380, pm.get_tid()=74208, tenant_id=500) [2024-09-11 15:49:19.563812] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74208][][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.563819] INFO [LIB] init (ob_log_compressor.cpp:65) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] syslog compressor init finish (ret=0) [2024-09-11 15:49:19.563834] INFO [LIB] run1 (ob_log_compressor.cpp:195) [74208][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=2] syslog compress thread start [2024-09-11 15:49:19.563840] INFO [SERVER.OMT] init (ob_tenant_timezone.cpp:49) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] tenant timezone init(ret=0, tenant_id_=1, sizeof(ObTimeZoneInfoManager)=3072) [2024-09-11 15:49:19.563886] INFO [SERVER.OMT] add_tenant_timezone (ob_tenant_timezone_mgr.cpp:170) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] add tenant timezone success!(tenant_id=1, sizeof(ObTenantTimezone)=3200) [2024-09-11 15:49:19.563900] INFO [SQL] init_sql_factories (ob_sql_init.h:53) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] init sql factories [2024-09-11 15:49:19.566703] INFO [SQL.ENG] create_hash_table (ob_serializable_function.cpp:147) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=26] function serialization hash table created(func_cnt=87260, bucket_size=262144, size=7361, conflicts=156) [2024-09-11 15:49:19.674568] INFO [SHARE] change_initial_value (ob_system_variable.cpp:3269) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=25] succ to change_initial_value(version_comment="OceanBase_CE 4.2.4.0 (r100000082024070810-556a8f594436d32a23ee92289717913cf503184b) (Built Jul 8 2024 11:05:25)", system_time_zone_str="+08:00", default_coll_int_str="45", server_uuid="5a1c0a0f-7012-11ef-803d-6045bd566d45") [2024-09-11 15:49:19.674806] WDIAG [OCCAM] init (ob_vtable_event_recycle_buffer.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=35][errcode=-4002] invalid argument(ret=-4002, mem_tag="MdsEventCache", recycle_buffer_number=0, recycle_buffer_number=0, hash_idx_bkt_num_each=8192) [2024-09-11 15:49:19.674821] WDIAG [OCCAM] init (ob_mds_event_buffer.h:250) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=14][errcode=0] init failed(ret=0, ret="OB_SUCCESS") [2024-09-11 15:49:19.674884] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.675482] WDIAG [SERVER.OMT] get_tenant_config_with_lock (ob_tenant_config_mgr.cpp:369) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7][errcode=-4201] failed to get fallback tenant config(fallback_tenant_id=1, ret=-4201) [2024-09-11 15:49:19.675514] INFO set_str (ob_mem_leak_checker.h:131) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] leak mod to check: NONE [2024-09-11 15:49:19.675549] INFO set_interval (ob_malloc_sample_struct.h:146) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set the min or max malloc times between two samples succeed,max_interval=256, min_interval=16 [2024-09-11 15:49:19.675556] INFO [SERVER] init_pre_setting (ob_server.cpp:2109) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] Whether record old log file(record_old_log_file=false) [2024-09-11 15:49:19.675561] INFO [SERVER] init_pre_setting (ob_server.cpp:2111) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] Whether log warn(log_warn=true) [2024-09-11 15:49:19.675564] INFO [SERVER] init_pre_setting (ob_server.cpp:2114) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Whether compress syslog file(compress_func_ptr="none") [2024-09-11 15:49:19.675573] INFO [SERVER] init_pre_setting (ob_server.cpp:2118) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] init log config(record_old_log_file=false, log_warn=true, enable_async_syslog=true, max_disk_size=0, compress_func_ptr="none", min_uncompressed_count=0) [2024-09-11 15:49:19.675581] INFO [SERVER] init_pre_setting (ob_server.cpp:2120) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] won't recycle log file [2024-09-11 15:49:19.676054] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74209][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=47244640256) [2024-09-11 15:49:19.676160] INFO register_pm (ob_page_manager.cpp:40) [74209][][T0][Y0-0000000000000000-0-0] [lt=68] register pm finish(ret=0, &pm=0x7f5297e56380, pm.get_tid()=74209, tenant_id=500) [2024-09-11 15:49:19.676177] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74209][][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.676195] INFO [SERVER] init_pre_setting (ob_server.cpp:2154) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] set limit memory(limit_memory=57127770931) [2024-09-11 15:49:19.676206] INFO [SERVER] init_pre_setting (ob_server.cpp:2156) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.676966] INFO [STORAGE] init_local_dirs (ob_file_system_router.cpp:161) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] succeed to construct local dir(data_dir_="/data/oceanbase", slog_dir_="/data/oceanbase/slog", clog_dir_="/data/oceanbase/clog", sstable_dir_="/data/oceanbase/sstable") [2024-09-11 15:49:19.676991] INFO init (ob_io_struct.cpp:775) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] start tg(lib::TGDefIDs::IO_TUNING=120, tg_name=IO_TUNING) [2024-09-11 15:49:19.677140] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74210][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=51539607552) [2024-09-11 15:49:19.677213] INFO register_pm (ob_page_manager.cpp:40) [74210][][T0][Y0-0000000000000000-0-0] [lt=57] register pm finish(ret=0, &pm=0x7f5297ed4380, pm.get_tid()=74210, tenant_id=500) [2024-09-11 15:49:19.677227] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74210][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.677254] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] create tg succeed(tg_id=256, tg=0x7f5298f45ef0, thread_cnt=1, tg->attr_={name:IO_SCHEDULE, type:2}) [2024-09-11 15:49:19.677264] INFO [COMMON] run1 (ob_io_struct.cpp:819) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6] io tuner thread started [2024-09-11 15:49:19.677271] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.677278] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=3] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.677317] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] create tg succeed(tg_id=258, tg=0x7f5298f5def0, thread_cnt=1, tg->attr_={name:IO_SCHEDULE, type:2}) [2024-09-11 15:49:19.677341] WDIAG [STORAGE.BLKMGR] get_all_macro_ids (ob_block_manager.cpp:576) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=1][errcode=-4006] fail to for each block map(ret=-4006) [2024-09-11 15:49:19.677352] WDIAG [COMMON] send_detect_task (ob_io_struct.cpp:791) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] fail to get macro ids(ret=-4006, macro_ids=[]) [2024-09-11 15:49:19.677362] WDIAG [COMMON] run1 (ob_io_struct.cpp:826) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] fail to send detect task(ret=-4006) [2024-09-11 15:49:19.677585] WDIAG create_tg_tenant (thread_mgr.h:1032) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0][errcode=0] create tg tenant but tenant tg helper is null(tg_def_id=122, tg_id=272) [2024-09-11 15:49:19.677594] INFO create_tg_tenant (thread_mgr.h:1043) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] create tg succeed(tg_id=272, tg=0x7f529d2fddb0, thread_cnt=1, tg->attr_={name:IO_CALLBACK, type:2}, tg=0x7f529d2fddb0) [2024-09-11 15:49:19.677755] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74211][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=55834574848) [2024-09-11 15:49:19.677829] INFO register_pm (ob_page_manager.cpp:40) [74211][][T0][Y0-0000000000000000-0-0] [lt=37] register pm finish(ret=0, &pm=0x7f5297f52380, pm.get_tid()=74211, tenant_id=500) [2024-09-11 15:49:19.677846] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74211][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.677864] INFO [COMMON] run1 (ob_io_struct.cpp:2602) [74211][DiskCB][T0][Y0-0000000000000000-0-0] [lt=4] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.677968] WDIAG create_tg_tenant (thread_mgr.h:1032) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0][errcode=0] create tg tenant but tenant tg helper is null(tg_def_id=122, tg_id=273) [2024-09-11 15:49:19.677976] INFO create_tg_tenant (thread_mgr.h:1043) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] create tg succeed(tg_id=273, tg=0x7f5298f43e70, thread_cnt=1, tg->attr_={name:IO_CALLBACK, type:2}, tg=0x7f5298f43e70) [2024-09-11 15:49:19.678136] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74212][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=60129542144) [2024-09-11 15:49:19.678196] INFO register_pm (ob_page_manager.cpp:40) [74212][][T0][Y0-0000000000000000-0-0] [lt=45] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.678208] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74212][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.678326] WDIAG create_tg_tenant (thread_mgr.h:1032) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1][errcode=0] create tg tenant but tenant tg helper is null(tg_def_id=122, tg_id=274) [2024-09-11 15:49:19.678334] INFO create_tg_tenant (thread_mgr.h:1043) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=274, tg=0x7f5298e35ed0, thread_cnt=1, tg->attr_={name:IO_CALLBACK, type:2}, tg=0x7f5298e35ed0) [2024-09-11 15:49:19.678489] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74213][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=64424509440) [2024-09-11 15:49:19.678580] INFO register_pm (ob_page_manager.cpp:40) [74213][][T0][Y0-0000000000000000-0-0] [lt=53] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.678591] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74213][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.678614] INFO [COMMON] run1 (ob_io_struct.cpp:2602) [74213][DiskCB][T0][Y0-0000000000000000-0-0] [lt=4] io callback thread started [2024-09-11 15:49:19.678715] WDIAG create_tg_tenant (thread_mgr.h:1032) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1][errcode=0] create tg tenant but tenant tg helper is null(tg_def_id=122, tg_id=275) [2024-09-11 15:49:19.678857] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74214][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=68719476736) [2024-09-11 15:49:19.678919] INFO register_pm (ob_page_manager.cpp:40) [74214][][T0][Y0-0000000000000000-0-0] [lt=39] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.678928] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74214][][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.678946] INFO [COMMON] run1 (ob_io_struct.cpp:2602) [74214][DiskCB][T0][Y0-0000000000000000-0-0] [lt=3] io callback thread started [2024-09-11 15:49:19.679350] WDIAG create_tg_tenant (thread_mgr.h:1032) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0][errcode=0] create tg tenant but tenant tg helper is null(tg_def_id=122, tg_id=276) [2024-09-11 15:49:19.679358] INFO create_tg_tenant (thread_mgr.h:1043) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=276, tg=0x7f5298e3bcb0, thread_cnt=1, tg->attr_={name:IO_CALLBACK, type:2}, tg=0x7f5298e3bcb0) [2024-09-11 15:49:19.679364] INFO init (ob_io_struct.cpp:2551) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] start tg(tg_id_=276, tg_name=IO_CALLBACK) [2024-09-11 15:49:19.679506] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74215][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=73014444032) [2024-09-11 15:49:19.679570] INFO register_pm (ob_page_manager.cpp:40) [74215][][T0][Y0-0000000000000000-0-0] [lt=12] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.679583] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74215][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.679600] INFO [COMMON] run1 (ob_io_struct.cpp:2602) [74215][DiskCB][T0][Y0-0000000000000000-0-0] [lt=3] io callback thread started [2024-09-11 15:49:19.680005] WDIAG create_tg_tenant (thread_mgr.h:1032) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4][errcode=0] create tg tenant but tenant tg helper is null(tg_def_id=122, tg_id=277) [2024-09-11 15:49:19.680012] INFO create_tg_tenant (thread_mgr.h:1043) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=277, tg=0x7f5298e3fcb0, thread_cnt=1, tg->attr_={name:IO_CALLBACK, type:2}, tg=0x7f5298e3fcb0) [2024-09-11 15:49:19.680018] INFO init (ob_io_struct.cpp:2551) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] start tg(tg_id_=277, tg_name=IO_CALLBACK) [2024-09-11 15:49:19.680169] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74216][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=77309411328) [2024-09-11 15:49:19.680218] INFO register_pm (ob_page_manager.cpp:40) [74216][][T0][Y0-0000000000000000-0-0] [lt=16] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.680231] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74216][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.680248] INFO [COMMON] run1 (ob_io_struct.cpp:2602) [74216][DiskCB][T0][Y0-0000000000000000-0-0] [lt=4] io callback thread started [2024-09-11 15:49:19.680652] WDIAG create_tg_tenant (thread_mgr.h:1032) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3][errcode=0] create tg tenant but tenant tg helper is null(tg_def_id=122, tg_id=278) [2024-09-11 15:49:19.680661] INFO create_tg_tenant (thread_mgr.h:1043) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] create tg succeed(tg_id=278, tg=0x7f5298e41d90, thread_cnt=1, tg->attr_={name:IO_CALLBACK, type:2}, tg=0x7f5298e41d90) [2024-09-11 15:49:19.680666] INFO init (ob_io_struct.cpp:2551) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] start tg(tg_id_=278, tg_name=IO_CALLBACK) [2024-09-11 15:49:19.680802] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74217][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=81604378624) [2024-09-11 15:49:19.680857] INFO register_pm (ob_page_manager.cpp:40) [74217][][T0][Y0-0000000000000000-0-0] [lt=9] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.680867] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74217][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.681286] WDIAG create_tg_tenant (thread_mgr.h:1032) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4][errcode=0] create tg tenant but tenant tg helper is null(tg_def_id=122, tg_id=279) [2024-09-11 15:49:19.681295] INFO create_tg_tenant (thread_mgr.h:1043) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] create tg succeed(tg_id=279, tg=0x7f5298e31df0, thread_cnt=1, tg->attr_={name:IO_CALLBACK, type:2}, tg=0x7f5298e31df0) [2024-09-11 15:49:19.681301] INFO init (ob_io_struct.cpp:2551) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] start tg(tg_id_=279, tg_name=IO_CALLBACK) [2024-09-11 15:49:19.681442] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74218][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=85899345920) [2024-09-11 15:49:19.681475] INFO register_pm (ob_page_manager.cpp:40) [74218][][T0][Y0-0000000000000000-0-0] [lt=7] register pm finish(ret=0, &pm=0x7f5296cd4380, pm.get_tid()=74218, tenant_id=500) [2024-09-11 15:49:19.681486] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74218][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.681497] INFO [COMMON] run1 (ob_io_struct.cpp:2602) [74218][DiskCB][T0][Y0-0000000000000000-0-0] [lt=2] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.681597] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.682200] WDIAG [SERVER.OMT] get_tenant_config_with_lock (ob_tenant_config_mgr.cpp:369) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8][errcode=-4201] failed to get fallback tenant config(fallback_tenant_id=1, ret=-4201) [2024-09-11 15:49:19.682273] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.682318] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.682360] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.682366] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.682375] WDIAG [SHARE.SCHEMA] check_inner_stat (ob_server_schema_service.cpp:285) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3][errcode=0] inner stat error(schema_service_=NULL, sql_proxy_=NULL, config_=NULL) [2024-09-11 15:49:19.682393] WDIAG [SHARE.SCHEMA] check_inner_stat (ob_multi_version_schema_service.cpp:1794) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=17][errcode=0] inner stat error(init_=false) [2024-09-11 15:49:19.682402] WDIAG [SHARE.SCHEMA] check_if_tenant_has_been_dropped (ob_multi_version_schema_service.cpp:2067) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5][errcode=-4014] inner stat error(ret=-4014) [2024-09-11 15:49:19.682412] WDIAG [SERVER] nonblock_get_leader (ob_inner_sql_connection.cpp:1906) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8][errcode=-4014] user tenant has been dropped(ret=-4014, ret="OB_INNER_STAT_ERROR", tenant_id=1) [2024-09-11 15:49:19.682419] WDIAG [SERVER] execute_read_inner (ob_inner_sql_connection.cpp:1817) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5][errcode=-4014] nonblock get leader failed(ret=-4014, tenant_id=1, ls_id={id:1}, cluster_id=1719994443) [2024-09-11 15:49:19.682434] WDIAG [SERVER] retry_while_no_tenant_resource (ob_inner_sql_connection.cpp:1054) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11][errcode=-4014] retry_while_no_tenant_resource failed(ret=-4014, tenant_id=1) [2024-09-11 15:49:19.682446] WDIAG [SERVER] execute_read (ob_inner_sql_connection.cpp:1726) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11][errcode=-4014] execute_read failed(ret=-4014, cluster_id=1719994443, tenant_id=1) [2024-09-11 15:49:19.682457] WDIAG [COMMON.MYSQLP] read (ob_mysql_proxy.cpp:131) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5][errcode=-4014] query failed(ret=-4014, conn=0x7f52985fc060, start=1726040959682268, sql=select mode, size, latency, iops from __all_disk_io_calibration where svr_ip = "10.31.35.7" and svr_port = 2882 and storage_name = "DATA") [2024-09-11 15:49:19.682470] WDIAG [COMMON.MYSQLP] read (ob_mysql_proxy.cpp:66) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13][errcode=-4014] read failed(ret=-4014) [2024-09-11 15:49:19.682476] WDIAG [COMMON] parse_calibration_table (ob_io_calibration.cpp:829) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5][errcode=-4014] query failed(ret=-4014, sql_string=select mode, size, latency, iops from __all_disk_io_calibration where svr_ip = "10.31.35.7" and svr_port = 2882 and storage_name = "DATA") [2024-09-11 15:49:19.682549] WDIAG [COMMON] read_from_table (ob_io_calibration.cpp:699) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6][errcode=-4014] parse calibration data failed(ret=-4014) [2024-09-11 15:49:19.682677] WDIAG crc64_sse42_dispatch (ob_crc64.cpp:1149) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7][errcode=0] Use ISAL for crc64 calculate [2024-09-11 15:49:19.682693] INFO [CLOG] update_checksum (ob_server_log_block_mgr.cpp:1529) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] update_checksum success(this={magic:19536, version:1, flag:0, log_pool_meta:{curr_total_size:0, next_total_size:0, status:0}, checksum:4141593973}) [2024-09-11 15:49:19.688296] INFO [CLOG] update_log_pool_meta_guarded_by_lock_ (ob_server_log_block_mgr.cpp:877) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=17] update_log_pool_meta_guarded_by_lock_ success(ret=0, this={dir::"", dir_fd:-1, meta_fd:16, log_pool_meta:{curr_total_size:0, next_total_size:0, status:0}, min_block_id:0, max_block_id:0, min_log_disk_size_for_all_tenants_:0, is_inited:false}) [2024-09-11 15:49:19.696182] INFO [CLOG] scan_log_pool_dir_and_do_trim_ (ob_server_log_block_mgr.cpp:643) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=21] the log pool is empty, no need trime(ret=0, this={dir::"/data/oceanbase/clog/log_pool", dir_fd:15, meta_fd:16, log_pool_meta:{curr_total_size:0, next_total_size:0, status:0}, min_block_id:0, max_block_id:0, min_log_disk_size_for_all_tenants_:0, is_inited:true}) [2024-09-11 15:49:19.696383] INFO [CLOG] deserialize (ob_server_log_block_mgr.cpp:1484) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=25] deserialize LogPoolMeta success(this={curr_total_size:0, next_total_size:0, status:0}, buf="LP") [2024-09-11 15:49:19.696397] INFO [CLOG] deserialize (ob_server_log_block_mgr.cpp:1573) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] deserialize LogPoolMeta success(this={magic:19536, version:1, flag:0, log_pool_meta:{curr_total_size:0, next_total_size:0, status:0}, checksum:4141593973}, buf="LP") [2024-09-11 15:49:19.696414] INFO [CLOG] load_meta_ (ob_server_log_block_mgr.cpp:765) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] load_meta_ success(ret=0, this={dir::"/data/oceanbase/clog/log_pool", dir_fd:15, meta_fd:16, log_pool_meta:{curr_total_size:0, next_total_size:0, status:0}, min_block_id:0, max_block_id:0, min_log_disk_size_for_all_tenants_:0, is_inited:true}) [2024-09-11 15:49:19.696427] INFO [CLOG] try_continous_to_resize_ (ob_server_log_block_mgr.cpp:739) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] current status is normal, no need continous do resize(ret=0, this={dir::"/data/oceanbase/clog/log_pool", dir_fd:15, meta_fd:16, log_pool_meta:{curr_total_size:0, next_total_size:0, status:0}, min_block_id:0, max_block_id:0, min_log_disk_size_for_all_tenants_:0, is_inited:true}) [2024-09-11 15:49:19.696437] INFO [CLOG] do_load_ (ob_server_log_block_mgr.cpp:618) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] do_load_ success(ret=0, this={dir::"/data/oceanbase/clog/log_pool", dir_fd:15, meta_fd:16, log_pool_meta:{curr_total_size:0, next_total_size:0, status:0}, min_block_id:0, max_block_id:0, min_log_disk_size_for_all_tenants_:0, is_inited:true}, time_guard=time guard 'RestartServerBlockMgr' cost too much time, used=5817, time_dist: scan_log_disk_=5527, scan_log_pool_dir_and_do_trim_=53, load_meta_=217, try_continous_to_resize_=11) [2024-09-11 15:49:19.696452] INFO [CLOG] init (ob_server_log_block_mgr.cpp:119) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13] ObServerLogBlockMgr init success(this={dir::"/data/oceanbase/clog/log_pool", dir_fd:15, meta_fd:16, log_pool_meta:{curr_total_size:0, next_total_size:0, status:0}, min_block_id:0, max_block_id:0, min_log_disk_size_for_all_tenants_:0, is_inited:true}) [2024-09-11 15:49:19.696474] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] cal_all_part_disk_default_percentage succ(data_dir="/data/oceanbase/sstable", clog_dir="/data/oceanbase/clog", shared_mode=false, data_disk_total_size=1026107822080, data_disk_default_percentage=90, clog_disk_total_size=255665811456, clog_disk_default_percentage=90) [2024-09-11 15:49:19.696485] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] decide disk size finished(suggested_disk_size=0, suggested_disk_percentage=85, default_disk_percentage=90, total_space=1026107822080, disk_size=872191648768) [2024-09-11 15:49:19.696493] INFO [SERVER] get_data_disk_info_in_config (ob_server_utils.cpp:128) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] get_data_disk_info_in_config(suggested_data_disk_size=0, suggested_clog_disk_size=0, suggested_data_disk_percentage=85, suggested_clog_disk_percentage=85, data_disk_size=872191648768, data_disk_percentage=0) [2024-09-11 15:49:19.696508] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] cal_all_part_disk_default_percentage succ(data_dir="/data/oceanbase/sstable", clog_dir="/data/oceanbase/clog", shared_mode=false, data_disk_total_size=1026107822080, data_disk_default_percentage=90, clog_disk_total_size=255665811456, clog_disk_default_percentage=90) [2024-09-11 15:49:19.696519] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] decide disk size finished(suggested_disk_size=0, suggested_disk_percentage=85, default_disk_percentage=90, total_space=255665811456, disk_size=217315939737) [2024-09-11 15:49:19.696524] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] get_log_disk_info_in_config(suggested_data_disk_size=0, suggested_clog_disk_size=0, suggested_data_disk_percentage=85, suggested_clog_disk_percentage=85, log_disk_size=217315939737, log_disk_percentage=0, total_log_disk_size=255665811456) [2024-09-11 15:49:19.696530] INFO [SERVER] cal_all_part_disk_size (ob_server_utils.cpp:151) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] cal_all_part_disk_size success(suggested_data_disk_size=0, suggested_clog_disk_size=0, suggested_data_disk_percentage=85, suggested_clog_disk_percentage=85, data_disk_size=872191648768, log_disk_size=217315939737, data_disk_percentage=0, log_disk_percentage=0) [2024-09-11 15:49:19.696561] INFO get_device (ob_device_manager.cpp:244) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] try to init device manager! [2024-09-11 15:49:19.708468] INFO alloc_device (ob_device_manager.cpp:210) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] success insert into map!(storage_info.ptr()=0x55eef1888f96, storage_type_prefix=local://) [2024-09-11 15:49:19.708493] INFO alloc_device (ob_device_manager.cpp:226) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=24] alloc a new device!(storage_info.ptr()=0x55eef1888f96, storage_type_prefix=local://, avai_idx=0, device_count_=1, device_handle=0x7f5299032080) [2024-09-11 15:49:19.708808] INFO [SHARE] init (ob_io_device_helper.cpp:190) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] finish to init io device(ret=0, data_dir="/data/oceanbase", sstable_dir="/data/oceanbase/sstable", block_size=2097152, data_disk_percentage=0, data_disk_size=872191648768) [2024-09-11 15:49:19.708828] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] create tg succeed(tg_id=280, tg=0x7f5298e33ed0, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.708925] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13] start tg(tg_id_=280, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.709128] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74219][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=90194313216) [2024-09-11 15:49:19.709241] INFO register_pm (ob_page_manager.cpp:40) [74219][][T0][Y0-0000000000000000-0-0] [lt=29] register pm finish(ret=0, &pm=0x7f5296d52380, pm.get_tid()=74219, tenant_id=500) [2024-09-11 15:49:19.709258] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74219][][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.709275] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] create tg succeed(tg_id=281, tg=0x7f5298e49df0, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.709288] INFO [COMMON] run1 (ob_io_struct.cpp:1972) [74219][IO_GETEVENT0][T0][Y0-0000000000000000-0-0] [lt=5] io get_events thread started(thread_id=0, tg_id_=280) [2024-09-11 15:49:19.709323] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] start tg(tg_id_=281, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.709489] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74220][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=94489280512) [2024-09-11 15:49:19.709582] INFO register_pm (ob_page_manager.cpp:40) [74220][][T0][Y0-0000000000000000-0-0] [lt=23] register pm finish(ret=0, &pm=0x7f5296dd0380, pm.get_tid()=74220, tenant_id=500) [2024-09-11 15:49:19.709600] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74220][][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.709612] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] create tg succeed(tg_id=282, tg=0x7f5298e4ded0, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.709620] INFO [COMMON] run1 (ob_io_struct.cpp:1972) [74220][IO_GETEVENT0][T0][Y0-0000000000000000-0-0] [lt=5] io get_events thread started(thread_id=0, tg_id_=281) [2024-09-11 15:49:19.709657] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] start tg(tg_id_=282, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.709812] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74221][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=98784247808) [2024-09-11 15:49:19.709928] INFO register_pm (ob_page_manager.cpp:40) [74221][][T0][Y0-0000000000000000-0-0] [lt=23] register pm finish(ret=0, &pm=0x7f5296656380, pm.get_tid()=74221, tenant_id=500) [2024-09-11 15:49:19.709952] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74221][][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.709963] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=283, tg=0x7f5298e61ec0, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.709974] INFO [COMMON] run1 (ob_io_struct.cpp:1972) [74221][IO_GETEVENT0][T0][Y0-0000000000000000-0-0] [lt=5] io get_events thread started(thread_id=0, tg_id_=282) [2024-09-11 15:49:19.710016] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] start tg(tg_id_=283, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.710166] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74222][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=103079215104) [2024-09-11 15:49:19.710238] INFO register_pm (ob_page_manager.cpp:40) [74222][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f52966d4380, pm.get_tid()=74222, tenant_id=500) [2024-09-11 15:49:19.710252] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74222][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.710261] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=284, tg=0x7f5298e69cb0, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.710268] INFO [COMMON] run1 (ob_io_struct.cpp:1972) [74222][IO_GETEVENT0][T0][Y0-0000000000000000-0-0] [lt=3] io get_events thread started(thread_id=0, tg_id_=283) [2024-09-11 15:49:19.710302] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] start tg(tg_id_=284, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.710437] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74223][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=107374182400) [2024-09-11 15:49:19.710500] INFO register_pm (ob_page_manager.cpp:40) [74223][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f5296752380, pm.get_tid()=74223, tenant_id=500) [2024-09-11 15:49:19.710514] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74223][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.710521] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=285, tg=0x7f5298e59cb0, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.710528] INFO [COMMON] run1 (ob_io_struct.cpp:1972) [74223][IO_GETEVENT0][T0][Y0-0000000000000000-0-0] [lt=3] io get_events thread started(thread_id=0, tg_id_=284) [2024-09-11 15:49:19.710562] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] start tg(tg_id_=285, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.710698] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74224][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=111669149696) [2024-09-11 15:49:19.710760] INFO register_pm (ob_page_manager.cpp:40) [74224][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f52967d0380, pm.get_tid()=74224, tenant_id=500) [2024-09-11 15:49:19.710773] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74224][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.710781] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] create tg succeed(tg_id=286, tg=0x7f5298e63d90, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.710788] INFO [COMMON] run1 (ob_io_struct.cpp:1972) [74224][IO_GETEVENT0][T0][Y0-0000000000000000-0-0] [lt=3] io get_events thread started(thread_id=0, tg_id_=285) [2024-09-11 15:49:19.710828] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] start tg(tg_id_=286, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.711008] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74225][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=115964116992) [2024-09-11 15:49:19.711101] INFO register_pm (ob_page_manager.cpp:40) [74225][][T0][Y0-0000000000000000-0-0] [lt=24] register pm finish(ret=0, &pm=0x7f5296456380, pm.get_tid()=74225, tenant_id=500) [2024-09-11 15:49:19.711119] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74225][][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.711133] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] create tg succeed(tg_id=287, tg=0x7f5298e65df0, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.711146] INFO [COMMON] run1 (ob_io_struct.cpp:1972) [74225][IO_GETEVENT0][T0][Y0-0000000000000000-0-0] [lt=5] io get_events thread started(thread_id=0, tg_id_=286) [2024-09-11 15:49:19.711178] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] start tg(tg_id_=287, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.711314] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74226][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=120259084288) [2024-09-11 15:49:19.711378] INFO register_pm (ob_page_manager.cpp:40) [74226][][T0][Y0-0000000000000000-0-0] [lt=11] register pm finish(ret=0, &pm=0x7f52964d4380, pm.get_tid()=74226, tenant_id=500) [2024-09-11 15:49:19.711393] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74226][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.711402] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] create tg succeed(tg_id=288, tg=0x7f5298e75ed0, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.711409] INFO [COMMON] run1 (ob_io_struct.cpp:1972) [74226][IO_GETEVENT0][T0][Y0-0000000000000000-0-0] [lt=4] io get_events thread started(thread_id=0, tg_id_=287) [2024-09-11 15:49:19.711420] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] start tg(tg_id_=288, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.711554] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74227][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=124554051584) [2024-09-11 15:49:19.711618] INFO register_pm (ob_page_manager.cpp:40) [74227][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f5296552380, pm.get_tid()=74227, tenant_id=500) [2024-09-11 15:49:19.711631] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74227][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.711641] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create tg succeed(tg_id=289, tg=0x7f52971ff300, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.711649] INFO [COMMON] run1 (ob_io_struct.cpp:2257) [74227][IO_SYNC_CH0][T0][Y0-0000000000000000-0-0] [lt=3] sync io thread started(thread_id=0, tg_id_=288) [2024-09-11 15:49:19.711654] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] start tg(tg_id_=289, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.711787] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74228][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=128849018880) [2024-09-11 15:49:19.711848] INFO register_pm (ob_page_manager.cpp:40) [74228][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52965d0380, pm.get_tid()=74228, tenant_id=500) [2024-09-11 15:49:19.711862] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74228][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.711871] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=290, tg=0x7f5296f8d3e0, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.711878] INFO [COMMON] run1 (ob_io_struct.cpp:2257) [74228][IO_SYNC_CH0][T0][Y0-0000000000000000-0-0] [lt=3] sync io thread started(thread_id=0, tg_id_=289) [2024-09-11 15:49:19.711885] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] start tg(tg_id_=290, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.712028] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74229][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=133143986176) [2024-09-11 15:49:19.712089] INFO register_pm (ob_page_manager.cpp:40) [74229][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f5296256380, pm.get_tid()=74229, tenant_id=500) [2024-09-11 15:49:19.712102] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74229][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.712111] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] create tg succeed(tg_id=291, tg=0x7f5296f9f300, thread_cnt=1, tg->attr_={name:IO_CHANNEL, type:2}) [2024-09-11 15:49:19.712118] INFO [COMMON] run1 (ob_io_struct.cpp:2257) [74229][IO_SYNC_CH0][T0][Y0-0000000000000000-0-0] [lt=3] sync io thread started(thread_id=0, tg_id_=290) [2024-09-11 15:49:19.712126] INFO start_thread (ob_io_struct.cpp:1864) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] start tg(tg_id_=291, tg_name=IO_CHANNEL) [2024-09-11 15:49:19.712262] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74230][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=137438953472) [2024-09-11 15:49:19.712324] INFO register_pm (ob_page_manager.cpp:40) [74230][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f52962d4380, pm.get_tid()=74230, tenant_id=500) [2024-09-11 15:49:19.712336] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74230][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.712350] INFO [COMMON] run1 (ob_io_struct.cpp:2257) [74230][IO_SYNC_CH0][T0][Y0-0000000000000000-0-0] [lt=3] sync io thread started(thread_id=0, tg_id_=291) [2024-09-11 15:49:19.712350] INFO [COMMON] add_device_channel (ob_io_manager.cpp:425) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] add io device channel succ(device_handle=0x7f5299032080) [2024-09-11 15:49:19.712619] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.712629] WDIAG [COMMON] get_instance (memory_dump.cpp:106) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9][errcode=-4006] memory dump not init [2024-09-11 15:49:19.712635] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.712664] INFO [COMMON] init (memory_dump.cpp:130) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] pre memory size(sizeof(PreAllocMemory)=12760320) [2024-09-11 15:49:19.716387] INFO init (memory_dump.cpp:151) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] start tg(TGDefIDs::MEMORY_DUMP=8, tg_name=memDump) [2024-09-11 15:49:19.716558] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74231][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=141733920768) [2024-09-11 15:49:19.716624] INFO register_pm (ob_page_manager.cpp:40) [74231][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f5296352380, pm.get_tid()=74231, tenant_id=500) [2024-09-11 15:49:19.716635] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74231][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.716654] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.716683] INFO [COMMON] get_suitable_bucket_num (ob_kv_storecache.cpp:187) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] The ObKVGlobalCache set suitable kvcache buckets(bucket_num=12582917, server_memory_factor=27, reserved_memory=1288490188) [2024-09-11 15:49:19.729095] INFO [COMMON] init (ob_kvcache_store.cpp:97) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] ObKVCacheStore init success(max_cache_size=67209142272, block_size=2080768) [2024-09-11 15:49:19.777498] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.802319] INFO init (ob_kv_storecache.cpp:223) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=24] start tg(lib::TGDefIDs::KVCacheWash=42, tg_name=KVCacheWash) [2024-09-11 15:49:19.802558] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74233][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=146028888064) [2024-09-11 15:49:19.802662] INFO register_pm (ob_page_manager.cpp:40) [74233][][T0][Y0-0000000000000000-0-0] [lt=27] register pm finish(ret=0, &pm=0x7f52963d0380, pm.get_tid()=74233, tenant_id=500) [2024-09-11 15:49:19.802680] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74233][][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.802727] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=23] ObTimer create success(this=0x7f529d2ad7f0, thread_id=74233, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0x1159e0f7 0xb8cdbcd 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:19.802739] INFO init (ob_kv_storecache.cpp:225) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] start tg(lib::TGDefIDs::KVCacheRep=43, tg_name=KVCacheRep) [2024-09-11 15:49:19.802929] INFO run1 (ob_timer.cpp:361) [74233][][T0][Y0-0000000000000000-0-0] [lt=5] timer thread started(this=0x7f529d2ad7f0, tid=74233, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:19.802920] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74234][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=150323855360) [2024-09-11 15:49:19.802956] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.803014] INFO register_pm (ob_page_manager.cpp:40) [74234][][T0][Y0-0000000000000000-0-0] [lt=18] register pm finish(ret=0, &pm=0x7f528a656380, pm.get_tid()=74234, tenant_id=500) [2024-09-11 15:49:19.803034] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.803066] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] ObTimer create success(this=0x7f529d2ad960, thread_id=74234, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0x1159e177 0xb8cdbcd 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:19.803084] INFO [COMMON] reload_wash_interval (ob_kv_storecache.cpp:818) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] success to reload_wash_interval(wash_interval=200000) [2024-09-11 15:49:19.803096] INFO [COMMON] init (ob_kv_storecache.cpp:252) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=12] ObKVGlobalCache has been inited!(bucket_num=12582917, max_cache_size=67209142272, block_size=2080768) [2024-09-11 15:49:19.803222] INFO run1 (ob_timer.cpp:361) [74234][][T0][Y0-0000000000000000-0-0] [lt=5] timer thread started(this=0x7f529d2ad960, tid=74234, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:19.803242] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.803761] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15226476118660514297, table={database_id:201001, name_case_mode:2, table_name:"__all_core_table"}, strlen=16) [2024-09-11 15:49:19.803974] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=16] set tenant space table name(key=12077705988849111579, table={database_id:201001, name_case_mode:2, table_name:"__all_table"}, strlen=11) [2024-09-11 15:49:19.804042] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=11727259994073319751, table={database_id:201001, name_case_mode:2, table_name:"__all_column"}, strlen=12) [2024-09-11 15:49:19.804070] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=487700392585173101, table={database_id:201001, name_case_mode:2, table_name:"__all_ddl_operation"}, strlen=19) [2024-09-11 15:49:19.804162] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3662393253953293139, table={database_id:201001, name_case_mode:2, table_name:"__all_user"}, strlen=10) [2024-09-11 15:49:19.804239] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=10347691945195890309, table={database_id:201001, name_case_mode:2, table_name:"__all_user_history"}, strlen=18) [2024-09-11 15:49:19.804262] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6478477434419865197, table={database_id:201001, name_case_mode:2, table_name:"__all_database"}, strlen=14) [2024-09-11 15:49:19.804288] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12324969384525918141, table={database_id:201001, name_case_mode:2, table_name:"__all_database_history"}, strlen=22) [2024-09-11 15:49:19.804322] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6544939996090161411, table={database_id:201001, name_case_mode:2, table_name:"__all_tablegroup"}, strlen=16) [2024-09-11 15:49:19.804361] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9230174574550506209, table={database_id:201001, name_case_mode:2, table_name:"__all_tablegroup_history"}, strlen=24) [2024-09-11 15:49:19.804398] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=15076769442941540929, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant"}, strlen=12) [2024-09-11 15:49:19.804432] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=2103283252546922553, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_history"}, strlen=20) [2024-09-11 15:49:19.804468] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13279045070842814367, table={database_id:201001, name_case_mode:2, table_name:"__all_table_privilege"}, strlen=21) [2024-09-11 15:49:19.804507] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=17681914463146072195, table={database_id:201001, name_case_mode:2, table_name:"__all_table_privilege_history"}, strlen=29) [2024-09-11 15:49:19.804539] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18198147208370910105, table={database_id:201001, name_case_mode:2, table_name:"__all_database_privilege"}, strlen=24) [2024-09-11 15:49:19.804572] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=13335089156427463537, table={database_id:201001, name_case_mode:2, table_name:"__all_database_privilege_history"}, strlen=32) [2024-09-11 15:49:19.804721] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8386627974535773695, table={database_id:201001, name_case_mode:2, table_name:"__all_table_history"}, strlen=19) [2024-09-11 15:49:19.804782] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17940619070668235193, table={database_id:201001, name_case_mode:2, table_name:"__all_column_history"}, strlen=20) [2024-09-11 15:49:19.804800] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=804168397464531157, table={database_id:201001, name_case_mode:2, table_name:"__all_zone"}, strlen=10) [2024-09-11 15:49:19.804832] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8232794103823547407, table={database_id:201001, name_case_mode:2, table_name:"__all_server"}, strlen=12) [2024-09-11 15:49:19.804868] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=6703665805633317969, table={database_id:201001, name_case_mode:2, table_name:"__all_sys_parameter"}, strlen=19) [2024-09-11 15:49:19.804899] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9851932463369305511, table={database_id:201001, name_case_mode:2, table_name:"__tenant_parameter"}, strlen=18) [2024-09-11 15:49:19.804937] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] set tenant space table name(key=16642653260683727133, table={database_id:201001, name_case_mode:2, table_name:"__all_sys_variable"}, strlen=18) [2024-09-11 15:49:19.804957] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13070089431139260123, table={database_id:201001, name_case_mode:2, table_name:"__all_sys_stat"}, strlen=14) [2024-09-11 15:49:19.804987] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=9069418420064527651, table={database_id:201001, name_case_mode:2, table_name:"__all_unit"}, strlen=10) [2024-09-11 15:49:19.805011] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=15515320811484657339, table={database_id:201001, name_case_mode:2, table_name:"__all_unit_config"}, strlen=17) [2024-09-11 15:49:19.805033] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5474482723362942009, table={database_id:201001, name_case_mode:2, table_name:"__all_resource_pool"}, strlen=19) [2024-09-11 15:49:19.805049] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5876952487480195497, table={database_id:201001, name_case_mode:2, table_name:"__all_charset"}, strlen=13) [2024-09-11 15:49:19.805068] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=1795113162659580005, table={database_id:201001, name_case_mode:2, table_name:"__all_collation"}, strlen=15) [2024-09-11 15:49:19.805086] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1716155363434330697, table={database_id:201003, name_case_mode:2, table_name:"help_topic"}, strlen=10) [2024-09-11 15:49:19.805101] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8973188859429806243, table={database_id:201003, name_case_mode:2, table_name:"help_category"}, strlen=13) [2024-09-11 15:49:19.805116] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=15499975339262925301, table={database_id:201003, name_case_mode:2, table_name:"help_keyword"}, strlen=12) [2024-09-11 15:49:19.805135] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=13088092480086163129, table={database_id:201003, name_case_mode:2, table_name:"help_relation"}, strlen=13) [2024-09-11 15:49:19.805146] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=18193494207799034211, table={database_id:201001, name_case_mode:2, table_name:"__all_dummy"}, strlen=11) [2024-09-11 15:49:19.805179] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=663992401372972439, table={database_id:201001, name_case_mode:2, table_name:"__all_rootservice_event_history"}, strlen=31) [2024-09-11 15:49:19.805192] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10039099160382870579, table={database_id:201001, name_case_mode:2, table_name:"__all_privilege"}, strlen=15) [2024-09-11 15:49:19.805235] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=3521308379172393619, table={database_id:201001, name_case_mode:2, table_name:"__all_outline"}, strlen=13) [2024-09-11 15:49:19.805277] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=500774069721720243, table={database_id:201001, name_case_mode:2, table_name:"__all_outline_history"}, strlen=21) [2024-09-11 15:49:19.805298] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1042921113981961667, table={database_id:201001, name_case_mode:2, table_name:"__all_recyclebin"}, strlen=16) [2024-09-11 15:49:19.805348] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=16848244930256647885, table={database_id:201001, name_case_mode:2, table_name:"__all_part"}, strlen=10) [2024-09-11 15:49:19.805401] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1367570675294393285, table={database_id:201001, name_case_mode:2, table_name:"__all_part_history"}, strlen=18) [2024-09-11 15:49:19.805444] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=13286699829075481941, table={database_id:201001, name_case_mode:2, table_name:"__all_sub_part"}, strlen=14) [2024-09-11 15:49:19.805485] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=4602243002968661693, table={database_id:201001, name_case_mode:2, table_name:"__all_sub_part_history"}, strlen=22) [2024-09-11 15:49:19.805533] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17799652704697731175, table={database_id:201001, name_case_mode:2, table_name:"__all_part_info"}, strlen=15) [2024-09-11 15:49:19.805576] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3031936591718982951, table={database_id:201001, name_case_mode:2, table_name:"__all_part_info_history"}, strlen=23) [2024-09-11 15:49:19.805612] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6214301824114323613, table={database_id:201001, name_case_mode:2, table_name:"__all_def_sub_part"}, strlen=18) [2024-09-11 15:49:19.805652] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=15431532259233437141, table={database_id:201001, name_case_mode:2, table_name:"__all_def_sub_part_history"}, strlen=26) [2024-09-11 15:49:19.805685] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14299411459193732821, table={database_id:201001, name_case_mode:2, table_name:"__all_server_event_history"}, strlen=26) [2024-09-11 15:49:19.805726] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=4474134102491154269, table={database_id:201001, name_case_mode:2, table_name:"__all_rootservice_job"}, strlen=21) [2024-09-11 15:49:19.805753] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9294579269041697877, table={database_id:201001, name_case_mode:2, table_name:"__all_sys_variable_history"}, strlen=26) [2024-09-11 15:49:19.805770] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=8407162095714011381, table={database_id:201001, name_case_mode:2, table_name:"__all_restore_job"}, strlen=17) [2024-09-11 15:49:19.805834] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=15405363549951447867, table={database_id:201001, name_case_mode:2, table_name:"__all_restore_job_history"}, strlen=25) [2024-09-11 15:49:19.805855] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] set tenant space table name(key=15126336451296145195, table={database_id:201001, name_case_mode:2, table_name:"__all_ddl_id"}, strlen=12) [2024-09-11 15:49:19.805888] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=6556147850475236615, table={database_id:201001, name_case_mode:2, table_name:"__all_foreign_key"}, strlen=17) [2024-09-11 15:49:19.805932] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6003916054558667195, table={database_id:201001, name_case_mode:2, table_name:"__all_foreign_key_history"}, strlen=25) [2024-09-11 15:49:19.805952] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=14983513593375415935, table={database_id:201001, name_case_mode:2, table_name:"__all_foreign_key_column"}, strlen=24) [2024-09-11 15:49:19.805975] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=17259218636947690865, table={database_id:201001, name_case_mode:2, table_name:"__all_foreign_key_column_history"}, strlen=32) [2024-09-11 15:49:19.805998] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3369309189063807079, table={database_id:201001, name_case_mode:2, table_name:"__all_synonym"}, strlen=13) [2024-09-11 15:49:19.806021] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=6164942491782496947, table={database_id:201001, name_case_mode:2, table_name:"__all_synonym_history"}, strlen=21) [2024-09-11 15:49:19.806043] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=15707315468013655865, table={database_id:201001, name_case_mode:2, table_name:"__all_auto_increment"}, strlen=20) [2024-09-11 15:49:19.806065] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=15481048351588947741, table={database_id:201001, name_case_mode:2, table_name:"__all_ddl_checksum"}, strlen=18) [2024-09-11 15:49:19.806101] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2966663788907865603, table={database_id:201001, name_case_mode:2, table_name:"__all_routine"}, strlen=13) [2024-09-11 15:49:19.806142] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=12467473665640905523, table={database_id:201001, name_case_mode:2, table_name:"__all_routine_history"}, strlen=21) [2024-09-11 15:49:19.806188] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4525265300527736011, table={database_id:201001, name_case_mode:2, table_name:"__all_routine_param"}, strlen=19) [2024-09-11 15:49:19.806230] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1218314858947921743, table={database_id:201001, name_case_mode:2, table_name:"__all_routine_param_history"}, strlen=27) [2024-09-11 15:49:19.806259] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4625667915141197935, table={database_id:201001, name_case_mode:2, table_name:"__all_package"}, strlen=13) [2024-09-11 15:49:19.806289] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9350636482973666035, table={database_id:201001, name_case_mode:2, table_name:"__all_package_history"}, strlen=21) [2024-09-11 15:49:19.806311] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=998393027456732053, table={database_id:201001, name_case_mode:2, table_name:"__all_acquired_snapshot"}, strlen=23) [2024-09-11 15:49:19.806339] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5556373293997605449, table={database_id:201001, name_case_mode:2, table_name:"__all_constraint"}, strlen=16) [2024-09-11 15:49:19.806367] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=11475804357484972513, table={database_id:201001, name_case_mode:2, table_name:"__all_constraint_history"}, strlen=24) [2024-09-11 15:49:19.806383] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14671751299176157395, table={database_id:201001, name_case_mode:2, table_name:"__all_ori_schema_version"}, strlen=24) [2024-09-11 15:49:19.806404] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14111330992233147957, table={database_id:201001, name_case_mode:2, table_name:"__all_func"}, strlen=10) [2024-09-11 15:49:19.806430] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=8118547034481856581, table={database_id:201001, name_case_mode:2, table_name:"__all_func_history"}, strlen=18) [2024-09-11 15:49:19.806442] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1110452371895440697, table={database_id:201001, name_case_mode:2, table_name:"__all_temp_table"}, strlen=16) [2024-09-11 15:49:19.806476] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=8706279734557067381, table={database_id:201001, name_case_mode:2, table_name:"__all_sequence_object"}, strlen=21) [2024-09-11 15:49:19.806507] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=311492729514872259, table={database_id:201001, name_case_mode:2, table_name:"__all_sequence_object_history"}, strlen=29) [2024-09-11 15:49:19.806521] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=16250243702109460225, table={database_id:201001, name_case_mode:2, table_name:"__all_sequence_value"}, strlen=20) [2024-09-11 15:49:19.806539] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=3721853868477607205, table={database_id:201001, name_case_mode:2, table_name:"__all_freeze_schema_version"}, strlen=27) [2024-09-11 15:49:19.806579] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11087628166864537917, table={database_id:201001, name_case_mode:2, table_name:"__all_type"}, strlen=10) [2024-09-11 15:49:19.806616] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=12680554093421879877, table={database_id:201001, name_case_mode:2, table_name:"__all_type_history"}, strlen=18) [2024-09-11 15:49:19.806654] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9536818930262141557, table={database_id:201001, name_case_mode:2, table_name:"__all_type_attr"}, strlen=15) [2024-09-11 15:49:19.806690] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9185925756457514023, table={database_id:201001, name_case_mode:2, table_name:"__all_type_attr_history"}, strlen=23) [2024-09-11 15:49:19.806722] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9408247421213979999, table={database_id:201001, name_case_mode:2, table_name:"__all_coll_type"}, strlen=15) [2024-09-11 15:49:19.806758] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=7521902980132874023, table={database_id:201001, name_case_mode:2, table_name:"__all_coll_type_history"}, strlen=23) [2024-09-11 15:49:19.806779] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13388842482819813155, table={database_id:201001, name_case_mode:2, table_name:"__all_weak_read_service"}, strlen=23) [2024-09-11 15:49:19.806826] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=265138247334288457, table={database_id:201001, name_case_mode:2, table_name:"__all_dblink"}, strlen=12) [2024-09-11 15:49:19.806877] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=6709520633702190649, table={database_id:201001, name_case_mode:2, table_name:"__all_dblink_history"}, strlen=20) [2024-09-11 15:49:19.806896] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=2028679341034938537, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_role_grantee_map"}, strlen=29) [2024-09-11 15:49:19.806927] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13] set tenant space table name(key=1031911103916912531, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_role_grantee_map_history"}, strlen=37) [2024-09-11 15:49:19.806951] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=4910421004887031027, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_keystore"}, strlen=21) [2024-09-11 15:49:19.806977] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5332820740432672259, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_keystore_history"}, strlen=29) [2024-09-11 15:49:19.806998] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13117474934449926091, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_ols_policy"}, strlen=23) [2024-09-11 15:49:19.807022] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=18082021277245346327, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_ols_policy_history"}, strlen=31) [2024-09-11 15:49:19.807047] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=1724644558237091093, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_ols_component"}, strlen=26) [2024-09-11 15:49:19.807077] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14980706431689169701, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_ols_component_history"}, strlen=34) [2024-09-11 15:49:19.807098] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15601369921806167451, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_ols_label"}, strlen=22) [2024-09-11 15:49:19.807120] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=266144608167419341, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_ols_label_history"}, strlen=30) [2024-09-11 15:49:19.807143] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1896378858718403101, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_ols_user_level"}, strlen=27) [2024-09-11 15:49:19.807169] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7358788553473219103, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_ols_user_level_history"}, strlen=35) [2024-09-11 15:49:19.807189] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=5673522745085988803, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_tablespace"}, strlen=23) [2024-09-11 15:49:19.807212] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15882626076296079127, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_tablespace_history"}, strlen=31) [2024-09-11 15:49:19.807231] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=13665960389019087645, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_user_failed_login_stat"}, strlen=35) [2024-09-11 15:49:19.807263] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6409691859953470681, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_profile"}, strlen=20) [2024-09-11 15:49:19.807296] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=1398456045760357577, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_profile_history"}, strlen=28) [2024-09-11 15:49:19.807317] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8629536137880323733, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_security_audit"}, strlen=27) [2024-09-11 15:49:19.807343] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10566526679905020831, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_security_audit_history"}, strlen=35) [2024-09-11 15:49:19.807405] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3533070307346278799, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_trigger"}, strlen=20) [2024-09-11 15:49:19.807461] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3200646983440820425, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_trigger_history"}, strlen=28) [2024-09-11 15:49:19.807492] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16301959326055699619, table={database_id:201001, name_case_mode:2, table_name:"__all_seed_parameter"}, strlen=20) [2024-09-11 15:49:19.807572] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=14514248590458868153, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_security_audit_record"}, strlen=34) [2024-09-11 15:49:19.807590] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16525368402904849221, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_sysauth"}, strlen=20) [2024-09-11 15:49:19.807611] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2505673765478814921, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_sysauth_history"}, strlen=28) [2024-09-11 15:49:19.807633] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=11575954516769260421, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_objauth"}, strlen=20) [2024-09-11 15:49:19.807661] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=4245225539433991177, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_objauth_history"}, strlen=28) [2024-09-11 15:49:19.807675] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9257112491128637401, table={database_id:201001, name_case_mode:2, table_name:"__all_restore_info"}, strlen=18) [2024-09-11 15:49:19.807704] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=720157880997668007, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_error"}, strlen=18) [2024-09-11 15:49:19.807727] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17852559657101847729, table={database_id:201001, name_case_mode:2, table_name:"__all_restore_progress"}, strlen=22) [2024-09-11 15:49:19.807765] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7678268654218451217, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_object_type"}, strlen=24) [2024-09-11 15:49:19.807807] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13572145316021120241, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_object_type_history"}, strlen=32) [2024-09-11 15:49:19.807822] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15486192117395989245, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_time_zone"}, strlen=22) [2024-09-11 15:49:19.807838] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=17905961867763276171, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_time_zone_name"}, strlen=27) [2024-09-11 15:49:19.807856] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=8880680013683945841, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_time_zone_transition"}, strlen=33) [2024-09-11 15:49:19.807876] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8725935798345421989, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_time_zone_transition_type"}, strlen=38) [2024-09-11 15:49:19.807898] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=14941346610507177611, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_constraint_column"}, strlen=30) [2024-09-11 15:49:19.807933] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=14] set tenant space table name(key=9732128688555474845, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_constraint_column_history"}, strlen=38) [2024-09-11 15:49:19.807965] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12313307187600527045, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_global_transaction"}, strlen=31) [2024-09-11 15:49:19.807996] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=6535267976628650171, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_dependency"}, strlen=23) [2024-09-11 15:49:19.808016] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2683210741194592195, table={database_id:201001, name_case_mode:2, table_name:"__all_res_mgr_plan"}, strlen=18) [2024-09-11 15:49:19.808040] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=321165096716538023, table={database_id:201001, name_case_mode:2, table_name:"__all_res_mgr_directive"}, strlen=23) [2024-09-11 15:49:19.808059] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=640502581641158861, table={database_id:201001, name_case_mode:2, table_name:"__all_res_mgr_mapping_rule"}, strlen=26) [2024-09-11 15:49:19.808092] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=14745175144824914563, table={database_id:201001, name_case_mode:2, table_name:"__all_ddl_error_message"}, strlen=23) [2024-09-11 15:49:19.808118] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=14712446561922070599, table={database_id:201001, name_case_mode:2, table_name:"__all_space_usage"}, strlen=17) [2024-09-11 15:49:19.808184] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3299497049567549729, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_set_files"}, strlen=22) [2024-09-11 15:49:19.808201] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=18182191731230995467, table={database_id:201001, name_case_mode:2, table_name:"__all_res_mgr_consumer_group"}, strlen=28) [2024-09-11 15:49:19.808220] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=13923207293091690251, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_info"}, strlen=17) [2024-09-11 15:49:19.808253] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5788276983515769643, table={database_id:201001, name_case_mode:2, table_name:"__all_ddl_task_status"}, strlen=21) [2024-09-11 15:49:19.808273] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14345458131120366555, table={database_id:201001, name_case_mode:2, table_name:"__all_region_network_bandwidth_limit"}, strlen=36) [2024-09-11 15:49:19.808313] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17893919763894948745, table={database_id:201001, name_case_mode:2, table_name:"__all_deadlock_event_history"}, strlen=28) [2024-09-11 15:49:19.808350] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15938259562735129653, table={database_id:201001, name_case_mode:2, table_name:"__all_column_usage"}, strlen=18) [2024-09-11 15:49:19.808388] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2603469821525028165, table={database_id:201001, name_case_mode:2, table_name:"__all_job"}, strlen=9) [2024-09-11 15:49:19.808409] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9677407561020623763, table={database_id:201001, name_case_mode:2, table_name:"__all_job_log"}, strlen=13) [2024-09-11 15:49:19.808426] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=18299181273089282109, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_directory"}, strlen=22) [2024-09-11 15:49:19.808446] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3615909664776853197, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_directory_history"}, strlen=30) [2024-09-11 15:49:19.808490] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13203984404557063111, table={database_id:201001, name_case_mode:2, table_name:"__all_table_stat"}, strlen=16) [2024-09-11 15:49:19.808540] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=13593456723596311753, table={database_id:201001, name_case_mode:2, table_name:"__all_column_stat"}, strlen=17) [2024-09-11 15:49:19.808568] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=2033987196978381727, table={database_id:201001, name_case_mode:2, table_name:"__all_histogram_stat"}, strlen=20) [2024-09-11 15:49:19.808595] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10523643211813031695, table={database_id:201001, name_case_mode:2, table_name:"__all_monitor_modified"}, strlen=22) [2024-09-11 15:49:19.808635] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17786317888840441505, table={database_id:201001, name_case_mode:2, table_name:"__all_table_stat_history"}, strlen=24) [2024-09-11 15:49:19.808681] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17844106146146067643, table={database_id:201001, name_case_mode:2, table_name:"__all_column_stat_history"}, strlen=25) [2024-09-11 15:49:19.808715] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=515416535842957513, table={database_id:201001, name_case_mode:2, table_name:"__all_histogram_stat_history"}, strlen=28) [2024-09-11 15:49:19.808738] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=6256918342980536965, table={database_id:201001, name_case_mode:2, table_name:"__all_optstat_global_prefs"}, strlen=26) [2024-09-11 15:49:19.808760] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1005508210486894529, table={database_id:201001, name_case_mode:2, table_name:"__all_optstat_user_prefs"}, strlen=24) [2024-09-11 15:49:19.808798] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6155439119741924235, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_meta_table"}, strlen=19) [2024-09-11 15:49:19.808819] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6876489288212272485, table={database_id:201001, name_case_mode:2, table_name:"__all_tablet_to_ls"}, strlen=18) [2024-09-11 15:49:19.808848] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=12164389443361469299, table={database_id:201001, name_case_mode:2, table_name:"__all_tablet_meta_table"}, strlen=23) [2024-09-11 15:49:19.808880] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5092449924229211087, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_status"}, strlen=15) [2024-09-11 15:49:19.808933] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9921150920871154761, table={database_id:201001, name_case_mode:2, table_name:"__all_log_archive_progress"}, strlen=26) [2024-09-11 15:49:19.808971] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11667710272360144827, table={database_id:201001, name_case_mode:2, table_name:"__all_log_archive_history"}, strlen=25) [2024-09-11 15:49:19.809012] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14771177362653768571, table={database_id:201001, name_case_mode:2, table_name:"__all_log_archive_piece_files"}, strlen=29) [2024-09-11 15:49:19.809045] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11153776165287517939, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_log_archive_progress"}, strlen=29) [2024-09-11 15:49:19.809063] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=4840667780182692961, table={database_id:201001, name_case_mode:2, table_name:"__all_ls"}, strlen=8) [2024-09-11 15:49:19.809088] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5871136232436001723, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_storage_info"}, strlen=25) [2024-09-11 15:49:19.809106] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5253726504995511709, table={database_id:201001, name_case_mode:2, table_name:"__all_dam_last_arch_ts"}, strlen=22) [2024-09-11 15:49:19.809129] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6541041578174273069, table={database_id:201001, name_case_mode:2, table_name:"__all_dam_cleanup_jobs"}, strlen=22) [2024-09-11 15:49:19.809171] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=14454558605933543723, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_job"}, strlen=16) [2024-09-11 15:49:19.809208] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=345820062373353505, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_job_history"}, strlen=24) [2024-09-11 15:49:19.809262] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=7038381903360144763, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_task"}, strlen=17) [2024-09-11 15:49:19.809309] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17241731791169823227, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_task_history"}, strlen=25) [2024-09-11 15:49:19.809364] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5139340338441356893, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_ls_task"}, strlen=20) [2024-09-11 15:49:19.809416] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17112232417168141001, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_ls_task_history"}, strlen=28) [2024-09-11 15:49:19.809451] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5326619424660546683, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_ls_task_info"}, strlen=25) [2024-09-11 15:49:19.809474] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=10809465711872964189, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_skipped_tablet"}, strlen=27) [2024-09-11 15:49:19.809500] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7172672809704535647, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_skipped_tablet_history"}, strlen=35) [2024-09-11 15:49:19.809527] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8551986651507774603, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_info"}, strlen=17) [2024-09-11 15:49:19.809546] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16969434147253049475, table={database_id:201001, name_case_mode:2, table_name:"__all_tablet_to_table_history"}, strlen=29) [2024-09-11 15:49:19.809571] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=6966337288252588875, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_recovery_stat"}, strlen=22) [2024-09-11 15:49:19.809605] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7672455471652392683, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_ls_task_info_history"}, strlen=33) [2024-09-11 15:49:19.809631] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1718272479064774183, table={database_id:201001, name_case_mode:2, table_name:"__all_tablet_replica_checksum"}, strlen=29) [2024-09-11 15:49:19.809653] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9277721814065941751, table={database_id:201001, name_case_mode:2, table_name:"__all_tablet_checksum"}, strlen=21) [2024-09-11 15:49:19.809696] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1410158923608136531, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_replica_task"}, strlen=21) [2024-09-11 15:49:19.809726] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13552177719164551521, table={database_id:201001, name_case_mode:2, table_name:"__all_pending_transaction"}, strlen=25) [2024-09-11 15:49:19.809747] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7251939519579911917, table={database_id:201001, name_case_mode:2, table_name:"__all_balance_group_ls_stat"}, strlen=27) [2024-09-11 15:49:19.809818] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=14672553900982078935, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_scheduler_job"}, strlen=26) [2024-09-11 15:49:19.809838] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=11082355209028953489, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_scheduler_job_run_detail"}, strlen=37) [2024-09-11 15:49:19.809876] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=4332661699714066125, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_scheduler_program"}, strlen=30) [2024-09-11 15:49:19.809921] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=739950597555994075, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_scheduler_program_argument"}, strlen=39) [2024-09-11 15:49:19.809947] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6633247198031189931, table={database_id:201001, name_case_mode:2, table_name:"__all_context"}, strlen=13) [2024-09-11 15:49:19.809973] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=454551930966311923, table={database_id:201001, name_case_mode:2, table_name:"__all_context_history"}, strlen=21) [2024-09-11 15:49:19.809996] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13822394798323643845, table={database_id:201001, name_case_mode:2, table_name:"__all_global_context_value"}, strlen=26) [2024-09-11 15:49:19.810016] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2442104316564107661, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_election_reference_info"}, strlen=32) [2024-09-11 15:49:19.810057] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2023004161289107105, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_delete_job"}, strlen=23) [2024-09-11 15:49:19.810097] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9418129896431642007, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_delete_job_history"}, strlen=31) [2024-09-11 15:49:19.810138] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16360320756335183541, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_delete_task"}, strlen=24) [2024-09-11 15:49:19.810176] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5641975476073571633, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_delete_task_history"}, strlen=32) [2024-09-11 15:49:19.810213] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17591288669660113079, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_delete_ls_task"}, strlen=27) [2024-09-11 15:49:19.810252] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=3689768364663215327, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_delete_ls_task_history"}, strlen=35) [2024-09-11 15:49:19.810279] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12242147598090118883, table={database_id:201001, name_case_mode:2, table_name:"__all_zone_merge_info"}, strlen=21) [2024-09-11 15:49:19.810306] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=8265828946223808621, table={database_id:201001, name_case_mode:2, table_name:"__all_merge_info"}, strlen=16) [2024-09-11 15:49:19.810322] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17916265507013964363, table={database_id:201001, name_case_mode:2, table_name:"__all_freeze_info"}, strlen=17) [2024-09-11 15:49:19.810348] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=12386362653016066913, table={database_id:201001, name_case_mode:2, table_name:"__all_disk_io_calibration"}, strlen=25) [2024-09-11 15:49:19.810367] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=106569157966755327, table={database_id:201001, name_case_mode:2, table_name:"__all_plan_baseline"}, strlen=19) [2024-09-11 15:49:19.810403] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6856469588069932585, table={database_id:201001, name_case_mode:2, table_name:"__all_plan_baseline_item"}, strlen=24) [2024-09-11 15:49:19.810421] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=737016062760421533, table={database_id:201001, name_case_mode:2, table_name:"__all_spm_config"}, strlen=16) [2024-09-11 15:49:19.810439] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=385292018024404667, table={database_id:201001, name_case_mode:2, table_name:"__all_log_archive_dest_parameter"}, strlen=32) [2024-09-11 15:49:19.810455] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=750388973936519071, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_parameter"}, strlen=22) [2024-09-11 15:49:19.810492] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=2064434701400261915, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_restore_progress"}, strlen=25) [2024-09-11 15:49:19.810524] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5983074107095964001, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_restore_history"}, strlen=24) [2024-09-11 15:49:19.810548] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15195981732091019563, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_storage_info_history"}, strlen=33) [2024-09-11 15:49:19.810572] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17225039833591821085, table={database_id:201001, name_case_mode:2, table_name:"__all_backup_delete_policy"}, strlen=26) [2024-09-11 15:49:19.810592] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10618024175747124645, table={database_id:201001, name_case_mode:2, table_name:"__all_mock_fk_parent_table"}, strlen=26) [2024-09-11 15:49:19.810612] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=4096373257849981925, table={database_id:201001, name_case_mode:2, table_name:"__all_mock_fk_parent_table_history"}, strlen=34) [2024-09-11 15:49:19.810631] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15042892075467936941, table={database_id:201001, name_case_mode:2, table_name:"__all_mock_fk_parent_table_column"}, strlen=33) [2024-09-11 15:49:19.810653] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6266905018957919515, table={database_id:201001, name_case_mode:2, table_name:"__all_mock_fk_parent_table_column_history"}, strlen=41) [2024-09-11 15:49:19.810672] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1626377680216083193, table={database_id:201001, name_case_mode:2, table_name:"__all_log_restore_source"}, strlen=24) [2024-09-11 15:49:19.810703] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13586415458395150971, table={database_id:201001, name_case_mode:2, table_name:"__all_kv_ttl_task"}, strlen=17) [2024-09-11 15:49:19.810739] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=10315139639212232443, table={database_id:201001, name_case_mode:2, table_name:"__all_kv_ttl_task_history"}, strlen=25) [2024-09-11 15:49:19.810756] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15060160636423438025, table={database_id:201001, name_case_mode:2, table_name:"__all_service_epoch"}, strlen=19) [2024-09-11 15:49:19.810790] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14207301601487712751, table={database_id:201001, name_case_mode:2, table_name:"__all_spatial_reference_systems"}, strlen=31) [2024-09-11 15:49:19.810817] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1427218845995887213, table={database_id:201001, name_case_mode:2, table_name:"__all_column_checksum_error_info"}, strlen=32) [2024-09-11 15:49:19.810855] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=536232206730337799, table={database_id:201001, name_case_mode:2, table_name:"__all_transfer_task"}, strlen=19) [2024-09-11 15:49:19.810897] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=5753606698620705679, table={database_id:201001, name_case_mode:2, table_name:"__all_transfer_task_history"}, strlen=27) [2024-09-11 15:49:19.810933] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=16] set tenant space table name(key=9898996633246390741, table={database_id:201001, name_case_mode:2, table_name:"__all_balance_job"}, strlen=17) [2024-09-11 15:49:19.810962] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12994895240210476603, table={database_id:201001, name_case_mode:2, table_name:"__all_balance_job_history"}, strlen=25) [2024-09-11 15:49:19.811000] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7598411896746562089, table={database_id:201001, name_case_mode:2, table_name:"__all_balance_task"}, strlen=18) [2024-09-11 15:49:19.811037] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18315806932585433045, table={database_id:201001, name_case_mode:2, table_name:"__all_balance_task_history"}, strlen=26) [2024-09-11 15:49:19.811056] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2726033030194402551, table={database_id:201001, name_case_mode:2, table_name:"__all_arbitration_service"}, strlen=25) [2024-09-11 15:49:19.811086] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] set tenant space table name(key=5367016885783802827, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_arb_replica_task"}, strlen=25) [2024-09-11 15:49:19.811103] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17864334880061719717, table={database_id:201001, name_case_mode:2, table_name:"__all_data_dictionary_in_log"}, strlen=28) [2024-09-11 15:49:19.811134] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=10088403076917926571, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_arb_replica_task_history"}, strlen=33) [2024-09-11 15:49:19.811164] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14641783777040638849, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_policy"}, strlen=16) [2024-09-11 15:49:19.811195] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15309866415396578593, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_policy_history"}, strlen=24) [2024-09-11 15:49:19.811211] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=736295740555706301, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_security_column"}, strlen=25) [2024-09-11 15:49:19.811233] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=9614448622504189163, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_security_column_history"}, strlen=33) [2024-09-11 15:49:19.811251] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10604796654752325437, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_group"}, strlen=15) [2024-09-11 15:49:19.811273] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=2287975951870720615, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_group_history"}, strlen=23) [2024-09-11 15:49:19.811293] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3384713904088717219, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_context"}, strlen=17) [2024-09-11 15:49:19.811319] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=10516942058551462715, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_context_history"}, strlen=25) [2024-09-11 15:49:19.811339] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4796164509649626743, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_attribute"}, strlen=19) [2024-09-11 15:49:19.811362] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17118269223872947663, table={database_id:201001, name_case_mode:2, table_name:"__all_rls_attribute_history"}, strlen=27) [2024-09-11 15:49:19.811396] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=6303018733342293705, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_rewrite_rules"}, strlen=26) [2024-09-11 15:49:19.811416] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1505072643534354837, table={database_id:201001, name_case_mode:2, table_name:"__all_reserved_snapshot"}, strlen=23) [2024-09-11 15:49:19.811450] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=3206000261011698383, table={database_id:201001, name_case_mode:2, table_name:"__all_cluster_event_history"}, strlen=27) [2024-09-11 15:49:19.811470] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=2941245638296296215, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_transfer_member_list_lock_info"}, strlen=39) [2024-09-11 15:49:19.811491] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11234993593640609995, table={database_id:201001, name_case_mode:2, table_name:"__all_external_table_file"}, strlen=25) [2024-09-11 15:49:19.811521] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7976223127122149093, table={database_id:201001, name_case_mode:2, table_name:"__all_task_opt_stat_gather_history"}, strlen=34) [2024-09-11 15:49:19.811555] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14262268536927770655, table={database_id:201001, name_case_mode:2, table_name:"__all_table_opt_stat_gather_history"}, strlen=35) [2024-09-11 15:49:19.811630] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=17419416618465201167, table={database_id:201001, name_case_mode:2, table_name:"__wr_active_session_history"}, strlen=27) [2024-09-11 15:49:19.811654] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8648431613149611097, table={database_id:201001, name_case_mode:2, table_name:"__wr_snapshot"}, strlen=13) [2024-09-11 15:49:19.811669] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10924522129631307255, table={database_id:201001, name_case_mode:2, table_name:"__wr_statname"}, strlen=13) [2024-09-11 15:49:19.811690] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=1926239589368122255, table={database_id:201001, name_case_mode:2, table_name:"__wr_sysstat"}, strlen=12) [2024-09-11 15:49:19.811713] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=14044128492918867653, table={database_id:201001, name_case_mode:2, table_name:"__all_balance_task_helper"}, strlen=25) [2024-09-11 15:49:19.811731] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10606982525096515081, table={database_id:201001, name_case_mode:2, table_name:"__all_dbms_lock_allocated"}, strlen=25) [2024-09-11 15:49:19.811757] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=13551619464768476839, table={database_id:201001, name_case_mode:2, table_name:"__wr_control"}, strlen=12) [2024-09-11 15:49:19.811800] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=12273043209952030165, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_event_history"}, strlen=26) [2024-09-11 15:49:19.811823] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=2156128032411121717, table={database_id:201001, name_case_mode:2, table_name:"__all_tenant_scheduler_job_class"}, strlen=32) [2024-09-11 15:49:19.811894] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=16402562115065233409, table={database_id:201001, name_case_mode:2, table_name:"__all_recover_table_job"}, strlen=23) [2024-09-11 15:49:19.811973] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] set tenant space table name(key=322676203845648151, table={database_id:201001, name_case_mode:2, table_name:"__all_recover_table_job_history"}, strlen=31) [2024-09-11 15:49:19.812043] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=4057484502251261055, table={database_id:201001, name_case_mode:2, table_name:"__all_import_table_job"}, strlen=22) [2024-09-11 15:49:19.812109] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10256335000019078605, table={database_id:201001, name_case_mode:2, table_name:"__all_import_table_job_history"}, strlen=30) [2024-09-11 15:49:19.812176] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15253123702236863135, table={database_id:201001, name_case_mode:2, table_name:"__all_import_table_task"}, strlen=23) [2024-09-11 15:49:19.812242] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8857254671380765655, table={database_id:201001, name_case_mode:2, table_name:"__all_import_table_task_history"}, strlen=31) [2024-09-11 15:49:19.812272] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16250367188041164807, table={database_id:201001, name_case_mode:2, table_name:"__all_storage_ha_error_diagnose_history"}, strlen=39) [2024-09-11 15:49:19.812304] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=11398066368870582173, table={database_id:201001, name_case_mode:2, table_name:"__all_storage_ha_perf_diagnose_history"}, strlen=38) [2024-09-11 15:49:19.812330] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9688623159790226459, table={database_id:201001, name_case_mode:2, table_name:"__wr_system_event"}, strlen=17) [2024-09-11 15:49:19.812354] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11650360314263353923, table={database_id:201001, name_case_mode:2, table_name:"__wr_event_name"}, strlen=15) [2024-09-11 15:49:19.812378] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=15856097785690596323, table={database_id:201001, name_case_mode:2, table_name:"__all_routine_privilege"}, strlen=23) [2024-09-11 15:49:19.812408] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4716672932354326487, table={database_id:201001, name_case_mode:2, table_name:"__all_routine_privilege_history"}, strlen=31) [2024-09-11 15:49:19.812505] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=17999792226030913103, table={database_id:201001, name_case_mode:2, table_name:"__wr_sqlstat"}, strlen=12) [2024-09-11 15:49:19.812527] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10701076660877348721, table={database_id:201001, name_case_mode:2, table_name:"__all_ncomp_dll"}, strlen=15) [2024-09-11 15:49:19.812549] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10392657045332137307, table={database_id:201001, name_case_mode:2, table_name:"__all_aux_stat"}, strlen=14) [2024-09-11 15:49:19.812590] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15623804334560284769, table={database_id:201001, name_case_mode:2, table_name:"__all_index_usage_info"}, strlen=22) [2024-09-11 15:49:19.812614] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5410973579032597443, table={database_id:201001, name_case_mode:2, table_name:"__all_transfer_partition_task"}, strlen=29) [2024-09-11 15:49:19.812641] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1460391870692694099, table={database_id:201001, name_case_mode:2, table_name:"__all_transfer_partition_task_history"}, strlen=37) [2024-09-11 15:49:19.812664] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1117220808036644773, table={database_id:201001, name_case_mode:2, table_name:"__wr_sqltext"}, strlen=12) [2024-09-11 15:49:19.812682] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2930611376442922651, table={database_id:201001, name_case_mode:2, table_name:"__all_audit_log_filter"}, strlen=22) [2024-09-11 15:49:19.812704] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=15228694239222102799, table={database_id:201001, name_case_mode:2, table_name:"__all_audit_log_user"}, strlen=20) [2024-09-11 15:49:19.812731] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=3393161370099407981, table={database_id:201001, name_case_mode:2, table_name:"__all_column_privilege"}, strlen=22) [2024-09-11 15:49:19.812758] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=8394810126509044877, table={database_id:201001, name_case_mode:2, table_name:"__all_column_privilege_history"}, strlen=30) [2024-09-11 15:49:19.812807] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=109545231548433475, table={database_id:201001, name_case_mode:2, table_name:"__all_ls_replica_task_history"}, strlen=29) [2024-09-11 15:49:19.812826] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5359467319832074531, table={database_id:201001, name_case_mode:2, table_name:"__all_user_proxy_info"}, strlen=21) [2024-09-11 15:49:19.812851] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=4527303895030807491, table={database_id:201001, name_case_mode:2, table_name:"__all_user_proxy_info_history"}, strlen=29) [2024-09-11 15:49:19.812869] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14818930701916259273, table={database_id:201001, name_case_mode:2, table_name:"__all_user_proxy_role_info"}, strlen=26) [2024-09-11 15:49:19.812892] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=14174244267723549669, table={database_id:201001, name_case_mode:2, table_name:"__all_user_proxy_role_info_history"}, strlen=34) [2024-09-11 15:49:19.812919] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17487649412344447135, table={database_id:201001, name_case_mode:2, table_name:"__all_service"}, strlen=13) [2024-09-11 15:49:19.812967] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3276578535233262435, table={database_id:201001, name_case_mode:2, table_name:"__all_scheduler_job_run_detail_v2"}, strlen=33) [2024-09-11 15:49:19.813010] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17045071868751366117, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_all_table"}, strlen=26) [2024-09-11 15:49:19.813036] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5519398100204870277, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_table_column"}, strlen=29) [2024-09-11 15:49:19.813076] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=16117044152472803067, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_table_index"}, strlen=28) [2024-09-11 15:49:19.813093] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=16150779124246126639, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_show_create_database"}, strlen=37) [2024-09-11 15:49:19.813112] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=11884990978553673621, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_show_create_table"}, strlen=34) [2024-09-11 15:49:19.813125] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=2387169672638203455, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_session_variable"}, strlen=33) [2024-09-11 15:49:19.813137] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=956164978035976065, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_privilege_grant"}, strlen=32) [2024-09-11 15:49:19.813244] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=10723563407649040877, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_processlist"}, strlen=25) [2024-09-11 15:49:19.813261] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=14601271136071318673, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_warning"}, strlen=24) [2024-09-11 15:49:19.813277] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=9823273726776516055, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_current_tenant"}, strlen=31) [2024-09-11 15:49:19.813302] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=9449662593763233013, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_database_status"}, strlen=32) [2024-09-11 15:49:19.813319] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17889888313341552945, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_tenant_status"}, strlen=30) [2024-09-11 15:49:19.813341] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=81606536831860655, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_statname"}, strlen=25) [2024-09-11 15:49:19.813368] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=15043369427170900939, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_event_name"}, strlen=27) [2024-09-11 15:49:19.813378] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=18255339938544476937, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_global_variable"}, strlen=32) [2024-09-11 15:49:19.813391] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7382965831014104909, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_show_tables"}, strlen=28) [2024-09-11 15:49:19.813416] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=5823639658674059037, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_show_create_procedure"}, strlen=38) [2024-09-11 15:49:19.813453] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=12188669583906781559, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_core_meta_table"}, strlen=29) [2024-09-11 15:49:19.813540] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15768093327296574529, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_plan_cache_stat"}, strlen=29) [2024-09-11 15:49:19.813656] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1929560700166330149, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_plan_stat"}, strlen=23) [2024-09-11 15:49:19.813679] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10849111213766514175, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_mem_leak_checker_info"}, strlen=35) [2024-09-11 15:49:19.813717] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12534175108322031989, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_latch"}, strlen=19) [2024-09-11 15:49:19.813753] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=17946072786506275721, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_kvcache_info"}, strlen=26) [2024-09-11 15:49:19.813765] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1148958555621586483, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_data_type_class"}, strlen=29) [2024-09-11 15:49:19.813778] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7870574698325049231, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_data_type"}, strlen=23) [2024-09-11 15:49:19.813817] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=2991237636107603135, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_session_event"}, strlen=27) [2024-09-11 15:49:19.813854] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=13231924137069186047, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_session_wait"}, strlen=26) [2024-09-11 15:49:19.813889] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13614578644635299749, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_session_wait_history"}, strlen=34) [2024-09-11 15:49:19.813933] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9602714405924544917, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_system_event"}, strlen=26) [2024-09-11 15:49:19.813958] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=18315226002269187897, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_memstore_info"}, strlen=34) [2024-09-11 15:49:19.813983] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18170684266772089053, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_concurrency_object_pool"}, strlen=37) [2024-09-11 15:49:19.814006] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=792101162394988209, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sesstat"}, strlen=21) [2024-09-11 15:49:19.814034] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=2596156483016570673, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sysstat"}, strlen=21) [2024-09-11 15:49:19.814058] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8571893326947715237, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_disk_stat"}, strlen=23) [2024-09-11 15:49:19.814105] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13122091054986245039, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_memstore_info"}, strlen=27) [2024-09-11 15:49:19.814116] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15259231909277627059, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_upgrade_inspection"}, strlen=32) [2024-09-11 15:49:19.814171] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1511382916582423927, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_trans_stat"}, strlen=24) [2024-09-11 15:49:19.814196] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12516260303390182231, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_trans_ctx_mgr_stat"}, strlen=32) [2024-09-11 15:49:19.814241] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18194554554044506693, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_trans_scheduler"}, strlen=29) [2024-09-11 15:49:19.814456] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18341810671452752685, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sql_audit"}, strlen=23) [2024-09-11 15:49:19.814596] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17183208702325076817, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_core_all_table"}, strlen=28) [2024-09-11 15:49:19.814656] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1978990099111001603, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_core_column_table"}, strlen=31) [2024-09-11 15:49:19.814692] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=5356809869350394683, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_memory_info"}, strlen=25) [2024-09-11 15:49:19.814732] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] set tenant space table name(key=2426326948649033239, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sys_parameter_stat"}, strlen=32) [2024-09-11 15:49:19.814763] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2756782331778382803, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_trace_span_info"}, strlen=29) [2024-09-11 15:49:19.814781] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16901204961618683353, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_engine"}, strlen=20) [2024-09-11 15:49:19.814800] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=4052037019246478517, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_proxy_server_stat"}, strlen=31) [2024-09-11 15:49:19.814819] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=1591733027118987337, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_proxy_sys_variable"}, strlen=32) [2024-09-11 15:49:19.814866] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6049031990595067573, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_proxy_schema"}, strlen=26) [2024-09-11 15:49:19.814894] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4228542629693930061, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_plan_cache_plan_explain"}, strlen=37) [2024-09-11 15:49:19.814953] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=3696554365402450999, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_obrpc_stat"}, strlen=24) [2024-09-11 15:49:19.814984] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9895626175744829857, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_outline"}, strlen=24) [2024-09-11 15:49:19.815008] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17674221193126572289, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_concurrent_limit_sql"}, strlen=37) [2024-09-11 15:49:19.815055] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=5013799567113964503, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_sstable_macro_info"}, strlen=39) [2024-09-11 15:49:19.815136] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14830728642989910137, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_proxy_partition_info"}, strlen=34) [2024-09-11 15:49:19.815179] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13603489201581434473, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_proxy_partition"}, strlen=29) [2024-09-11 15:49:19.815217] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7994610665089267825, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_proxy_sub_partition"}, strlen=33) [2024-09-11 15:49:19.815241] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4747451874374698747, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sys_task_status"}, strlen=29) [2024-09-11 15:49:19.815282] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18321215885376430367, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_macro_block_marker_status"}, strlen=39) [2024-09-11 15:49:19.815306] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17831907667713727217, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_io_stat"}, strlen=21) [2024-09-11 15:49:19.815338] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8519204614051567739, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_long_ops_status"}, strlen=29) [2024-09-11 15:49:19.815372] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=233400546160387759, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_server_object_pool"}, strlen=32) [2024-09-11 15:49:19.815403] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6098701480593983745, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_trans_lock_stat"}, strlen=29) [2024-09-11 15:49:19.815420] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=16670391486764922061, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_show_create_tablegroup"}, strlen=39) [2024-09-11 15:49:19.815441] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=9684979741576106851, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_server_blacklist"}, strlen=30) [2024-09-11 15:49:19.815474] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=4804773615932141661, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_parameter_stat"}, strlen=35) [2024-09-11 15:49:19.815497] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8339999715751028429, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_server_schema_info"}, strlen=32) [2024-09-11 15:49:19.815524] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4372933476609421993, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_memory_context_stat"}, strlen=33) [2024-09-11 15:49:19.815582] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=454020862387476241, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dump_tenant_info"}, strlen=30) [2024-09-11 15:49:19.815613] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6982597829998253055, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_parameter_info"}, strlen=35) [2024-09-11 15:49:19.815625] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18232713114939768153, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_audit_operation"}, strlen=29) [2024-09-11 15:49:19.815637] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=13356918981701430511, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_audit_action"}, strlen=26) [2024-09-11 15:49:19.815667] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=12359944307016886891, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dag_warning_history"}, strlen=33) [2024-09-11 15:49:19.815691] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=1637384019149870571, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_encrypt_info"}, strlen=33) [2024-09-11 15:49:19.815706] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3146496550883101155, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_show_restore_preview"}, strlen=37) [2024-09-11 15:49:19.815724] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] set tenant space table name(key=16344561987762513411, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_master_key_version_info"}, strlen=37) [2024-09-11 15:49:19.815755] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14429749340777123195, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dag"}, strlen=17) [2024-09-11 15:49:19.815774] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14715506532307593681, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dag_scheduler"}, strlen=27) [2024-09-11 15:49:19.815808] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=243048139659601061, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_server_compaction_progress"}, strlen=40) [2024-09-11 15:49:19.815840] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=3834124668751569893, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_compaction_progress"}, strlen=40) [2024-09-11 15:49:19.815864] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4519553089221726529, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_compaction_diagnose_info"}, strlen=38) [2024-09-11 15:49:19.815888] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15614023263253954317, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_compaction_suggestion"}, strlen=35) [2024-09-11 15:49:19.815942] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7129529410050983945, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_session_info"}, strlen=26) [2024-09-11 15:49:19.815996] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=13147890795620097223, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_compaction_history"}, strlen=39) [2024-09-11 15:49:19.816017] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1600877708693490759, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_io_calibration_status"}, strlen=35) [2024-09-11 15:49:19.816041] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4898063400552337509, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_io_benchmark"}, strlen=26) [2024-09-11 15:49:19.816070] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1465653522913614701, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_io_quota"}, strlen=22) [2024-09-11 15:49:19.816093] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3605455190298286947, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_server_compaction_event_history"}, strlen=45) [2024-09-11 15:49:19.816110] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=5868130371028614267, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ddl_sim_point"}, strlen=27) [2024-09-11 15:49:19.816131] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=5904591545118668583, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ddl_sim_point_stat"}, strlen=32) [2024-09-11 15:49:19.816143] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4010968026106459731, table={database_id:201002, name_case_mode:2, table_name:"SESSION_VARIABLES"}, strlen=17) [2024-09-11 15:49:19.816153] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=12183085506146544347, table={database_id:201002, name_case_mode:2, table_name:"GLOBAL_STATUS"}, strlen=13) [2024-09-11 15:49:19.816166] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=17971612439695227793, table={database_id:201002, name_case_mode:2, table_name:"SESSION_STATUS"}, strlen=14) [2024-09-11 15:49:19.816257] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] set tenant space table name(key=16887988928553426911, table={database_id:201003, name_case_mode:2, table_name:"user"}, strlen=4) [2024-09-11 15:49:19.816298] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=2946110349501038242, table={database_id:201003, name_case_mode:2, table_name:"db"}, strlen=2) [2024-09-11 15:49:19.816340] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11767149002664574223, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_lock_wait_stat"}, strlen=28) [2024-09-11 15:49:19.816383] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16785437781243172845, table={database_id:201003, name_case_mode:2, table_name:"proc"}, strlen=4) [2024-09-11 15:49:19.816403] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9373709181414260655, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_collation"}, strlen=26) [2024-09-11 15:49:19.816418] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=698041592007753371, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_charset"}, strlen=24) [2024-09-11 15:49:19.816449] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=7686771750626269381, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_memstore_allocator_info"}, strlen=44) [2024-09-11 15:49:19.816489] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=3975159249677897845, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_table_mgr"}, strlen=23) [2024-09-11 15:49:19.816508] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12213057926634880251, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_freeze_info"}, strlen=25) [2024-09-11 15:49:19.816533] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=5651337753085766071, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_bad_block_table"}, strlen=29) [2024-09-11 15:49:19.816562] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=3184051855783834287, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_px_worker_stat"}, strlen=28) [2024-09-11 15:49:19.816585] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=540057813118157961, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_auto_increment"}, strlen=28) [2024-09-11 15:49:19.816602] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7883789047354781169, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sequence_value"}, strlen=28) [2024-09-11 15:49:19.816680] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=9797883523630614005, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_store_stat"}, strlen=31) [2024-09-11 15:49:19.816709] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4204286209984997437, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ddl_operation"}, strlen=27) [2024-09-11 15:49:19.816727] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.816756] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=403399859139876099, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_outline"}, strlen=21) [2024-09-11 15:49:19.816801] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=2587094168211168195, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_outline_history"}, strlen=29) [2024-09-11 15:49:19.816825] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17728413332431590231, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_synonym"}, strlen=21) [2024-09-11 15:49:19.816857] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11952264632673044291, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_synonym_history"}, strlen=29) [2024-09-11 15:49:19.816892] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12205109805863173929, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_database_privilege"}, strlen=32) [2024-09-11 15:49:19.816939] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=5622413429548427137, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_database_privilege_history"}, strlen=40) [2024-09-11 15:49:19.816980] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] set tenant space table name(key=10873134288822667535, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_table_privilege"}, strlen=29) [2024-09-11 15:49:19.817019] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17882259221661241491, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_table_privilege_history"}, strlen=37) [2024-09-11 15:49:19.817043] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14771492140714248861, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_database"}, strlen=22) [2024-09-11 15:49:19.817071] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9833893932480909, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_database_history"}, strlen=30) [2024-09-11 15:49:19.817107] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4189394883475384051, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablegroup"}, strlen=24) [2024-09-11 15:49:19.817144] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=5094629874663768497, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablegroup_history"}, strlen=32) [2024-09-11 15:49:19.817282] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=11398463348276985611, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_table"}, strlen=19) [2024-09-11 15:49:19.817432] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4608830451644128399, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_table_history"}, strlen=27) [2024-09-11 15:49:19.817493] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7562389478707205431, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_column"}, strlen=20) [2024-09-11 15:49:19.817555] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16431477134343216393, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_column_history"}, strlen=28) [2024-09-11 15:49:19.817609] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=8489996283756060637, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_part"}, strlen=18) [2024-09-11 15:49:19.817664] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=230522973419338389, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_part_history"}, strlen=26) [2024-09-11 15:49:19.817711] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14128098823668382455, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_part_info"}, strlen=23) [2024-09-11 15:49:19.817758] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13123746419565878103, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_part_info_history"}, strlen=31) [2024-09-11 15:49:19.817795] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=10106353299013747501, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_def_sub_part"}, strlen=26) [2024-09-11 15:49:19.817833] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3723349451437439589, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_def_sub_part_history"}, strlen=34) [2024-09-11 15:49:19.817878] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1159724203221591333, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sub_part"}, strlen=22) [2024-09-11 15:49:19.817938] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13485400240322980621, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sub_part_history"}, strlen=30) [2024-09-11 15:49:19.817968] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3717080332221137241, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_constraint"}, strlen=24) [2024-09-11 15:49:19.817999] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2261503562025306545, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_constraint_history"}, strlen=32) [2024-09-11 15:49:19.818035] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=4409443192218650679, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_foreign_key"}, strlen=25) [2024-09-11 15:49:19.818070] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14361527399166515819, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_foreign_key_history"}, strlen=33) [2024-09-11 15:49:19.818091] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5950001812682361007, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_foreign_key_column"}, strlen=32) [2024-09-11 15:49:19.818115] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2561377922478625665, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_foreign_key_column_history"}, strlen=40) [2024-09-11 15:49:19.818128] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=6775471235914828521, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_temp_table"}, strlen=24) [2024-09-11 15:49:19.818147] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=2619761066459048579, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ori_schema_version"}, strlen=32) [2024-09-11 15:49:19.818169] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3599012369663730315, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sys_stat"}, strlen=22) [2024-09-11 15:49:19.818249] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=11285558379627175171, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_user"}, strlen=18) [2024-09-11 15:49:19.818325] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13991047535965035541, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_user_history"}, strlen=26) [2024-09-11 15:49:19.818351] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13546331211903348077, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sys_variable"}, strlen=26) [2024-09-11 15:49:19.818382] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=15203718889589478437, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sys_variable_history"}, strlen=34) [2024-09-11 15:49:19.818403] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13952794816638871429, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_func"}, strlen=18) [2024-09-11 15:49:19.818427] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=302374348645638613, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_func_history"}, strlen=26) [2024-09-11 15:49:19.818458] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8073781812480077855, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_package"}, strlen=21) [2024-09-11 15:49:19.818494] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=997892529133287171, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_package_history"}, strlen=29) [2024-09-11 15:49:19.818531] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=8717918775075212819, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_routine"}, strlen=21) [2024-09-11 15:49:19.818568] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16857541619530486019, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_routine_history"}, strlen=29) [2024-09-11 15:49:19.818610] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10730994778248205851, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_routine_param"}, strlen=27) [2024-09-11 15:49:19.818652] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9535769933649594591, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_routine_param_history"}, strlen=35) [2024-09-11 15:49:19.818692] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=13863005444471519661, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_type"}, strlen=18) [2024-09-11 15:49:19.818733] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=6760888573649057493, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_type_history"}, strlen=26) [2024-09-11 15:49:19.818771] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6555548921245691493, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_type_attr"}, strlen=23) [2024-09-11 15:49:19.818808] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=8412557849092588759, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_type_attr_history"}, strlen=31) [2024-09-11 15:49:19.818845] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16069758238323198479, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_coll_type"}, strlen=23) [2024-09-11 15:49:19.818880] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=948630518003741015, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_coll_type_history"}, strlen=31) [2024-09-11 15:49:19.818911] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5565045024453101299, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_recyclebin"}, strlen=24) [2024-09-11 15:49:19.818947] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=9856389798854850085, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sequence_object"}, strlen=29) [2024-09-11 15:49:19.818980] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15117924462640267155, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sequence_object_history"}, strlen=37) [2024-09-11 15:49:19.819009] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9018600011392890789, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_raid_stat"}, strlen=23) [2024-09-11 15:49:19.819063] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5346947681947891153, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dtl_channel"}, strlen=25) [2024-09-11 15:49:19.819101] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=10317028212445898625, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dtl_memory"}, strlen=24) [2024-09-11 15:49:19.819149] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7495290977220553369, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dblink"}, strlen=20) [2024-09-11 15:49:19.819201] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=39914602108813961, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dblink_history"}, strlen=28) [2024-09-11 15:49:19.819221] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10896661835979267033, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_role_grantee_map"}, strlen=37) [2024-09-11 15:49:19.819245] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=12906519302648313763, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_role_grantee_map_history"}, strlen=45) [2024-09-11 15:49:19.819270] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2079997026815527299, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_keystore"}, strlen=29) [2024-09-11 15:49:19.819298] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17490817767971734035, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_keystore_history"}, strlen=37) [2024-09-11 15:49:19.819319] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=485769933102303643, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_ols_policy"}, strlen=31) [2024-09-11 15:49:19.819344] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=14691388718955392839, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_ols_policy_history"}, strlen=39) [2024-09-11 15:49:19.819369] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5034473838598928101, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_ols_component"}, strlen=34) [2024-09-11 15:49:19.819398] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=9983559006356479861, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_ols_component_history"}, strlen=42) [2024-09-11 15:49:19.819421] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2561451508816412843, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_ols_label"}, strlen=30) [2024-09-11 15:49:19.819445] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=8383393710500269469, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_ols_label_history"}, strlen=38) [2024-09-11 15:49:19.819470] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15170142716402851629, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_ols_user_level"}, strlen=35) [2024-09-11 15:49:19.819498] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4781830095091789679, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_ols_user_level_history"}, strlen=43) [2024-09-11 15:49:19.819519] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12055934656033059667, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_tablespace"}, strlen=31) [2024-09-11 15:49:19.819546] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=14437243768588124295, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_tablespace_history"}, strlen=39) [2024-09-11 15:49:19.819586] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15119970302480577059, table={database_id:201001, name_case_mode:2, table_name:"__ALL_VIRTUAL_INFORMATION_COLUMNS"}, strlen=33) [2024-09-11 15:49:19.819606] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6863781887472262157, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_user_failed_login_stat"}, strlen=43) [2024-09-11 15:49:19.819637] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=8017982115028235945, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_profile"}, strlen=28) [2024-09-11 15:49:19.819672] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=2721457751194233305, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_profile_history"}, strlen=36) [2024-09-11 15:49:19.819695] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16565928560198285159, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_security_audit"}, strlen=28) [2024-09-11 15:49:19.819720] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15453874706799428633, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_security_audit_history"}, strlen=36) [2024-09-11 15:49:19.819783] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15695521474672823901, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_trigger"}, strlen=21) [2024-09-11 15:49:19.819841] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7389671326051986051, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_trigger_history"}, strlen=29) [2024-09-11 15:49:19.819863] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13049868170434991729, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ps_stat"}, strlen=21) [2024-09-11 15:49:19.819894] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=14136636651706376169, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ps_item_info"}, strlen=26) [2024-09-11 15:49:19.819941] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18062948468190921669, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sql_workarea_history_stat"}, strlen=39) [2024-09-11 15:49:19.819980] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15455121100221849387, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sql_workarea_active"}, strlen=33) [2024-09-11 15:49:19.820005] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=422828323326750833, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sql_workarea_histogram"}, strlen=36) [2024-09-11 15:49:19.820037] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=3079069077185636353, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sql_workarea_memory_info"}, strlen=38) [2024-09-11 15:49:19.820111] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7133451772835048223, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_security_audit_record"}, strlen=35) [2024-09-11 15:49:19.820129] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7228018561142438595, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sysauth"}, strlen=21) [2024-09-11 15:49:19.820152] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=12846125774171091971, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sysauth_history"}, strlen=29) [2024-09-11 15:49:19.820176] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1031644095001014915, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_objauth"}, strlen=21) [2024-09-11 15:49:19.820203] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7612607355932228675, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_objauth_history"}, strlen=29) [2024-09-11 15:49:19.820220] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11306438604387822971, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_info"}, strlen=25) [2024-09-11 15:49:19.820254] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=6133276299577641357, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_error"}, strlen=19) [2024-09-11 15:49:19.820281] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9531929556517464041, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_id_service"}, strlen=24) [2024-09-11 15:49:19.820321] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9012299189202494091, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_object_type"}, strlen=25) [2024-09-11 15:49:19.820406] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5599497167657472551, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sql_plan_monitor"}, strlen=30) [2024-09-11 15:49:19.820426] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=2901527188234334077, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sql_monitor_statname"}, strlen=34) [2024-09-11 15:49:19.820463] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=13461434051077489945, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_open_cursor"}, strlen=25) [2024-09-11 15:49:19.820479] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15974226688182846823, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_time_zone"}, strlen=23) [2024-09-11 15:49:19.820496] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=3845598664882503553, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_time_zone_name"}, strlen=28) [2024-09-11 15:49:19.820515] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=9206088101880571647, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_time_zone_transition"}, strlen=34) [2024-09-11 15:49:19.820537] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=12110693898284894383, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_time_zone_transition_type"}, strlen=39) [2024-09-11 15:49:19.820558] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4349716677028971385, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_constraint_column"}, strlen=31) [2024-09-11 15:49:19.820579] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3902236903292639367, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_constraint_column_history"}, strlen=39) [2024-09-11 15:49:19.820648] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17419216990975841511, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_files"}, strlen=19) [2024-09-11 15:49:19.820682] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6450260072801964657, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dependency"}, strlen=24) [2024-09-11 15:49:19.820716] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=17891045281809288447, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_object_definition"}, strlen=34) [2024-09-11 15:49:19.820745] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14355066443958061683, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_global_transaction"}, strlen=32) [2024-09-11 15:49:19.820781] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3628010422253109179, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ddl_task_status"}, strlen=29) [2024-09-11 15:49:19.820822] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6750277639978755225, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_deadlock_event_history"}, strlen=36) [2024-09-11 15:49:19.820864] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7779057099719093317, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_column_usage"}, strlen=26) [2024-09-11 15:49:19.820889] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4969690976617040677, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_ctx_memory_info"}, strlen=36) [2024-09-11 15:49:19.820935] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11735107274888830045, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_job"}, strlen=17) [2024-09-11 15:49:19.820957] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15293252979412049315, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_job_log"}, strlen=21) [2024-09-11 15:49:19.820976] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16523867938420976589, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_directory"}, strlen=30) [2024-09-11 15:49:19.820998] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=2862981526483453981, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_directory_history"}, strlen=38) [2024-09-11 15:49:19.821046] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=4628984733493714743, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_table_stat"}, strlen=24) [2024-09-11 15:49:19.821094] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17730013269317283161, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_column_stat"}, strlen=25) [2024-09-11 15:49:19.821122] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11721256880206584943, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_histogram_stat"}, strlen=28) [2024-09-11 15:49:19.821141] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=11262788829881758221, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_memory_info"}, strlen=32) [2024-09-11 15:49:19.821162] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14448741272763703023, table={database_id:201001, name_case_mode:2, table_name:"__tenant_virtual_show_create_trigger"}, strlen=36) [2024-09-11 15:49:19.821190] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7620780125860384401, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_px_target_monitor"}, strlen=31) [2024-09-11 15:49:19.821218] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9352088221461444127, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_monitor_modified"}, strlen=30) [2024-09-11 15:49:19.821263] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11704116115689029617, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_table_stat_history"}, strlen=32) [2024-09-11 15:49:19.821312] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12492210588049866667, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_column_stat_history"}, strlen=33) [2024-09-11 15:49:19.821347] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=11240216773464383513, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_histogram_stat_history"}, strlen=36) [2024-09-11 15:49:19.821378] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=15587507658764508021, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_optstat_global_prefs"}, strlen=34) [2024-09-11 15:49:19.821402] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6171141165154741809, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_optstat_user_prefs"}, strlen=32) [2024-09-11 15:49:19.821443] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1724892932833849851, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dblink_info"}, strlen=25) [2024-09-11 15:49:19.821490] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14759636445393915577, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_log_archive_progress"}, strlen=34) [2024-09-11 15:49:19.821531] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17357481071210235371, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_log_archive_history"}, strlen=33) [2024-09-11 15:49:19.821576] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12362983739570776107, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_log_archive_piece_files"}, strlen=37) [2024-09-11 15:49:19.821611] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15139794031340849027, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_log_archive_progress"}, strlen=37) [2024-09-11 15:49:19.821637] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7729278448204384555, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_storage_info"}, strlen=33) [2024-09-11 15:49:19.821667] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15447288619456367615, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_status"}, strlen=23) [2024-09-11 15:49:19.821688] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13028989530138550297, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls"}, strlen=16) [2024-09-11 15:49:19.821735] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=9284250887884948155, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_meta_table"}, strlen=27) [2024-09-11 15:49:19.821763] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5493912404109002883, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_meta_table"}, strlen=31) [2024-09-11 15:49:19.821783] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=3588497416681679573, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_to_ls"}, strlen=26) [2024-09-11 15:49:19.821849] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12100763325643629103, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_load_data_stat"}, strlen=28) [2024-09-11 15:49:19.821868] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18117172864998676173, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dam_last_arch_ts"}, strlen=30) [2024-09-11 15:49:19.821894] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=1537603850334117277, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dam_cleanup_jobs"}, strlen=30) [2024-09-11 15:49:19.821953] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=3044850077559108747, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_task"}, strlen=25) [2024-09-11 15:49:19.822002] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17202505655549402603, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_task_history"}, strlen=33) [2024-09-11 15:49:19.822058] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17047651074108843053, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_ls_task"}, strlen=28) [2024-09-11 15:49:19.822111] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=11389951488068771609, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_ls_task_history"}, strlen=36) [2024-09-11 15:49:19.822151] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=15054984140751875691, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_ls_task_info"}, strlen=33) [2024-09-11 15:49:19.822177] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9274573885911750957, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_skipped_tablet"}, strlen=35) [2024-09-11 15:49:19.822203] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17493899479825934703, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_skipped_tablet_history"}, strlen=43) [2024-09-11 15:49:19.822236] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7509444197035147337, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_schedule_task"}, strlen=34) [2024-09-11 15:49:19.822256] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10869902154882669011, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_to_table_history"}, strlen=37) [2024-09-11 15:49:19.822298] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=12546918956490930507, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_log_stat"}, strlen=22) [2024-09-11 15:49:19.822332] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6701865584114924347, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_info"}, strlen=25) [2024-09-11 15:49:19.822356] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=11855718107486377787, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_recovery_stat"}, strlen=30) [2024-09-11 15:49:19.822391] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=12587755641033976731, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_ls_task_info_history"}, strlen=41) [2024-09-11 15:49:19.822419] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18406284742543154199, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_replica_checksum"}, strlen=37) [2024-09-11 15:49:19.822450] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=1205737448185443981, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ddl_checksum"}, strlen=26) [2024-09-11 15:49:19.822485] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5925394552384815091, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ddl_error_message"}, strlen=31) [2024-09-11 15:49:19.822533] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17271418239381163395, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_replica_task"}, strlen=29) [2024-09-11 15:49:19.822565] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7711276800779762705, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_pending_transaction"}, strlen=33) [2024-09-11 15:49:19.822640] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16815142292578973063, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_scheduler_job"}, strlen=34) [2024-09-11 15:49:19.822662] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8565889842710766529, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_scheduler_job_run_detail"}, strlen=45) [2024-09-11 15:49:19.822702] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9539175925425545117, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_scheduler_program"}, strlen=38) [2024-09-11 15:49:19.822731] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11425374051081425547, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_scheduler_program_argument"}, strlen=47) [2024-09-11 15:49:19.822757] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3916000153522362885, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_context"}, strlen=28) [2024-09-11 15:49:19.822785] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9533827165629233177, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_context_history"}, strlen=36) [2024-09-11 15:49:19.822813] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=7814232905113498645, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_global_context_value"}, strlen=34) [2024-09-11 15:49:19.822849] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11860989642212446163, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_unit"}, strlen=18) [2024-09-11 15:49:19.822889] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14951763112884753087, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_server"}, strlen=20) [2024-09-11 15:49:19.822917] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9351457796962509085, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_election_reference_info"}, strlen=40) [2024-09-11 15:49:19.822957] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=592293780414098497, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dtl_interm_result_monitor"}, strlen=39) [2024-09-11 15:49:19.823000] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1060854932764735443, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_archive_stat"}, strlen=26) [2024-09-11 15:49:19.823023] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9539041885416743927, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_apply_stat"}, strlen=24) [2024-09-11 15:49:19.823048] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10496609065609346969, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_replay_stat"}, strlen=25) [2024-09-11 15:49:19.823079] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11413213707988076431, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_proxy_routine"}, strlen=27) [2024-09-11 15:49:19.823119] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=10358779125222260293, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_delete_task"}, strlen=32) [2024-09-11 15:49:19.823163] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=11599824501998688193, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_delete_task_history"}, strlen=40) [2024-09-11 15:49:19.823203] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11154654444260157799, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_delete_ls_task"}, strlen=35) [2024-09-11 15:49:19.823241] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3485147956206526255, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_delete_ls_task_history"}, strlen=43) [2024-09-11 15:49:19.823275] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=343669036260397667, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_info"}, strlen=21) [2024-09-11 15:49:19.823311] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13889191828480646139, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_info"}, strlen=25) [2024-09-11 15:49:19.823347] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6079923593706602753, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_obj_lock"}, strlen=22) [2024-09-11 15:49:19.823380] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6472093144422145235, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_zone_merge_info"}, strlen=29) [2024-09-11 15:49:19.823413] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1945215902301811325, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_merge_info"}, strlen=24) [2024-09-11 15:49:19.823439] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15964639146969719227, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tx_data_table"}, strlen=27) [2024-09-11 15:49:19.823461] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7673918398027639835, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_transaction_freeze_checkpoint"}, strlen=43) [2024-09-11 15:49:19.823488] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] set tenant space table name(key=15624299328231463817, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_transaction_checkpoint"}, strlen=36) [2024-09-11 15:49:19.823507] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15798389760806859297, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_checkpoint"}, strlen=24) [2024-09-11 15:49:19.823574] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=15531534655917745073, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_set_files"}, strlen=30) [2024-09-11 15:49:19.823617] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=71109448549058811, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_job"}, strlen=24) [2024-09-11 15:49:19.823657] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12387585157070926513, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_job_history"}, strlen=32) [2024-09-11 15:49:19.823675] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12350315148594123023, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_plan_baseline"}, strlen=27) [2024-09-11 15:49:19.823714] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=6183609270707877497, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_plan_baseline_item"}, strlen=32) [2024-09-11 15:49:19.823734] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=3151019715489723885, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_spm_config"}, strlen=24) [2024-09-11 15:49:19.823827] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=13132184332004101493, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ash"}, strlen=17) [2024-09-11 15:49:19.823850] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11918594671119802407, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dml_stats"}, strlen=23) [2024-09-11 15:49:19.823871] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=13036576026545251339, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_log_archive_dest_parameter"}, strlen=40) [2024-09-11 15:49:19.823889] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=16093634333412927151, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_parameter"}, strlen=30) [2024-09-11 15:49:19.823917] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=10155872605547575013, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_restore_job"}, strlen=25) [2024-09-11 15:49:19.823980] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=14185053981704344363, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_restore_job_history"}, strlen=33) [2024-09-11 15:49:19.824005] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1928064507193205857, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_restore_progress"}, strlen=30) [2024-09-11 15:49:19.824040] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5810440368445130859, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_restore_progress"}, strlen=33) [2024-09-11 15:49:19.824075] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17530758321575504433, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_restore_history"}, strlen=32) [2024-09-11 15:49:19.824101] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1170841563710246107, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_storage_info_history"}, strlen=41) [2024-09-11 15:49:19.824144] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4703139222417769329, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_delete_job"}, strlen=31) [2024-09-11 15:49:19.824186] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10632192905468537543, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_delete_job_history"}, strlen=39) [2024-09-11 15:49:19.824214] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=11000215179100375213, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_backup_delete_policy"}, strlen=34) [2024-09-11 15:49:19.824240] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5876935806899258221, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_ddl_kv_info"}, strlen=32) [2024-09-11 15:49:19.824252] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=14873430687965254563, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_privilege"}, strlen=23) [2024-09-11 15:49:19.824284] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2089366038399339591, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_pointer_status"}, strlen=35) [2024-09-11 15:49:19.824311] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10627082229730709285, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_storage_meta_memory_status"}, strlen=40) [2024-09-11 15:49:19.824344] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8939272523027070653, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_kvcache_store_memblock"}, strlen=36) [2024-09-11 15:49:19.824369] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9216959591761298069, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_mock_fk_parent_table"}, strlen=34) [2024-09-11 15:49:19.824390] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4129838943307665781, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_mock_fk_parent_table_history"}, strlen=42) [2024-09-11 15:49:19.824411] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=984891633015355805, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_mock_fk_parent_table_column"}, strlen=41) [2024-09-11 15:49:19.824433] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5460854150695835531, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_mock_fk_parent_table_column_history"}, strlen=49) [2024-09-11 15:49:19.824458] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] set tenant space table name(key=8919811956763903017, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_log_restore_source"}, strlen=32) [2024-09-11 15:49:19.824479] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10954304872243212639, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_query_response_time"}, strlen=33) [2024-09-11 15:49:19.824511] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6545585155718650571, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_kv_ttl_task"}, strlen=25) [2024-09-11 15:49:19.824542] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18042509731592680363, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_kv_ttl_task_history"}, strlen=33) [2024-09-11 15:49:19.824570] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13998009241548891997, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_column_checksum_error_info"}, strlen=40) [2024-09-11 15:49:19.824591] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12075422687990272449, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_kvcache_handle_leak_info"}, strlen=38) [2024-09-11 15:49:19.824616] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2292498830973454709, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_compaction_info"}, strlen=36) [2024-09-11 15:49:19.824650] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17021727362987859019, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_replica_task_plan"}, strlen=34) [2024-09-11 15:49:19.824674] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13644660654514962207, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_schema_memory"}, strlen=27) [2024-09-11 15:49:19.824699] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17356939664844236393, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_schema_slot"}, strlen=25) [2024-09-11 15:49:19.824733] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=4071040417179486983, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_minor_freeze_info"}, strlen=31) [2024-09-11 15:49:19.824766] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1487015695059130217, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_show_trace"}, strlen=24) [2024-09-11 15:49:19.824830] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1291559025050508855, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ha_diagnose"}, strlen=25) [2024-09-11 15:49:19.824849] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8085407918903625525, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_data_dictionary_in_log"}, strlen=36) [2024-09-11 15:49:19.824891] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=1668431628577824439, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_transfer_task"}, strlen=27) [2024-09-11 15:49:19.824939] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=16238595714709201631, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_transfer_task_history"}, strlen=35) [2024-09-11 15:49:19.824965] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2052785859105055013, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_balance_job"}, strlen=25) [2024-09-11 15:49:19.824994] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14209611581564978411, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_balance_job_history"}, strlen=33) [2024-09-11 15:49:19.825031] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16568327804104172345, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_balance_task"}, strlen=26) [2024-09-11 15:49:19.825069] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11268964407024390053, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_balance_task_history"}, strlen=34) [2024-09-11 15:49:19.825102] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=5834086537654077777, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_policy"}, strlen=24) [2024-09-11 15:49:19.825134] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11527250685653204145, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_policy_history"}, strlen=32) [2024-09-11 15:49:19.825150] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=4391310970442466989, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_security_column"}, strlen=33) [2024-09-11 15:49:19.825171] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=13746413204235921179, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_security_column_history"}, strlen=41) [2024-09-11 15:49:19.825195] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=1247673376743413805, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_group"}, strlen=23) [2024-09-11 15:49:19.825222] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18138749897546578327, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_group_history"}, strlen=31) [2024-09-11 15:49:19.825243] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=11434448096665393395, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_context"}, strlen=25) [2024-09-11 15:49:19.825266] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=4054725959564269867, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_context_history"}, strlen=33) [2024-09-11 15:49:19.825286] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5969152825870287687, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_attribute"}, strlen=27) [2024-09-11 15:49:19.825309] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9230262160036425951, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_rls_attribute_history"}, strlen=35) [2024-09-11 15:49:19.825346] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=17034345015754626881, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_mysql_sys_agent"}, strlen=36) [2024-09-11 15:49:19.825432] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8067658311674277467, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sql_plan"}, strlen=22) [2024-09-11 15:49:19.825452] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13612515769418554729, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_core_table"}, strlen=24) [2024-09-11 15:49:19.825477] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=9402952207825142477, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_malloc_sample_info"}, strlen=32) [2024-09-11 15:49:19.825501] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5144966946066999899, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_arb_replica_task"}, strlen=33) [2024-09-11 15:49:19.825531] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18198900394465886683, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_arb_replica_task_history"}, strlen=41) [2024-09-11 15:49:19.825550] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=15297394115237879971, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_archive_dest_status"}, strlen=33) [2024-09-11 15:49:19.825577] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=13005540884162415703, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_io_scheduler"}, strlen=26) [2024-09-11 15:49:19.825599] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17728228981306809755, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_external_table_file"}, strlen=33) [2024-09-11 15:49:19.825643] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=1860983463288664109, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_mds_node_stat"}, strlen=27) [2024-09-11 15:49:19.825687] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] set tenant space table name(key=10530148734795515671, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_mds_event_history"}, strlen=31) [2024-09-11 15:49:19.825723] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=5968137363206907135, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dup_ls_lease_mgr"}, strlen=30) [2024-09-11 15:49:19.825753] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=15136874716734464437, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dup_ls_tablet_set"}, strlen=31) [2024-09-11 15:49:19.825778] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8598226558419424097, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_dup_ls_tablets"}, strlen=28) [2024-09-11 15:49:19.825804] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14995035787260068275, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tx_data"}, strlen=21) [2024-09-11 15:49:19.825835] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16042482742831708917, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_task_opt_stat_gather_history"}, strlen=42) [2024-09-11 15:49:19.825865] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13772490704032415727, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_table_opt_stat_gather_history"}, strlen=43) [2024-09-11 15:49:19.825900] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7721711920597138893, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_opt_stat_gather_monitor"}, strlen=37) [2024-09-11 15:49:19.825940] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] set tenant space table name(key=8131848130447112427, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_thread"}, strlen=20) [2024-09-11 15:49:19.825967] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=11231016621379798787, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_arbitration_member_info"}, strlen=37) [2024-09-11 15:49:19.825986] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=13682262039954657957, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_arbitration_service_status"}, strlen=40) [2024-09-11 15:49:19.826064] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=8104150357795778823, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_wr_active_session_history"}, strlen=39) [2024-09-11 15:49:19.826092] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2451381255180576193, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_wr_snapshot"}, strlen=25) [2024-09-11 15:49:19.826106] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12651551067153809327, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_wr_statname"}, strlen=25) [2024-09-11 15:49:19.826129] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=17873980323221140663, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_wr_sysstat"}, strlen=24) [2024-09-11 15:49:19.826159] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1493344956298490013, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_kv_connection"}, strlen=27) [2024-09-11 15:49:19.826191] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=9989051053516796343, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_virtual_long_ops_status_mysql_sys_agent"}, strlen=53) [2024-09-11 15:49:19.826212] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15844349189330946855, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_transfer_member_list_lock_info"}, strlen=47) [2024-09-11 15:49:19.826236] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=1657946496038858739, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_timestamp_service"}, strlen=31) [2024-09-11 15:49:19.826260] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1286434179101877883, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_resource_pool_mysql_sys_agent"}, strlen=43) [2024-09-11 15:49:19.826287] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=8963527203131936283, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_px_p2p_datahub"}, strlen=28) [2024-09-11 15:49:19.826312] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=11952147885549452999, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_log_restore_status"}, strlen=35) [2024-09-11 15:49:19.826345] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11460087502655244783, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_parameter"}, strlen=30) [2024-09-11 15:49:19.826370] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=6152974097711947533, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tablet_buffer_info"}, strlen=32) [2024-09-11 15:49:19.826395] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=7905855757146812175, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_wr_control"}, strlen=24) [2024-09-11 15:49:19.826439] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=3372244551647335781, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_event_history"}, strlen=34) [2024-09-11 15:49:19.826461] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17064265643146925141, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_balance_task_helper"}, strlen=33) [2024-09-11 15:49:19.826484] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12096839057539653341, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_balance_group_ls_stat"}, strlen=35) [2024-09-11 15:49:19.826504] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15964651543123332159, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_cgroup_config"}, strlen=27) [2024-09-11 15:49:19.826527] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=4289222286364158957, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_flt_config"}, strlen=24) [2024-09-11 15:49:19.826553] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=4411403517229041573, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_scheduler_job_class"}, strlen=40) [2024-09-11 15:49:19.826625] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13536547784777408817, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_recover_table_job"}, strlen=31) [2024-09-11 15:49:19.826692] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7973472036953049223, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_recover_table_job_history"}, strlen=39) [2024-09-11 15:49:19.826760] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6966368003139150063, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_import_table_job"}, strlen=30) [2024-09-11 15:49:19.826826] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4751390230936711261, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_import_table_job_history"}, strlen=38) [2024-09-11 15:49:19.826893] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11286289711302332047, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_import_table_task"}, strlen=31) [2024-09-11 15:49:19.826966] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16092162188021118343, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_import_table_task_history"}, strlen=39) [2024-09-11 15:49:19.826996] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=9229442554812877735, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_data_activity_metrics"}, strlen=35) [2024-09-11 15:49:19.827037] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10718475031531619939, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_storage_ha_error_diagnose"}, strlen=39) [2024-09-11 15:49:19.827070] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1412388920416779901, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_storage_ha_perf_diagnose"}, strlen=38) [2024-09-11 15:49:19.827114] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=3771098543848547687, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_checkpoint_diagnose_memtable_info"}, strlen=47) [2024-09-11 15:49:19.827146] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9759733904445142113, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_checkpoint_diagnose_checkpoint_unit_info"}, strlen=54) [2024-09-11 15:49:19.827169] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=14692758621090566273, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_checkpoint_diagnose_info"}, strlen=38) [2024-09-11 15:49:19.827192] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=10119511710787131011, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_wr_system_event"}, strlen=29) [2024-09-11 15:49:19.827216] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3156274413447503307, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_wr_event_name"}, strlen=27) [2024-09-11 15:49:19.827253] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=2655950866746185399, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_scheduler_running_job"}, strlen=42) [2024-09-11 15:49:19.827279] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2050364268541204883, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_routine_privilege"}, strlen=31) [2024-09-11 15:49:19.827307] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13839826595388648007, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_routine_privilege_history"}, strlen=39) [2024-09-11 15:49:19.827402] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5181494283587313153, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sqlstat"}, strlen=21) [2024-09-11 15:49:19.827498] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=7920741514584227639, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_wr_sqlstat"}, strlen=24) [2024-09-11 15:49:19.827523] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=17911465648816144107, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_aux_stat"}, strlen=22) [2024-09-11 15:49:19.827536] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=2001432699442288201, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_sys_variable_default_value"}, strlen=40) [2024-09-11 15:49:19.827565] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16111023212303507763, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_transfer_partition_task"}, strlen=37) [2024-09-11 15:49:19.827593] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=14324840299070848675, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_transfer_partition_task_history"}, strlen=45) [2024-09-11 15:49:19.827611] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5041175817293940637, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_wr_sqltext"}, strlen=24) [2024-09-11 15:49:19.827653] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=2571263332964794257, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_index_usage_info"}, strlen=30) [2024-09-11 15:49:19.827671] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=5000866229888357835, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_audit_log_filter"}, strlen=30) [2024-09-11 15:49:19.827692] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=3813316034198982879, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_audit_log_user"}, strlen=28) [2024-09-11 15:49:19.827715] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5114135863185170653, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_column_privilege"}, strlen=30) [2024-09-11 15:49:19.827741] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3024565239093516573, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_column_privilege_history"}, strlen=38) [2024-09-11 15:49:19.827757] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=9067502545600094555, table={database_id:201002, name_case_mode:2, table_name:"ENABLED_ROLES"}, strlen=13) [2024-09-11 15:49:19.827807] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=6150985665985824275, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_ls_replica_task_history"}, strlen=37) [2024-09-11 15:49:19.827838] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1865455977160712787, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_session_ps_info"}, strlen=29) [2024-09-11 15:49:19.827863] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=8926106621815740627, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tracepoint_info"}, strlen=29) [2024-09-11 15:49:19.827878] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=6253777733840673709, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_compatibility_control"}, strlen=35) [2024-09-11 15:49:19.827899] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=16868688502280647699, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_user_proxy_info"}, strlen=29) [2024-09-11 15:49:19.827929] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=12] set tenant space table name(key=1377437659161167251, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_user_proxy_info_history"}, strlen=37) [2024-09-11 15:49:19.827947] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11138645184115358713, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_user_proxy_role_info"}, strlen=34) [2024-09-11 15:49:19.827970] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=10353420629622781685, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_user_proxy_role_info_history"}, strlen=42) [2024-09-11 15:49:19.827989] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2879425852841045007, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_service"}, strlen=21) [2024-09-11 15:49:19.828019] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=6929023576706388717, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_resource_limit"}, strlen=35) [2024-09-11 15:49:19.828038] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13246605072146993839, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_tenant_resource_limit_detail"}, strlen=42) [2024-09-11 15:49:19.828088] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1066808762073345267, table={database_id:201001, name_case_mode:2, table_name:"__all_virtual_scheduler_job_run_detail_v2"}, strlen=41) [2024-09-11 15:49:19.828182] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=17503530014375511261, table={database_id:201001, name_case_mode:2, table_name:"__idx_12302_all_virtual_ash_i1"}, strlen=30) [2024-09-11 15:49:19.828269] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16239231304054327411, table={database_id:201001, name_case_mode:2, table_name:"__idx_12185_all_virtual_sql_plan_monitor_i1"}, strlen=43) [2024-09-11 15:49:19.828469] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=7789048750964705481, table={database_id:201001, name_case_mode:2, table_name:"__idx_11031_all_virtual_sql_audit_i1"}, strlen=36) [2024-09-11 15:49:19.828496] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14664382071044604101, table={database_id:201001, name_case_mode:2, table_name:"__idx_11021_all_virtual_sysstat_i1"}, strlen=34) [2024-09-11 15:49:19.828517] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9878436345123346437, table={database_id:201001, name_case_mode:2, table_name:"__idx_11020_all_virtual_sesstat_i1"}, strlen=34) [2024-09-11 15:49:19.828552] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=14727691026288464667, table={database_id:201001, name_case_mode:2, table_name:"__idx_11017_all_virtual_system_event_i1"}, strlen=39) [2024-09-11 15:49:19.828587] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1104783573546073227, table={database_id:201001, name_case_mode:2, table_name:"__idx_11015_all_virtual_session_wait_history_i1"}, strlen=47) [2024-09-11 15:49:19.828627] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=11558598683348067675, table={database_id:201001, name_case_mode:2, table_name:"__idx_11014_all_virtual_session_wait_i1"}, strlen=39) [2024-09-11 15:49:19.828660] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=685544362751320801, table={database_id:201001, name_case_mode:2, table_name:"__idx_11013_all_virtual_session_event_i1"}, strlen=40) [2024-09-11 15:49:19.828740] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=16792499377288307349, table={database_id:201001, name_case_mode:2, table_name:"__idx_11003_all_virtual_plan_cache_stat_i1"}, strlen=42) [2024-09-11 15:49:19.828941] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10958272015631773073, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SQL_AUDIT"}, strlen=21) [2024-09-11 15:49:19.829056] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=16421534873438116337, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PLAN_STAT"}, strlen=21) [2024-09-11 15:49:19.829085] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=13558547876718044153, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PLAN_CACHE_PLAN_EXPLAIN"}, strlen=35) [2024-09-11 15:49:19.829116] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=954675123952698065, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_OUTLINE_AGENT"}, strlen=28) [2024-09-11 15:49:19.829129] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12151405100145753503, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PRIVILEGE"}, strlen=21) [2024-09-11 15:49:19.829162] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15783705509503860481, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SYS_PARAMETER_STAT_AGENT"}, strlen=36) [2024-09-11 15:49:19.829198] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=1240298715878553129, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_TABLE_INDEX_AGENT"}, strlen=32) [2024-09-11 15:49:19.829217] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] set tenant space table name(key=6619366707306986001, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_CHARSET_AGENT"}, strlen=28) [2024-09-11 15:49:19.829252] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] set tenant space table name(key=18138649733327172245, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_ALL_TABLE_AGENT"}, strlen=30) [2024-09-11 15:49:19.829272] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5910669776223974579, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_COLLATION"}, strlen=24) [2024-09-11 15:49:19.829306] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15064587668953574105, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SERVER_AGENT"}, strlen=24) [2024-09-11 15:49:19.829384] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17400888474716665069, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PLAN_CACHE_STAT"}, strlen=27) [2024-09-11 15:49:19.829460] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6010558242954583817, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PROCESSLIST"}, strlen=23) [2024-09-11 15:49:19.829498] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13075372594361221059, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SESSION_WAIT"}, strlen=24) [2024-09-11 15:49:19.829532] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=3057877921373148913, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SESSION_WAIT_HISTORY"}, strlen=32) [2024-09-11 15:49:19.829564] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18064947967558857015, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_MEMORY_INFO"}, strlen=23) [2024-09-11 15:49:19.829593] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] set tenant space table name(key=13859510231782735949, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_MEMSTORE_INFO"}, strlen=32) [2024-09-11 15:49:19.829638] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4755370316219665787, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_MEMSTORE_INFO"}, strlen=25) [2024-09-11 15:49:19.829662] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=3800891364362070909, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SESSTAT"}, strlen=19) [2024-09-11 15:49:19.829689] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=5576264371222165885, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SYSSTAT"}, strlen=19) [2024-09-11 15:49:19.829723] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3571432000906451209, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SYSTEM_EVENT"}, strlen=24) [2024-09-11 15:49:19.829735] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1616618779671534147, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_SESSION_VARIABLE"}, strlen=31) [2024-09-11 15:49:19.829746] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17092266054732424853, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_GLOBAL_VARIABLE"}, strlen=30) [2024-09-11 15:49:19.829764] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12453863776852237401, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_SHOW_CREATE_TABLE"}, strlen=32) [2024-09-11 15:49:19.829791] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10750467716708913161, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_SHOW_CREATE_PROCEDURE"}, strlen=36) [2024-09-11 15:49:19.829805] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5020331436799812609, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_SHOW_CREATE_TABLEGROUP"}, strlen=37) [2024-09-11 15:49:19.829819] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=11959848630817593517, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_PRIVILEGE_GRANT"}, strlen=30) [2024-09-11 15:49:19.829846] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=8521607528891372577, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_TABLE_COLUMN"}, strlen=27) [2024-09-11 15:49:19.829883] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=15886079649307873263, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TRACE_SPAN_INFO"}, strlen=27) [2024-09-11 15:49:19.829916] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17427277139297029807, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_CONCURRENT_LIMIT_SQL_AGENT"}, strlen=41) [2024-09-11 15:49:19.829930] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=2072573508439406499, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_DATA_TYPE"}, strlen=21) [2024-09-11 15:49:19.829944] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=7328156346192825341, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_AUDIT_OPERATION"}, strlen=27) [2024-09-11 15:49:19.829956] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=4979944919678583043, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_AUDIT_ACTION"}, strlen=24) [2024-09-11 15:49:19.829986] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=7490892679011979155, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PX_WORKER_STAT"}, strlen=26) [2024-09-11 15:49:19.830012] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18047997801730839805, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PS_STAT"}, strlen=19) [2024-09-11 15:49:19.830042] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5725745366666107581, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PS_ITEM_INFO"}, strlen=24) [2024-09-11 15:49:19.830073] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=709454584256138057, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_PARAMETER_STAT"}, strlen=33) [2024-09-11 15:49:19.830114] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14745886186380716369, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SQL_WORKAREA_HISTORY_STAT"}, strlen=37) [2024-09-11 15:49:19.830153] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=493140323273095767, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SQL_WORKAREA_ACTIVE"}, strlen=31) [2024-09-11 15:49:19.830178] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13701859188528486501, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SQL_WORKAREA_HISTOGRAM"}, strlen=34) [2024-09-11 15:49:19.830207] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12820534881080475365, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SQL_WORKAREA_MEMORY_INFO"}, strlen=36) [2024-09-11 15:49:19.830243] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=1558734771232747473, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TABLE_MGR"}, strlen=21) [2024-09-11 15:49:19.830266] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=912614872360138193, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SERVER_SCHEMA_INFO"}, strlen=30) [2024-09-11 15:49:19.830338] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=5576142519251074051, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SQL_PLAN_MONITOR"}, strlen=28) [2024-09-11 15:49:19.830354] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11550450796932981881, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SQL_MONITOR_STATNAME"}, strlen=32) [2024-09-11 15:49:19.830393] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=3222509492869381907, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_LOCK_WAIT_STAT"}, strlen=26) [2024-09-11 15:49:19.830425] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14766895581699948045, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_OPEN_CURSOR"}, strlen=23) [2024-09-11 15:49:19.830459] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6726961343221200067, table={database_id:201006, name_case_mode:2, table_name:"TENANT_VIRTUAL_OBJECT_DEFINITION"}, strlen=32) [2024-09-11 15:49:19.830503] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=8399779441820560587, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_ROUTINE_PARAM_SYS_AGENT"}, strlen=35) [2024-09-11 15:49:19.830542] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4091649778928606749, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TYPE_SYS_AGENT"}, strlen=26) [2024-09-11 15:49:19.830579] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3323502805254460675, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TYPE_ATTR_SYS_AGENT"}, strlen=31) [2024-09-11 15:49:19.830613] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=18188473784694160835, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_COLL_TYPE_SYS_AGENT"}, strlen=31) [2024-09-11 15:49:19.830644] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=12217158526274195943, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PACKAGE_SYS_AGENT"}, strlen=29) [2024-09-11 15:49:19.830700] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=3392251834176825089, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_TRIGGER_SYS_AGENT"}, strlen=36) [2024-09-11 15:49:19.830737] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=240307410300616103, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_ROUTINE_SYS_AGENT"}, strlen=29) [2024-09-11 15:49:19.830766] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=5843102546781691751, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_GLOBAL_TRANSACTION"}, strlen=30) [2024-09-11 15:49:19.830916] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15634757523011953937, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TABLE_REAL_AGENT"}, strlen=28) [2024-09-11 15:49:19.830978] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6385271315226289767, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_COLUMN_REAL_AGENT"}, strlen=29) [2024-09-11 15:49:19.831005] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=3570238883768216131, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_DATABASE_REAL_AGENT"}, strlen=31) [2024-09-11 15:49:19.831029] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=8959162939136035799, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_AUTO_INCREMENT_REAL_AGENT"}, strlen=37) [2024-09-11 15:49:19.831082] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13095962599989623387, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PART_REAL_AGENT"}, strlen=27) [2024-09-11 15:49:19.831124] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=9710273396038989187, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SUB_PART_REAL_AGENT"}, strlen=31) [2024-09-11 15:49:19.831155] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10139470045281449045, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PACKAGE_REAL_AGENT"}, strlen=30) [2024-09-11 15:49:19.831170] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9745109132667636759, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SEQUENCE_VALUE_REAL_AGENT"}, strlen=37) [2024-09-11 15:49:19.831205] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=17961325251060528293, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SEQUENCE_OBJECT_REAL_AGENT"}, strlen=38) [2024-09-11 15:49:19.831278] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=3790209578171387355, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_USER_REAL_AGENT"}, strlen=27) [2024-09-11 15:49:19.831302] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15220618193421138581, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SYNONYM_REAL_AGENT"}, strlen=30) [2024-09-11 15:49:19.831335] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4688348015648221869, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_FOREIGN_KEY_REAL_AGENT"}, strlen=34) [2024-09-11 15:49:19.831359] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=7788941402726656223, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_RECYCLEBIN_REAL_AGENT"}, strlen=33) [2024-09-11 15:49:19.831396] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=11063832862446786581, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_ROUTINE_REAL_AGENT"}, strlen=30) [2024-09-11 15:49:19.831431] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13312122887084384927, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TABLEGROUP_REAL_AGENT"}, strlen=33) [2024-09-11 15:49:19.831451] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=14346287031741541231, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_FOREIGN_KEY_COLUMN_REAL_AGENT"}, strlen=41) [2024-09-11 15:49:19.831480] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17075554883580067359, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_CONSTRAINT_REAL_AGENT"}, strlen=33) [2024-09-11 15:49:19.831520] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10840680912220602267, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TYPE_REAL_AGENT"}, strlen=27) [2024-09-11 15:49:19.831556] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=246093778082682985, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TYPE_ATTR_REAL_AGENT"}, strlen=32) [2024-09-11 15:49:19.831590] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=13449921089785494825, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_COLL_TYPE_REAL_AGENT"}, strlen=32) [2024-09-11 15:49:19.831631] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=6385208198904108737, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_ROUTINE_PARAM_REAL_AGENT"}, strlen=36) [2024-09-11 15:49:19.831655] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=9578908402156358501, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_KEYSTORE_REAL_AGENT"}, strlen=38) [2024-09-11 15:49:19.831679] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=10476030892634719673, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_OLS_POLICY_REAL_AGENT"}, strlen=40) [2024-09-11 15:49:19.831704] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=17204695735239765947, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_OLS_COMPONENT_REAL_AGENT"}, strlen=43) [2024-09-11 15:49:19.831726] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=991306686467851251, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_OLS_LABEL_REAL_AGENT"}, strlen=39) [2024-09-11 15:49:19.831754] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=4924428405412308721, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_OLS_USER_LEVEL_REAL_AGENT"}, strlen=44) [2024-09-11 15:49:19.831776] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15472155165878582073, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_TABLESPACE_REAL_AGENT"}, strlen=40) [2024-09-11 15:49:19.831806] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=2663102168381264919, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_PROFILE_REAL_AGENT"}, strlen=37) [2024-09-11 15:49:19.831829] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=13290442952085111093, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_ROLE_GRANTEE_MAP_REAL_AGENT"}, strlen=46) [2024-09-11 15:49:19.831866] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=10142726584912402277, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TABLE_PRIVILEGE_REAL_AGENT"}, strlen=38) [2024-09-11 15:49:19.831889] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=16165284582547397937, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_SECURITY_AUDIT_REAL_AGENT"}, strlen=44) [2024-09-11 15:49:19.831956] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=1028789838245989911, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_TRIGGER_REAL_AGENT"}, strlen=37) [2024-09-11 15:49:19.832034] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] set tenant space table name(key=86976348190435307, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_SECURITY_AUDIT_RECORD_REAL_AGENT"}, strlen=51) [2024-09-11 15:49:19.832053] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=11295070627755566871, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_SYSAUTH_REAL_AGENT"}, strlen=37) [2024-09-11 15:49:19.832079] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=4192266527385287191, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_OBJAUTH_REAL_AGENT"}, strlen=37) [2024-09-11 15:49:19.832107] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=14220930887511194059, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_ERROR_REAL_AGENT"}, strlen=35) [2024-09-11 15:49:19.832145] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set tenant space table name(key=15558168386859970891, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_DEF_SUB_PART_REAL_AGENT"}, strlen=35) [2024-09-11 15:49:19.832184] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] set tenant space table name(key=12659027134157013807, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_OBJECT_TYPE_REAL_AGENT"}, strlen=41) [2024-09-11 15:49:19.832353] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=4192386705164775943, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TABLET_ENCRYPT_INFO"}, strlen=31) [2024-09-11 15:49:19.832508] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=4790598570325686765, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_COLUMN_STAT_REAL_AGENT"}, strlen=34) [2024-09-11 15:49:19.832677] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=17802118549550839751, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_HISTOGRAM_STAT_HISTORY_REAL_AGENT"}, strlen=45) [2024-09-11 15:49:19.832844] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=15035849274684193315, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TENANT_SCHEDULER_PROGRAM_REAL_AGENT"}, strlen=47) [2024-09-11 15:49:19.833005] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=18290794327221945553, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SERVER_COMPACTION_PROGRESS"}, strlen=38) [2024-09-11 15:49:19.833271] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=17816722389201792165, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_CORE_ALL_TABLE"}, strlen=26) [2024-09-11 15:49:19.833334] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] set tenant space table name(key=12283825564198937527, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_CORE_COLUMN_TABLE"}, strlen=29) [2024-09-11 15:49:19.833500] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=4036760859619401965, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PROXY_PARTITION_INFO"}, strlen=32) [2024-09-11 15:49:19.833651] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] set tenant space table name(key=4858039470039679501, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_BACKUP_JOB_HISTORY"}, strlen=30) [2024-09-11 15:49:19.833823] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=12643871327959592495, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PLAN_BASELINE_ITEM_REAL_AGENT"}, strlen=41) [2024-09-11 15:49:19.833996] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=15416499976402432373, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_LOG_ARCHIVE_PROGRESS"}, strlen=32) [2024-09-11 15:49:19.834152] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=16635504735248940503, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_RESTORE_JOB_HISTORY"}, strlen=31) [2024-09-11 15:49:19.834304] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=4337658739498130951, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_BACKUP_STORAGE_INFO_HISTORY"}, strlen=39) [2024-09-11 15:49:19.834467] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=2953143415765643941, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_DEADLOCK_EVENT_HISTORY"}, strlen=34) [2024-09-11 15:49:19.834626] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=3544668226667192493, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_FREEZE_INFO_REAL_AGENT"}, strlen=34) [2024-09-11 15:49:19.834787] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] set tenant space table name(key=16516293575796315009, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_RLS_ATTRIBUTE_REAL_AGENT"}, strlen=36) [2024-09-11 15:49:19.834955] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=4263650047599387153, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TRANS_SCHEDULER"}, strlen=27) [2024-09-11 15:49:19.835112] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=6606725556978343807, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_THREAD"}, strlen=18) [2024-09-11 15:49:19.835279] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=10039060784009973357, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_BALANCE_JOB_REAL_AGENT"}, strlen=34) [2024-09-11 15:49:19.835436] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=9373951227016434535, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_PX_P2P_DATAHUB"}, strlen=26) [2024-09-11 15:49:19.835643] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] set tenant space table name(key=14178799646159474029, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_RECOVER_TABLE_JOB"}, strlen=29) [2024-09-11 15:49:19.835763] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=16488600996134026947, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_IMPORT_TABLE_JOB"}, strlen=28) [2024-09-11 15:49:19.835940] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] set tenant space table name(key=1561300714155895827, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_IMPORT_TABLE_TASK_HISTORY"}, strlen=37) [2024-09-11 15:49:19.836089] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=12234017200425496357, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SQLSTAT"}, strlen=19) [2024-09-11 15:49:19.836248] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=11352197425500656773, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_TRANSFER_PARTITION_TASK_HISTORY_REAL_AGENT"}, strlen=54) [2024-09-11 15:49:19.836439] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=6752725307369686221, table={database_id:201006, name_case_mode:2, table_name:"ALL_VIRTUAL_SCHEDULER_JOB_RUN_DETAIL_V2_REAL_AGENT"}, strlen=50) [2024-09-11 15:49:19.836573] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=8534425987974922479, table={database_id:201006, name_case_mode:2, table_name:"__idx_15136_idx_routine_pkg_id_real_agent"}, strlen=41) [2024-09-11 15:49:19.836739] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=2454651999249325309, table={database_id:201006, name_case_mode:2, table_name:"__idx_15160_idx_objauth_grantee_real_agent"}, strlen=42) [2024-09-11 15:49:19.836898] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=13174530972381228315, table={database_id:201006, name_case_mode:2, table_name:"__idx_15458_idx_scheduler_job_run_detail_v2_time_real_agent"}, strlen=59) [2024-09-11 15:49:19.837070] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=18002343643127621747, table={database_id:201006, name_case_mode:2, table_name:"__idx_15100_all_virtual_sql_plan_monitor_i1"}, strlen=43) [2024-09-11 15:49:19.837247] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=9559465989206138133, table={database_id:201006, name_case_mode:2, table_name:"__idx_15034_all_virtual_plan_cache_stat_i1"}, strlen=42) [2024-09-11 15:49:19.837446] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] set tenant space table name(key=144448313283230089, table={database_id:201006, name_case_mode:2, table_name:"__idx_15009_all_virtual_sql_audit_i1"}, strlen=36) [2024-09-11 15:49:19.837549] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=8369278986437195707, table={database_id:201001, name_case_mode:2, table_name:"GV$SQL_WORKAREA"}, strlen=15) [2024-09-11 15:49:19.837712] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=13143487958973300567, table={database_id:201001, name_case_mode:2, table_name:"V$OB_PROCESSLIST"}, strlen=16) [2024-09-11 15:49:19.837875] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=12937625434728911013, table={database_id:201002, name_case_mode:2, table_name:"PARAMETERS"}, strlen=10) [2024-09-11 15:49:19.838037] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=5572746848322698655, table={database_id:201001, name_case_mode:2, table_name:"GV$OB_SYS_TIME_MODEL"}, strlen=20) [2024-09-11 15:49:19.838201] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=13856518547138735877, table={database_id:201006, name_case_mode:2, table_name:"ALL_COL_COMMENTS"}, strlen=16) [2024-09-11 15:49:19.838369] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] set tenant space table name(key=14060189436473328705, table={database_id:201006, name_case_mode:2, table_name:"DBA_OBJ_AUDIT_OPTS"}, strlen=18) [2024-09-11 15:49:19.838526] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=5478600689837210307, table={database_id:201006, name_case_mode:2, table_name:"GV$SQL_JOIN_FILTER"}, strlen=18) [2024-09-11 15:49:19.838689] INFO [SHARE.SCHEMA] init_sys_table_name_map (ob_schema_struct.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] set tenant space table name(key=12018637227772852993, table={database_id:201006, name_case_mode:2, table_name:"DBA_JOBS"}, strlen=8) [2024-09-11 15:49:19.842686] INFO [SHARE.SCHEMA] alloc_ (ob_schema_mem_mgr.cpp:115) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] alloc schema mgr(tmp_ptr=0x7f5289804060, tmp_ptr=0x7f5289804060) [2024-09-11 15:49:19.842859] INFO [SHARE.SCHEMA] add_tenant (ob_schema_mgr.cpp:1165) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=18] add tenant schema(ret=0, tenant_id=1, tenant_schema={tenant_id:1, schema_version:1, tenant_name:"sys", name_case_mode:2, read_only:false, primary_zone:"", locality:"", previous_locality:"", compatibility_mode:-1, gmt_modified:0, drop_tenant_time:0, status:0, in_recyclebin:false, arbitration_service_status:{status:3}}) [2024-09-11 15:49:19.842898] INFO [SHARE.SCHEMA] add_sys_variable (ob_sys_variable_mgr.cpp:267) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=27] sys variable schema(*tmp_schema={tenant_id:1, schema_version:1, name_case_mode:2, read_only:false}) [2024-09-11 15:49:19.843042] INFO [SHARE.SCHEMA] add_table (ob_schema_mgr.cpp:2525) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=19] add __all_core_table schema(ret=0, ret="OB_SUCCESS", table_schema={tenant_id:1, database_id:201001, tablegroup_id:202001, table_id:1, association_table_id:18446744073709551615, in_offline_ddl_white_list:false, table_name:"__all_core_table", session_id:0, index_type:0, table_type:0, table_mode:{table_mode_flag:0, pk_mode:0, table_state_flag:0, view_created_method_flag:0, table_organization_mode:0, auto_increment_mode:0, rowid_mode:0, view_column_filled_flag:0}, tablespace_id:18446744073709551615, data_table_id:0, name_casemode:-1, schema_version:0, part_level:0, part_option:{part_func_type:0, part_func_expr:"", part_num:1, auto_part:false, auto_part_size:0}, sub_part_option:{part_func_type:0, part_func_expr:"", part_num:-1, auto_part:false, auto_part_size:0}, partition_num:0, def_subpartition_num:0, partition_array:null, def_subpartition_array:null, hidden_partition_array:null, index_status:1, duplicate_scope:0, encryption:"", encrypt_key:"", master_key_id:18446744073709551615, sub_part_template_flags:0, get_tablet_id():{id:1}, max_dependency_version:-1, object_status:1, is_force_view:false, truncate_version:-1}, lbt()="0x2504ceab 0x123f1221 0x5e3f2b6 0x11f34e07 0x11f36e5c 0x129b8729 0xb8cdc58 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e") [2024-09-11 15:49:19.843115] INFO [SHARE.SCHEMA] init (ob_server_schema_service.cpp:214) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=44] init schema service(ret=0, ret="OB_SUCCESS") [2024-09-11 15:49:19.843130] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] Succ to register cache(cache_name="schema_cache", priority=1001, cache_id=0) [2024-09-11 15:49:19.843141] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] Succ to register cache(cache_name="schema_history_cache", priority=1001, cache_id=1) [2024-09-11 15:49:19.843146] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Succ to register cache(cache_name="tablet_table_cache", priority=1001, cache_id=2) [2024-09-11 15:49:19.843198] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.843561] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74235][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=154618822656) [2024-09-11 15:49:19.843686] INFO register_pm (ob_page_manager.cpp:40) [74235][][T0][Y0-0000000000000000-0-0] [lt=34] register pm finish(ret=0, &pm=0x7f528a6d4380, pm.get_tid()=74235, tenant_id=500) [2024-09-11 15:49:19.843709] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74235][][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.843802] INFO [SHARE.SCHEMA] init (ob_schema_store.cpp:40) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] [SCHEMA_STORE] schema store init(tenant_id=1) [2024-09-11 15:49:19.844601] INFO [SHARE.SCHEMA] add_schema (ob_multi_version_schema_service.cpp:2199) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] add schema(tenant_id=1, refreshed_schema_version=1, new_schema_version=1) [2024-09-11 15:49:19.844618] INFO [SHARE.SCHEMA] alloc_ (ob_schema_mem_mgr.cpp:115) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13] alloc schema mgr(tmp_ptr=0x7f5289819530, tmp_ptr=0x7f5289819530) [2024-09-11 15:49:19.844709] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:749) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] assign tenant_infos_ cost(ret=0, ret="OB_SUCCESS", cost=4) [2024-09-11 15:49:19.844743] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:756) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] assign user_infos_ cost(ret=0, ret="OB_SUCCESS", cost=5) [2024-09-11 15:49:19.844753] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:757) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] assign database_infos_ cost(ret=0, ret="OB_SUCCESS", cost=0) [2024-09-11 15:49:19.844759] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:758) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] assign database_name_map_ cost(ret=0, ret="OB_SUCCESS", cost=2) [2024-09-11 15:49:19.844766] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:759) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] assign tablegroup_infos_ cost(ret=0, ret="OB_SUCCESS", cost=0) [2024-09-11 15:49:19.844776] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:760) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] assign table_infos_ cost(ret=0, ret="OB_SUCCESS", cost=6) [2024-09-11 15:49:19.844780] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:761) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] assign index_infos_ cost(ret=0, ret="OB_SUCCESS", cost=0) [2024-09-11 15:49:19.844784] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:762) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] assign aux_vp_infos_ cost(ret=0, ret="OB_SUCCESS", cost=0) [2024-09-11 15:49:19.844789] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:763) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] assign lob_meta_infos_ cost(ret=0, ret="OB_SUCCESS", cost=1) [2024-09-11 15:49:19.844795] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:764) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] assign lob_piece_infos_ cost(ret=0, ret="OB_SUCCESS", cost=0) [2024-09-11 15:49:19.844800] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:765) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] assign drop_tenant_infos_ cost(ret=0, ret="OB_SUCCESS", cost=0) [2024-09-11 15:49:19.844808] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:766) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] assign table_id_map_ cost(ret=0, ret="OB_SUCCESS", cost=1) [2024-09-11 15:49:19.844813] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:767) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] assign table_name_map_ cost(ret=0, ret="OB_SUCCESS", cost=1) [2024-09-11 15:49:19.844820] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:768) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] assign index_name_map_ cost(ret=0, ret="OB_SUCCESS", cost=1) [2024-09-11 15:49:19.844825] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:769) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] assign aux_vp_name_map_ cost(ret=0, ret="OB_SUCCESS", cost=1) [2024-09-11 15:49:19.844832] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:770) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] assign foreign_key_name_map_ cost(ret=0, ret="OB_SUCCESS", cost=0) [2024-09-11 15:49:19.844841] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:771) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] assign constraint_name_map_ cost(ret=0, ret="OB_SUCCESS", cost=1) [2024-09-11 15:49:19.844846] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:772) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] assign hidden_table_name_map_ cost(ret=0, ret="OB_SUCCESS", cost=1) [2024-09-11 15:49:19.844886] INFO [SHARE.SCHEMA] assign (ob_schema_mgr.cpp:826) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] ObSchemaMgr assign cost(ret=0, ret="OB_SUCCESS", cost=201) [2024-09-11 15:49:19.844893] INFO [SHARE.SCHEMA] put (ob_schema_mgr_cache.cpp:502) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] put schema mgr(schema version=1) [2024-09-11 15:49:19.844909] WDIAG [SERVER.OMT] get_tenant_config_with_lock (ob_tenant_config_mgr.cpp:372) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5][errcode=-4201] failed to get tenant config(tenant_id=1, ret=-4201) [2024-09-11 15:49:19.844928] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.844933] INFO [SHARE.SCHEMA] put (ob_schema_mgr_cache.cpp:578) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] dst schema mgr item ptr(tenant_id=1, dst_item=0x7f5289a4c030, dst_timestamp=1726040959844932, dst_schema_version=1, target_pos=0) [2024-09-11 15:49:19.844940] INFO [SHARE.SCHEMA] alloc_and_put_schema_mgr_ (ob_multi_version_schema_service.cpp:2285) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] put schema mgr succeed(schema_version=1, eliminated_schema_version=-1, tenant_id=1) [2024-09-11 15:49:19.844945] WDIAG [SERVER.OMT] get_tenant_config_with_lock (ob_tenant_config_mgr.cpp:372) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4][errcode=-4201] failed to get tenant config(tenant_id=1, ret=-4201) [2024-09-11 15:49:19.844948] INFO [SHARE.SCHEMA] add_schema (ob_multi_version_schema_service.cpp:2238) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] [REFRESH_SCHEMA] change refreshed_schema_version with new mode(tenant_id=1, new_schema_version=1) [2024-09-11 15:49:19.844959] INFO [SHARE.SCHEMA] add_schema (ob_multi_version_schema_service.cpp:2245) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] finish add schema(ret=0, ret="OB_SUCCESS", tenant_id=1, new_schema_version=1, cost_ts=360) [2024-09-11 15:49:19.844967] INFO [SERVER] init (ob_srv_network_frame.cpp:120) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] io thread connection negotiation enabled! [2024-09-11 15:49:19.845146] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74236][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=158913789952) [2024-09-11 15:49:19.845231] INFO register_pm (ob_page_manager.cpp:40) [74236][][T0][Y0-0000000000000000-0-0] [lt=21] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.845246] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74236][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.845330] INFO [SERVER.OMT] add_self_to_cgroup (ob_cgroup_ctrl.cpp:358) [74236][LeaseQueueTh0][T0][Y0-0000000000000000-0-0] [lt=4] add tid to cgroup success(group_path="cgroup/other////", tid_value="74236", tenant_id=500, group_id=12) [2024-09-11 15:49:19.845394] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74237][][T0][Y0-0000000000000000-0-0] [lt=0] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.845478] INFO register_pm (ob_page_manager.cpp:40) [74237][][T0][Y0-0000000000000000-0-0] [lt=27] register pm finish(ret=0, &pm=0x7f528a7d0380, pm.get_tid()=74237, tenant_id=500) [2024-09-11 15:49:19.845841] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74237][][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.845941] INFO [SERVER.OMT] add_self_to_cgroup (ob_cgroup_ctrl.cpp:358) [74237][LeaseQueueTh1][T0][Y0-0000000000000000-0-0] [lt=15] add tid to cgroup success(group_path="cgroup/other////", tid_value="74237", tenant_id=500, group_id=12) [2024-09-11 15:49:19.845957] INFO [RPC.FRAME] onThreadCreated (ob_req_qhandler.cpp:45) [74237][LeaseQueueTh1][T0][Y0-0000000000000000-0-0] [lt=14] new task thread create(&translator_=0x55ef065e07d0) [2024-09-11 15:49:19.845964] INFO [RPC.OBRPC] th_init (ob_rpc_translator.cpp:33) [74237][LeaseQueueTh1][T0][Y0-0000000000000000-0-0] [lt=6] Init thread local success [2024-09-11 15:49:19.846033] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74238][][T0][Y0-0000000000000000-0-0] [lt=0] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.846098] INFO register_pm (ob_page_manager.cpp:40) [74238][][T0][Y0-0000000000000000-0-0] [lt=13] register pm finish(ret=0, &pm=0x7f5289656380, pm.get_tid()=74238, tenant_id=500) [2024-09-11 15:49:19.846113] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74238][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.846264] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74239][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=171798691840) [2024-09-11 15:49:19.846349] INFO register_pm (ob_page_manager.cpp:40) [74239][][T0][Y0-0000000000000000-0-0] [lt=19] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.846368] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74239][][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.846410] INFO create_queue_thread (ob_srv_deliver.cpp:476) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] start tg(tg_id=30, tg_name=DDLPQueueTh) [2024-09-11 15:49:19.846543] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74240][][T0][Y0-0000000000000000-0-0] [lt=0] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.846605] INFO register_pm (ob_page_manager.cpp:40) [74240][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f5289752380, pm.get_tid()=74240, tenant_id=500) [2024-09-11 15:49:19.846617] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74240][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.846744] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74241][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=180388626432) [2024-09-11 15:49:19.846801] INFO register_pm (ob_page_manager.cpp:40) [74241][][T0][Y0-0000000000000000-0-0] [lt=10] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.846813] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74241][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.846950] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74242][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=184683593728) [2024-09-11 15:49:19.847006] INFO register_pm (ob_page_manager.cpp:40) [74242][][T0][Y0-0000000000000000-0-0] [lt=10] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.847018] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74242][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.847149] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74243][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=188978561024) [2024-09-11 15:49:19.847207] INFO register_pm (ob_page_manager.cpp:40) [74243][][T0][Y0-0000000000000000-0-0] [lt=10] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.847219] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74243][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.847251] INFO [SERVER.OMT] add_self_to_cgroup (ob_cgroup_ctrl.cpp:358) [74243][DDLPQueueTh3][T0][Y0-0000000000000000-0-0] [lt=2] add tid to cgroup success(group_path="cgroup/other////", tid_value="74243", tenant_id=500, group_id=12) [2024-09-11 15:49:19.847374] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74244][][T0][Y0-0000000000000000-0-0] [lt=0] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.847428] INFO register_pm (ob_page_manager.cpp:40) [74244][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f5289552380, pm.get_tid()=74244, tenant_id=500) [2024-09-11 15:49:19.847439] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74244][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.847564] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74245][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=197568495616) [2024-09-11 15:49:19.847617] INFO register_pm (ob_page_manager.cpp:40) [74245][][T0][Y0-0000000000000000-0-0] [lt=8] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.847627] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74245][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.847754] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74246][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=201863462912) [2024-09-11 15:49:19.847807] INFO register_pm (ob_page_manager.cpp:40) [74246][][T0][Y0-0000000000000000-0-0] [lt=9] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.847819] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74246][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.847955] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74247][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=206158430208) [2024-09-11 15:49:19.848008] INFO register_pm (ob_page_manager.cpp:40) [74247][][T0][Y0-0000000000000000-0-0] [lt=9] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.848022] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74247][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.848048] INFO [SERVER.OMT] add_self_to_cgroup (ob_cgroup_ctrl.cpp:358) [74247][MysqlQueueTh3][T0][Y0-0000000000000000-0-0] [lt=2] add tid to cgroup success(group_path="cgroup/other////", tid_value="74247", tenant_id=500, group_id=12) [2024-09-11 15:49:19.848147] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74248][][T0][Y0-0000000000000000-0-0] [lt=0] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.848201] INFO register_pm (ob_page_manager.cpp:40) [74248][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5289352380, pm.get_tid()=74248, tenant_id=500) [2024-09-11 15:49:19.848214] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74248][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.848336] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74249][][T0][Y0-0000000000000000-0-0] [lt=0] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.848388] INFO register_pm (ob_page_manager.cpp:40) [74249][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52893d0380, pm.get_tid()=74249, tenant_id=500) [2024-09-11 15:49:19.848398] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74249][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.848561] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74250][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=219043332096) [2024-09-11 15:49:19.848613] INFO register_pm (ob_page_manager.cpp:40) [74250][][T0][Y0-0000000000000000-0-0] [lt=8] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.848623] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74250][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.848750] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74251][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=223338299392) [2024-09-11 15:49:19.848809] INFO register_pm (ob_page_manager.cpp:40) [74251][][T0][Y0-0000000000000000-0-0] [lt=11] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:19.848820] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74251][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.848855] INFO [SERVER.OMT] add_self_to_cgroup (ob_cgroup_ctrl.cpp:358) [74251][DiagnoseQueueTh][T0][Y0-0000000000000000-0-0] [lt=3] add tid to cgroup success(group_path="cgroup/other////", tid_value="74251", tenant_id=500, group_id=12) [2024-09-11 15:49:19.877616] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.917876] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] clock generator not inited [2024-09-11 15:49:19.977789] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003266] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003303] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003311] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003316] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003320] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003325] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003328] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003331] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003334] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003337] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003340] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003343] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003346] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003349] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003353] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003356] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=2][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003360] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003363] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003366] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003369] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003373] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003377] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003381] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003386] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003390] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003395] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003400] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003404] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003408] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003412] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003417] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003422] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003428] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003437] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003442] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003446] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003454] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003459] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003463] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003467] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003472] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003477] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003481] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003485] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003492] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003497] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003501] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003505] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003509] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003513] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003517] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003522] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003527] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003541] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003546] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003550] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003554] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003559] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003566] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003571] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003575] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003580] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003584] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:20.003591] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:20.003596] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=3][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:20.003600] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003605] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=3] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-52011957043, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:20.003609] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003614] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003617] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003622] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003627] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003632] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003639] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003644] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003648] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003653] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003658] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003665] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003670] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003674] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003679] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003683] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003691] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003698] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003702] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003707] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003711] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003715] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003721] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003728] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003733] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003737] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.003742] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.003777] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.003803] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 1 | total nodes count: 0 | [KVCACHE-HAZARD] i= 0 | thread_id= 74234 | inited= 1 | waiting_nodes_count= 0 | last_retire_version= 0 | acquired_version= 0 | [2024-09-11 15:49:20.019103] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.055079] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=0] Cache replace map node details(ret=0, replace_node_count=0, replace_time=51853, replace_start_pos=0, replace_num=100000) [2024-09-11 15:49:20.055103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:20.068721] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:183) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=0] create eio success [2024-09-11 15:49:20.068810] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:186) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=18] create eio success(thread_num=3, lbt()=0x2504ceab 0x14dc6343 0x14dc93c9 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.068828] INFO [RPC.FRAME] init_rpc_eio_ (ob_net_easy.cpp:199) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] init rpc eio success(opts={rpc_io_cnt_:3, high_prio_rpc_io_cnt_:0, mysql_io_cnt_:3, batch_rpc_io_cnt_:3, use_ipv6_:false, tcp_user_timeout_:3000000, tcp_keepidle_:-1389934592, tcp_keepintvl_:6000000, tcp_keepcnt_:10, enable_tcp_keepalive_:1}, lbt()=0x2504ceab 0x14dc6487 0x14dc95c3 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.069323] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:183) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] create eio success [2024-09-11 15:49:20.069337] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:186) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create eio success(thread_num=3, lbt()=0x2504ceab 0x14dc6343 0x14dc9871 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.069347] INFO [RPC.FRAME] init_mysql_eio_ (ob_net_easy.cpp:213) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] init mysql eio success(opts={rpc_io_cnt_:3, high_prio_rpc_io_cnt_:0, mysql_io_cnt_:3, batch_rpc_io_cnt_:3, use_ipv6_:false, tcp_user_timeout_:3000000, tcp_keepidle_:-1389934592, tcp_keepintvl_:6000000, tcp_keepcnt_:10, enable_tcp_keepalive_:1}, lbt()=0x2504ceab 0x14dc65cb 0x14dc9a95 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.069650] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:183) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] create eio success [2024-09-11 15:49:20.069663] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:186) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create eio success(thread_num=1, lbt()=0x2504ceab 0x14dc6343 0x14dc9ae0 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.069669] INFO [RPC.FRAME] init_mysql_eio_ (ob_net_easy.cpp:213) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] init mysql eio success(opts={rpc_io_cnt_:3, high_prio_rpc_io_cnt_:0, mysql_io_cnt_:3, batch_rpc_io_cnt_:3, use_ipv6_:false, tcp_user_timeout_:3000000, tcp_keepidle_:-1389934592, tcp_keepintvl_:6000000, tcp_keepcnt_:10, enable_tcp_keepalive_:1}, lbt()=0x2504ceab 0x14dc65cb 0x14dc9d04 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.069998] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:183) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create eio success [2024-09-11 15:49:20.070010] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:186) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create eio success(thread_num=4, lbt()=0x2504ceab 0x14dc6343 0x14dc9d80 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.070022] INFO [RPC.FRAME] init_rpc_eio_ (ob_net_easy.cpp:199) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] init rpc eio success(opts={rpc_io_cnt_:3, high_prio_rpc_io_cnt_:0, mysql_io_cnt_:3, batch_rpc_io_cnt_:3, use_ipv6_:false, tcp_user_timeout_:3000000, tcp_keepidle_:-1389934592, tcp_keepintvl_:6000000, tcp_keepcnt_:10, enable_tcp_keepalive_:1}, lbt()=0x2504ceab 0x14dc6487 0x14dc9f43 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.070312] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:183) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] create eio success [2024-09-11 15:49:20.070323] INFO [RPC.FRAME] create_eio_ (ob_net_easy.cpp:186) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] create eio success(thread_num=1, lbt()=0x2504ceab 0x14dc6343 0x14dc9f8d 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.070330] INFO [RPC.FRAME] init_rpc_eio_ (ob_net_easy.cpp:199) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] init rpc eio success(opts={rpc_io_cnt_:3, high_prio_rpc_io_cnt_:0, mysql_io_cnt_:3, batch_rpc_io_cnt_:3, use_ipv6_:false, tcp_user_timeout_:3000000, tcp_keepidle_:-1389934592, tcp_keepintvl_:6000000, tcp_keepcnt_:10, enable_tcp_keepalive_:1}, lbt()=0x2504ceab 0x14dc6487 0x14dca150 0xaae9f0c 0xb8cdcad 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.070345] INFO [SERVER] reload_ssl_config (ob_srv_network_frame.cpp:519) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] finish reload_ssl_config, close ssl [2024-09-11 15:49:20.070486] INFO [RPC.FRAME] add_unix_listen_ (ob_net_easy.cpp:372) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] listen unix domain succ(path=unix:run/sql.sock) [2024-09-11 15:49:20.070514] INFO [RPC.FRAME] net_register_and_add_listen_ (ob_net_easy.cpp:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] listen start,(eio->magic=1321370295473772970) [2024-09-11 15:49:20.070532] INFO [RPC.FRAME] net_register_and_add_listen_ (ob_net_easy.cpp:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] listen start,(eio->magic=6427631941701759361) [2024-09-11 15:49:20.070558] INFO [RPC.OBRPC] set_pipefd_listen (ob_net_keepalive.cpp:233) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] set pipefd: 58 [2024-09-11 15:49:20.070636] INFO [RPC.FRAME] add_unix_listen_ (ob_net_easy.cpp:372) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] listen unix domain succ(path=unix:run/rpc.sock) [2024-09-11 15:49:20.077887] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] clock generator not inited [2024-09-11 15:49:20.077924] INFO ussl_eloop_regist (ussl_eloop.c:41) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] [ussl] sock regist: 0x55ef152af8f0 fd=62 [2024-09-11 15:49:20.077934] INFO ob_pthread_create (ob_pthread.cpp:26) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] ob_pthread_create start [2024-09-11 15:49:20.078144] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74252][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=227633266688) [2024-09-11 15:49:20.078248] INFO register_pm (ob_page_manager.cpp:40) [74252][][T0][Y0-0000000000000000-0-0] [lt=25] register pm finish(ret=0, &pm=0x7f5289152380, pm.get_tid()=74252, tenant_id=500) [2024-09-11 15:49:20.078266] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74252][][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.078280] INFO ob_pthread_create (ob_pthread.cpp:39) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] ob_pthread_create succeed(thread=0x7f5298f91ef0) [2024-09-11 15:49:20.078289] INFO ussl_init_bg_thread (ussl-loop.c:127) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] [ussl] create background thread success! [2024-09-11 15:49:20.078354] INFO ussl_eloop_regist (ussl_eloop.c:41) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] [ussl] sock regist: 0x55ef152af880 fd=61 [2024-09-11 15:49:20.078367] INFO uloop_add_listen (ussl-loop.c:92) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] [ussl] listen success, fd:61, port:2882 [2024-09-11 15:49:20.078370] INFO ussl_loop_add_listen (ussl-loop.c:235) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] [ussl] uloop add listen success! port:2882 [2024-09-11 15:49:20.078402] INFO ussl_eloop_regist (ussl_eloop.c:41) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] [ussl] sock regist: 0x55ef152af8b8 fd=65 [2024-09-11 15:49:20.078408] INFO uloop_add_listen (ussl-loop.c:92) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] [ussl] listen success, fd:65, port:2882 [2024-09-11 15:49:20.078411] INFO ussl_loop_add_listen (ussl-loop.c:235) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] [ussl] uloop add listen success! port:2882 [2024-09-11 15:49:20.080027] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] PNIO sock regist: 0x7f52886040a8 fd=67 [2024-09-11 15:49:20.080040] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] PNIO sock regist: 0x7f52887846a8 fd=68 [2024-09-11 15:49:20.080046] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO sock regist: 0x7f5288784808 fd=69 [2024-09-11 15:49:20.080049] INFO timerfd_set_interval (timerfd.c:14) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO set interval: 8192 [2024-09-11 15:49:20.080155] INFO pktc_init (packet_client.c:113) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO pktc init succ [2024-09-11 15:49:20.080172] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] PNIO sock regist: 0x7f52886044d0 fd=72 [2024-09-11 15:49:20.080186] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] PNIO sock regist: 0x7f5288604450 fd=70 [2024-09-11 15:49:20.080188] INFO listenfd_init (listenfd.c:83) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO listen succ: 70 [2024-09-11 15:49:20.080193] INFO pkts_init (packet_server.c:80) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO pkts listen at "0.0.0.0:0" [2024-09-11 15:49:20.080362] INFO ob_pthread_create (ob_pthread.cpp:26) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] ob_pthread_create start [2024-09-11 15:49:20.080554] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74253][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=231928233984) [2024-09-11 15:49:20.080654] INFO register_pm (ob_page_manager.cpp:40) [74253][][T0][Y0-0000000000000000-0-0] [lt=22] register pm finish(ret=0, &pm=0x7f52891d0380, pm.get_tid()=74253, tenant_id=500) [2024-09-11 15:49:20.080673] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74253][][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.080683] INFO ob_pthread_create (ob_pthread.cpp:39) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] ob_pthread_create succeed(thread=0x7f5298f73df0) [2024-09-11 15:49:20.080703] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=5] PNIO [ratelimit] time: 1726040960080702, bytes: 0, bw: 0.000000 MB/s, add_ts: 1726040960080702, add_bytes: 0 [2024-09-11 15:49:20.082277] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] PNIO sock regist: 0x7f52882040a8 fd=74 [2024-09-11 15:49:20.082288] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] PNIO sock regist: 0x7f52883846a8 fd=75 [2024-09-11 15:49:20.082293] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO sock regist: 0x7f5288384808 fd=76 [2024-09-11 15:49:20.082296] INFO timerfd_set_interval (timerfd.c:14) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO set interval: 8192 [2024-09-11 15:49:20.082404] INFO pktc_init (packet_client.c:113) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO pktc init succ [2024-09-11 15:49:20.082422] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] PNIO sock regist: 0x7f52882044d0 fd=79 [2024-09-11 15:49:20.082431] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] PNIO sock regist: 0x7f5288204450 fd=77 [2024-09-11 15:49:20.082433] INFO listenfd_init (listenfd.c:83) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO listen succ: 77 [2024-09-11 15:49:20.082437] INFO pkts_init (packet_server.c:80) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO pkts listen at "0.0.0.0:0" [2024-09-11 15:49:20.082600] INFO ob_pthread_create (ob_pthread.cpp:26) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] ob_pthread_create start [2024-09-11 15:49:20.082770] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74254][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=236223201280) [2024-09-11 15:49:20.082856] INFO register_pm (ob_page_manager.cpp:40) [74254][][T0][Y0-0000000000000000-0-0] [lt=20] register pm finish(ret=0, &pm=0x7f5288056380, pm.get_tid()=74254, tenant_id=500) [2024-09-11 15:49:20.082872] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74254][][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.082883] INFO ob_pthread_create (ob_pthread.cpp:39) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ob_pthread_create succeed(thread=0x7f5298f7fed0) [2024-09-11 15:49:20.084466] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] PNIO sock regist: 0x7f5287c040a8 fd=81 [2024-09-11 15:49:20.084481] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=12] PNIO sock regist: 0x7f5287d846a8 fd=82 [2024-09-11 15:49:20.084487] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO sock regist: 0x7f5287d84808 fd=83 [2024-09-11 15:49:20.084490] INFO timerfd_set_interval (timerfd.c:14) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO set interval: 8192 [2024-09-11 15:49:20.084596] INFO pktc_init (packet_client.c:113) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] PNIO pktc init succ [2024-09-11 15:49:20.084613] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] PNIO sock regist: 0x7f5287c044d0 fd=86 [2024-09-11 15:49:20.084617] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO sock regist: 0x7f5287c04450 fd=84 [2024-09-11 15:49:20.084619] INFO listenfd_init (listenfd.c:83) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO listen succ: 84 [2024-09-11 15:49:20.084622] INFO pkts_init (packet_server.c:80) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO pkts listen at "0.0.0.0:0" [2024-09-11 15:49:20.084797] INFO ob_pthread_create (ob_pthread.cpp:26) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] ob_pthread_create start [2024-09-11 15:49:20.085097] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74255][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=240518168576) [2024-09-11 15:49:20.085190] INFO register_pm (ob_page_manager.cpp:40) [74255][][T0][Y0-0000000000000000-0-0] [lt=24] register pm finish(ret=0, &pm=0x7f52880d4380, pm.get_tid()=74255, tenant_id=500) [2024-09-11 15:49:20.085206] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74255][][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.085217] INFO ob_pthread_create (ob_pthread.cpp:39) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ob_pthread_create succeed(thread=0x7f5298f81ec0) [2024-09-11 15:49:20.086795] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] PNIO sock regist: 0x7f52878040a8 fd=88 [2024-09-11 15:49:20.086805] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] PNIO sock regist: 0x7f52879846a8 fd=89 [2024-09-11 15:49:20.086810] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO sock regist: 0x7f5287984808 fd=90 [2024-09-11 15:49:20.086812] INFO timerfd_set_interval (timerfd.c:14) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO set interval: 8192 [2024-09-11 15:49:20.086916] INFO pktc_init (packet_client.c:113) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO pktc init succ [2024-09-11 15:49:20.086932] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] PNIO sock regist: 0x7f52878044d0 fd=93 [2024-09-11 15:49:20.086942] INFO eloop_regist (eloop.c:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] PNIO sock regist: 0x7f5287804450 fd=91 [2024-09-11 15:49:20.086945] INFO listenfd_init (listenfd.c:83) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO listen succ: 91 [2024-09-11 15:49:20.086948] INFO pkts_init (packet_server.c:80) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] PNIO pkts listen at "0.0.0.0:0" [2024-09-11 15:49:20.087114] INFO ob_pthread_create (ob_pthread.cpp:26) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] ob_pthread_create start [2024-09-11 15:49:20.087263] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74256][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=244813135872) [2024-09-11 15:49:20.087346] INFO register_pm (ob_page_manager.cpp:40) [74256][][T0][Y0-0000000000000000-0-0] [lt=15] register pm finish(ret=0, &pm=0x7f5288152380, pm.get_tid()=74256, tenant_id=500) [2024-09-11 15:49:20.087362] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74256][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.087372] INFO ob_pthread_create (ob_pthread.cpp:39) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ob_pthread_create succeed(thread=0x7f5298f85cb0) [2024-09-11 15:49:20.087382] INFO [SERVER] init (ob_srv_network_frame.cpp:170) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] poc rpc server start successfully [2024-09-11 15:49:20.087390] INFO [SERVER] init (ob_srv_network_frame.cpp:175) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] init rpc network frame successfully(ssl_client_authentication="False") [2024-09-11 15:49:20.087390] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=4] PNIO [ratelimit] time: 1726040960087389, bytes: 0, bw: 0.000000 MB/s, add_ts: 1726040960087389, add_bytes: 0 [2024-09-11 15:49:20.087403] INFO [RPC] init (ob_batch_rpc.h:478) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] base thread init finished(is_hp_eio_enabled=false) [2024-09-11 15:49:20.087408] INFO [RPC] init (ob_batch_rpc.h:478) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] base thread init finished(is_hp_eio_enabled=false) [2024-09-11 15:49:20.087411] INFO [RPC] init (ob_batch_rpc.h:478) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] base thread init finished(is_hp_eio_enabled=false) [2024-09-11 15:49:20.087414] INFO [RPC] init (ob_batch_rpc.h:478) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] base thread init finished(is_hp_eio_enabled=false) [2024-09-11 15:49:20.087417] INFO [RPC] init (ob_batch_rpc.h:478) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] base thread init finished(is_hp_eio_enabled=false) [2024-09-11 15:49:20.087422] INFO [RPC] init (ob_batch_rpc.h:478) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] base thread init finished(is_hp_eio_enabled=false) [2024-09-11 15:49:20.087426] INFO [RPC] init (ob_batch_rpc.h:478) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] base thread init finished(is_hp_eio_enabled=false) [2024-09-11 15:49:20.087428] INFO [RPC] init (ob_batch_rpc.h:478) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=1] base thread init finished(is_hp_eio_enabled=false) [2024-09-11 15:49:20.087432] INFO init_network (ob_server.cpp:2386) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] start tg(lib::TGDefIDs::BRPC=25, tg_name=BRPC) [2024-09-11 15:49:20.087563] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74257][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=249108103168) [2024-09-11 15:49:20.087630] INFO register_pm (ob_page_manager.cpp:40) [74257][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f52881d0380, pm.get_tid()=74257, tenant_id=500) [2024-09-11 15:49:20.087648] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74257][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.087791] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74258][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=253403070464) [2024-09-11 15:49:20.087861] INFO register_pm (ob_page_manager.cpp:40) [74258][][T0][Y0-0000000000000000-0-0] [lt=15] register pm finish(ret=0, &pm=0x7f5287656380, pm.get_tid()=74258, tenant_id=500) [2024-09-11 15:49:20.087876] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74258][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.088019] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74259][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=257698037760) [2024-09-11 15:49:20.088089] INFO register_pm (ob_page_manager.cpp:40) [74259][][T0][Y0-0000000000000000-0-0] [lt=13] register pm finish(ret=0, &pm=0x7f52876d4380, pm.get_tid()=74259, tenant_id=500) [2024-09-11 15:49:20.088103] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74259][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.088228] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74260][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=261993005056) [2024-09-11 15:49:20.088304] INFO register_pm (ob_page_manager.cpp:40) [74260][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f5287752380, pm.get_tid()=74260, tenant_id=500) [2024-09-11 15:49:20.088317] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74260][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.088442] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74261][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=266287972352) [2024-09-11 15:49:20.088505] INFO register_pm (ob_page_manager.cpp:40) [74261][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f52877d0380, pm.get_tid()=74261, tenant_id=500) [2024-09-11 15:49:20.088518] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74261][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.088648] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74262][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=270582939648) [2024-09-11 15:49:20.088720] INFO register_pm (ob_page_manager.cpp:40) [74262][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f5287456380, pm.get_tid()=74262, tenant_id=500) [2024-09-11 15:49:20.088734] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74262][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.088866] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74263][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=274877906944) [2024-09-11 15:49:20.088952] INFO register_pm (ob_page_manager.cpp:40) [74263][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f52874d4380, pm.get_tid()=74263, tenant_id=500) [2024-09-11 15:49:20.088967] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74263][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.089098] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74264][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=279172874240) [2024-09-11 15:49:20.089165] INFO register_pm (ob_page_manager.cpp:40) [74264][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f5287552380, pm.get_tid()=74264, tenant_id=500) [2024-09-11 15:49:20.089178] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74264][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.089191] INFO init (ob_rl_rpc.cpp:41) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=12] ObRLGetRegionBWCallback inited [2024-09-11 15:49:20.089201] INFO init_network (ob_server.cpp:2390) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] start tg(lib::TGDefIDs::RLMGR=26, tg_name=RLMGR) [2024-09-11 15:49:20.089325] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74265][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=283467841536) [2024-09-11 15:49:20.089388] INFO register_pm (ob_page_manager.cpp:40) [74265][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f52875d0380, pm.get_tid()=74265, tenant_id=500) [2024-09-11 15:49:20.089401] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74265][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.094129] INFO [SHARE] init (ob_rs_mgr.cpp:229) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObRsMgr init successfully! master rootserver(master_rs="10.31.35.6:2882") [2024-09-11 15:49:20.094222] INFO [SERVER] init (ob_service.cpp:219) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=20] [OBSERVICE_NOTICE] init ob_service begin [2024-09-11 15:49:20.094233] INFO init (ob_heartbeat.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] start tg(lib::TGDefIDs::ObHeartbeat=44, tg_name=ObHeartbeat) [2024-09-11 15:49:20.094378] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74266][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=287762808832) [2024-09-11 15:49:20.094444] INFO register_pm (ob_page_manager.cpp:40) [74266][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f5286856380, pm.get_tid()=74266, tenant_id=500) [2024-09-11 15:49:20.094457] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74266][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.094506] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] ObTimer create success(this=0x7f529d2adad0, thread_id=74266, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0xaa394a9 0xb1aa063 0xb8cf0b5 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.094636] INFO run1 (ob_timer.cpp:361) [74266][][T0][Y0-0000000000000000-0-0] [lt=3] timer thread started(this=0x7f529d2adad0, tid=74266, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.094688] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74267][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=292057776128) [2024-09-11 15:49:20.094825] INFO register_pm (ob_page_manager.cpp:40) [74267][][T0][Y0-0000000000000000-0-0] [lt=27] register pm finish(ret=0, &pm=0x7f52868d4380, pm.get_tid()=74267, tenant_id=500) [2024-09-11 15:49:20.094855] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74267][][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.094886] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74267][][T0][Y0-0000000000000000-0-0] [lt=15] UniqTaskQueue thread start [2024-09-11 15:49:20.095042] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74268][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=296352743424) [2024-09-11 15:49:20.095107] INFO register_pm (ob_page_manager.cpp:40) [74268][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f5286952380, pm.get_tid()=74268, tenant_id=500) [2024-09-11 15:49:20.095119] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74268][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.095128] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74268][][T0][Y0-0000000000000000-0-0] [lt=4] UniqTaskQueue thread start [2024-09-11 15:49:20.095659] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74269][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=300647710720) [2024-09-11 15:49:20.095735] INFO register_pm (ob_page_manager.cpp:40) [74269][][T0][Y0-0000000000000000-0-0] [lt=17] register pm finish(ret=0, &pm=0x7f52869d0380, pm.get_tid()=74269, tenant_id=500) [2024-09-11 15:49:20.095750] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74269][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.095760] INFO [COMMON] run1 (ob_dedup_queue.cpp:361) [74269][][T0][Y0-0000000000000000-0-0] [lt=4] dedup queue thread start(this=0x55ef0ab01340) [2024-09-11 15:49:20.095799] INFO [COMMON] init (ob_dedup_queue.cpp:111) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] init dedup-queue:(thread_num=1, queue_size=20480, task_map_size=20480, total_mem_limit=335544320, hold_mem_limit=167772160, page_size=7936, this=0x55ef0ab01340, lbt="0x2504ceab 0x13aba403 0x13ab98d1 0x11828252 0xb1aa0a5 0xb8cf0b5 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e") [2024-09-11 15:49:20.096330] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74270][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=304942678016) [2024-09-11 15:49:20.096386] INFO register_pm (ob_page_manager.cpp:40) [74270][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f5286456380, pm.get_tid()=74270, tenant_id=500) [2024-09-11 15:49:20.096399] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74270][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.096404] INFO [COMMON] run1 (ob_dedup_queue.cpp:361) [74270][][T0][Y0-0000000000000000-0-0] [lt=4] dedup queue thread start(this=0x55ef07060580) [2024-09-11 15:49:20.096410] INFO [COMMON] init (ob_dedup_queue.cpp:111) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] init dedup-queue:(thread_num=1, queue_size=20480, task_map_size=20480, total_mem_limit=335544320, hold_mem_limit=167772160, page_size=7936, this=0x55ef07060580, lbt="0x2504ceab 0x13aba403 0x13ab98d1 0x11828252 0xb1aa0e0 0xb8cf0b5 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e") [2024-09-11 15:49:20.096930] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74271][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=309237645312) [2024-09-11 15:49:20.096983] INFO register_pm (ob_page_manager.cpp:40) [74271][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52864d4380, pm.get_tid()=74271, tenant_id=500) [2024-09-11 15:49:20.096993] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74271][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.096998] INFO [COMMON] run1 (ob_dedup_queue.cpp:361) [74271][][T0][Y0-0000000000000000-0-0] [lt=3] dedup queue thread start(this=0x55ef071bcd40) [2024-09-11 15:49:20.097004] INFO [COMMON] init (ob_dedup_queue.cpp:111) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] init dedup-queue:(thread_num=1, queue_size=20480, task_map_size=20480, total_mem_limit=335544320, hold_mem_limit=167772160, page_size=7936, this=0x55ef071bcd40, lbt="0x2504ceab 0x13aba403 0x13ab98d1 0x11828252 0xb1aa179 0xb8cf0b5 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e") [2024-09-11 15:49:20.097302] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74272][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=313532612608) [2024-09-11 15:49:20.097354] INFO register_pm (ob_page_manager.cpp:40) [74272][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5286552380, pm.get_tid()=74272, tenant_id=500) [2024-09-11 15:49:20.097365] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74272][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.097370] INFO [OCCAM] init_and_start (ob_occam_thread_pool.h:104) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] init thread success(this=0x7f529b4050d0, id=1, ret=0) [2024-09-11 15:49:20.097377] INFO [OCCAM] run1 (ob_occam_thread_pool.h:127) [74272][Occam][T0][Y0-0000000000000000-0-0] [lt=3] thread is running function [2024-09-11 15:49:20.097407] INFO [OCCAM] init (ob_occam_thread_pool.h:248) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] init occam thread pool success(ret=0, thread_num=1, queue_size_square_of_2=10, lbt()="0x2504ceab 0x834a216 0x8348ff3 0x8205485 0x1182828d 0xb1aa179 0xb8cf0b5 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e") [2024-09-11 15:49:20.097713] INFO [STORAGE.TRANS] init (ob_time_wheel.cpp:111) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] TimeWheelBase inited success(precision=5000000, start_ticket=345208192, scan_ticket=345208192) [2024-09-11 15:49:20.097721] INFO [STORAGE.TRANS] init (ob_time_wheel.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] ObTimeWheel init success(precision=5000000, real_thread_num=1) [2024-09-11 15:49:20.097850] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74273][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=317827579904) [2024-09-11 15:49:20.097911] INFO register_pm (ob_page_manager.cpp:40) [74273][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52865d0380, pm.get_tid()=74273, tenant_id=500) [2024-09-11 15:49:20.097923] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74273][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.097933] INFO [STORAGE.TRANS] start (ob_time_wheel.cpp:416) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimeWheel start success(timer_name="EventTimer") [2024-09-11 15:49:20.097942] INFO [OCCAM] init_and_start (ob_occam_timer.h:570) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] init ObOccamTimer success(ret=0) [2024-09-11 15:49:20.098452] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74274][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=322122547200) [2024-09-11 15:49:20.098512] INFO register_pm (ob_page_manager.cpp:40) [74274][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5286056380, pm.get_tid()=74274, tenant_id=500) [2024-09-11 15:49:20.098523] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74274][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.098530] INFO [COMMON] run1 (ob_dedup_queue.cpp:361) [74274][][T0][Y0-0000000000000000-0-0] [lt=3] dedup queue thread start(this=0x55ef0aa41380) [2024-09-11 15:49:20.098537] INFO [COMMON] init (ob_dedup_queue.cpp:111) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] init dedup-queue:(thread_num=1, queue_size=20480, task_map_size=20480, total_mem_limit=335544320, hold_mem_limit=167772160, page_size=7936, this=0x55ef0aa41380, lbt="0x2504ceab 0x13aba403 0x13ab98d1 0x11828252 0xb1aa19f 0xb8cf0b5 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e") [2024-09-11 15:49:20.098580] WDIAG [LIB] init (ob_tsc_timestamp.cpp:42) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13][errcode=-4007] invariant TSC not support(ret=-4007) [2024-09-11 15:49:20.099517] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74275][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=326417514496) [2024-09-11 15:49:20.099580] INFO register_pm (ob_page_manager.cpp:40) [74275][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f52860d4380, pm.get_tid()=74275, tenant_id=500) [2024-09-11 15:49:20.099592] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74275][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.099601] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74275][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.099720] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74276][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=330712481792) [2024-09-11 15:49:20.099786] INFO register_pm (ob_page_manager.cpp:40) [74276][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f5286152380, pm.get_tid()=74276, tenant_id=500) [2024-09-11 15:49:20.099799] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74276][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.099808] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74276][][T0][Y0-0000000000000000-0-0] [lt=4] UniqTaskQueue thread start [2024-09-11 15:49:20.099931] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74277][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=335007449088) [2024-09-11 15:49:20.099988] INFO register_pm (ob_page_manager.cpp:40) [74277][][T0][Y0-0000000000000000-0-0] [lt=11] register pm finish(ret=0, &pm=0x7f52861d0380, pm.get_tid()=74277, tenant_id=500) [2024-09-11 15:49:20.100000] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74277][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.100004] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74277][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.100134] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74278][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=339302416384) [2024-09-11 15:49:20.100196] INFO register_pm (ob_page_manager.cpp:40) [74278][][T0][Y0-0000000000000000-0-0] [lt=14] register pm finish(ret=0, &pm=0x7f5285856380, pm.get_tid()=74278, tenant_id=500) [2024-09-11 15:49:20.100208] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74278][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.100215] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74278][][T0][Y0-0000000000000000-0-0] [lt=2] UniqTaskQueue thread start [2024-09-11 15:49:20.100344] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74279][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=343597383680) [2024-09-11 15:49:20.100398] INFO register_pm (ob_page_manager.cpp:40) [74279][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52858d4380, pm.get_tid()=74279, tenant_id=500) [2024-09-11 15:49:20.100409] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74279][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.100415] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74279][][T0][Y0-0000000000000000-0-0] [lt=2] UniqTaskQueue thread start [2024-09-11 15:49:20.100533] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74280][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=347892350976) [2024-09-11 15:49:20.100584] INFO register_pm (ob_page_manager.cpp:40) [74280][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5285952380, pm.get_tid()=74280, tenant_id=500) [2024-09-11 15:49:20.100595] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74280][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.100601] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74280][][T0][Y0-0000000000000000-0-0] [lt=2] UniqTaskQueue thread start [2024-09-11 15:49:20.100715] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74281][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=352187318272) [2024-09-11 15:49:20.100767] INFO register_pm (ob_page_manager.cpp:40) [74281][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52859d0380, pm.get_tid()=74281, tenant_id=500) [2024-09-11 15:49:20.100777] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74281][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.100784] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74281][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.100785] INFO [SERVER] init (ob_tablet_table_updater.cpp:206) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] init a ObTabletTableUpdater success [2024-09-11 15:49:20.100942] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74282][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=356482285568) [2024-09-11 15:49:20.101002] INFO register_pm (ob_page_manager.cpp:40) [74282][][T0][Y0-0000000000000000-0-0] [lt=11] register pm finish(ret=0, &pm=0x7f5285656380, pm.get_tid()=74282, tenant_id=500) [2024-09-11 15:49:20.101015] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74282][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.101020] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74282][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.101150] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74283][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=360777252864) [2024-09-11 15:49:20.101209] INFO register_pm (ob_page_manager.cpp:40) [74283][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f52856d4380, pm.get_tid()=74283, tenant_id=500) [2024-09-11 15:49:20.101222] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74283][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.101227] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74283][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.101409] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74284][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=365072220160) [2024-09-11 15:49:20.101463] INFO register_pm (ob_page_manager.cpp:40) [74284][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5285752380, pm.get_tid()=74284, tenant_id=500) [2024-09-11 15:49:20.101476] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74284][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.101480] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74284][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.101602] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74285][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=369367187456) [2024-09-11 15:49:20.101655] INFO register_pm (ob_page_manager.cpp:40) [74285][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52857d0380, pm.get_tid()=74285, tenant_id=500) [2024-09-11 15:49:20.101823] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74285][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.101833] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74285][][T0][Y0-0000000000000000-0-0] [lt=6] UniqTaskQueue thread start [2024-09-11 15:49:20.101966] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74286][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=373662154752) [2024-09-11 15:49:20.102023] INFO register_pm (ob_page_manager.cpp:40) [74286][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f5285456380, pm.get_tid()=74286, tenant_id=500) [2024-09-11 15:49:20.102036] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74286][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.102043] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74286][][T0][Y0-0000000000000000-0-0] [lt=2] UniqTaskQueue thread start [2024-09-11 15:49:20.102159] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74287][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=377957122048) [2024-09-11 15:49:20.102213] INFO register_pm (ob_page_manager.cpp:40) [74287][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52854d4380, pm.get_tid()=74287, tenant_id=500) [2024-09-11 15:49:20.102225] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74287][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.102231] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74287][][T0][Y0-0000000000000000-0-0] [lt=2] UniqTaskQueue thread start [2024-09-11 15:49:20.102353] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74288][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=382252089344) [2024-09-11 15:49:20.102413] INFO register_pm (ob_page_manager.cpp:40) [74288][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5285552380, pm.get_tid()=74288, tenant_id=500) [2024-09-11 15:49:20.102426] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74288][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.102433] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74288][][T0][Y0-0000000000000000-0-0] [lt=2] UniqTaskQueue thread start [2024-09-11 15:49:20.102550] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74289][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=386547056640) [2024-09-11 15:49:20.102602] INFO register_pm (ob_page_manager.cpp:40) [74289][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52855d0380, pm.get_tid()=74289, tenant_id=500) [2024-09-11 15:49:20.102614] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74289][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.102618] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74289][][T0][Y0-0000000000000000-0-0] [lt=2] UniqTaskQueue thread start [2024-09-11 15:49:20.102741] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74290][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=390842023936) [2024-09-11 15:49:20.102794] INFO register_pm (ob_page_manager.cpp:40) [74290][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5285256380, pm.get_tid()=74290, tenant_id=500) [2024-09-11 15:49:20.102810] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74290][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.102816] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74290][][T0][Y0-0000000000000000-0-0] [lt=2] UniqTaskQueue thread start [2024-09-11 15:49:20.102820] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] create tg succeed(tg_id=292, tg=0x7f5298fb5cb0, thread_cnt=1, tg->attr_={name:SvrMetaCh, type:3}) [2024-09-11 15:49:20.102829] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] create tg succeed(tg_id=293, tg=0x7f5298fcdcb0, thread_cnt=1, tg->attr_={name:SvrMetaCh, type:3}) [2024-09-11 15:49:20.102838] INFO [SERVER] init (ob_service.cpp:261) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] [OBSERVICE_NOTICE] init ob_service finish(ret=0, ret="OB_SUCCESS", inited=true) [2024-09-11 15:49:20.102996] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74291][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=395136991232) [2024-09-11 15:49:20.103050] INFO register_pm (ob_page_manager.cpp:40) [74291][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52852d4380, pm.get_tid()=74291, tenant_id=500) [2024-09-11 15:49:20.103060] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74291][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.103112] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] ObTimer create success(this=0x55ef06a1a590, thread_id=74291, lbt()=0x2504ceab 0x13acfe20 0x1366d868 0x99793ab 0xb8cf11e 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.103232] INFO run1 (ob_timer.cpp:361) [74291][][T0][Y0-0000000000000000-0-0] [lt=3] timer thread started(this=0x55ef06a1a590, tid=74291, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.103376] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74292][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=399431958528) [2024-09-11 15:49:20.103430] INFO register_pm (ob_page_manager.cpp:40) [74292][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5285352380, pm.get_tid()=74292, tenant_id=500) [2024-09-11 15:49:20.103443] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74292][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.103450] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74292][][T0][Y0-0000000000000000-0-0] [lt=2] new reentrant thread created(idx=0) [2024-09-11 15:49:20.103571] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74293][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=403726925824) [2024-09-11 15:49:20.103623] INFO register_pm (ob_page_manager.cpp:40) [74293][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52853d0380, pm.get_tid()=74293, tenant_id=500) [2024-09-11 15:49:20.103634] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74293][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.103640] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74293][][T0][Y0-0000000000000000-0-0] [lt=2] new reentrant thread created(idx=1) [2024-09-11 15:49:20.103774] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74294][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=408021893120) [2024-09-11 15:49:20.103826] INFO register_pm (ob_page_manager.cpp:40) [74294][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5284e56380, pm.get_tid()=74294, tenant_id=500) [2024-09-11 15:49:20.103837] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74294][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.103841] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74294][][T0][Y0-0000000000000000-0-0] [lt=2] new reentrant thread created(idx=2) [2024-09-11 15:49:20.103967] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74295][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=412316860416) [2024-09-11 15:49:20.104019] INFO register_pm (ob_page_manager.cpp:40) [74295][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5284ed4380, pm.get_tid()=74295, tenant_id=500) [2024-09-11 15:49:20.104032] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74295][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.104036] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74295][][T0][Y0-0000000000000000-0-0] [lt=2] new reentrant thread created(idx=3) [2024-09-11 15:49:20.104160] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74296][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=416611827712) [2024-09-11 15:49:20.104218] INFO register_pm (ob_page_manager.cpp:40) [74296][][T0][Y0-0000000000000000-0-0] [lt=14] register pm finish(ret=0, &pm=0x7f5284f52380, pm.get_tid()=74296, tenant_id=500) [2024-09-11 15:49:20.104230] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74296][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.104250] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] ObTimer create success(this=0x55ef06a1b190, thread_id=74296, lbt()=0x2504ceab 0x13acfe20 0x1366d868 0x99793db 0xb8cf11e 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.104389] INFO run1 (ob_timer.cpp:361) [74296][][T0][Y0-0000000000000000-0-0] [lt=2] timer thread started(this=0x55ef06a1b190, tid=74296, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.104529] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74297][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=420906795008) [2024-09-11 15:49:20.104584] INFO register_pm (ob_page_manager.cpp:40) [74297][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f5284fd0380, pm.get_tid()=74297, tenant_id=500) [2024-09-11 15:49:20.104594] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74297][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.104601] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74297][][T0][Y0-0000000000000000-0-0] [lt=3] new reentrant thread created(idx=0) [2024-09-11 15:49:20.104734] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74298][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=425201762304) [2024-09-11 15:49:20.104785] INFO register_pm (ob_page_manager.cpp:40) [74298][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5284c56380, pm.get_tid()=74298, tenant_id=500) [2024-09-11 15:49:20.104796] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74298][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.104803] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74298][][T0][Y0-0000000000000000-0-0] [lt=2] new reentrant thread created(idx=0) [2024-09-11 15:49:20.106485] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74299][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=429496729600) [2024-09-11 15:49:20.106545] INFO register_pm (ob_page_manager.cpp:40) [74299][][T0][Y0-0000000000000000-0-0] [lt=11] register pm finish(ret=0, &pm=0x7f5284cd4380, pm.get_tid()=74299, tenant_id=500) [2024-09-11 15:49:20.106554] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74299][][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.106562] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74299][][T0][Y0-0000000000000000-0-0] [lt=3] new reentrant thread created(idx=0) [2024-09-11 15:49:20.106703] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74300][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=433791696896) [2024-09-11 15:49:20.106781] INFO register_pm (ob_page_manager.cpp:40) [74300][][T0][Y0-0000000000000000-0-0] [lt=16] register pm finish(ret=0, &pm=0x7f5284d52380, pm.get_tid()=74300, tenant_id=500) [2024-09-11 15:49:20.106796] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74300][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.106808] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74300][][T0][Y0-0000000000000000-0-0] [lt=5] new reentrant thread created(idx=0) [2024-09-11 15:49:20.106944] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74301][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=438086664192) [2024-09-11 15:49:20.107007] INFO register_pm (ob_page_manager.cpp:40) [74301][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f5284dd0380, pm.get_tid()=74301, tenant_id=500) [2024-09-11 15:49:20.107020] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74301][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.107025] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74301][][T0][Y0-0000000000000000-0-0] [lt=3] new reentrant thread created(idx=0) [2024-09-11 15:49:20.107159] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74302][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=442381631488) [2024-09-11 15:49:20.107215] INFO register_pm (ob_page_manager.cpp:40) [74302][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f5284456380, pm.get_tid()=74302, tenant_id=500) [2024-09-11 15:49:20.107226] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74302][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.107233] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74302][][T0][Y0-0000000000000000-0-0] [lt=3] new reentrant thread created(idx=0) [2024-09-11 15:49:20.107757] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74303][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=446676598784) [2024-09-11 15:49:20.107810] INFO register_pm (ob_page_manager.cpp:40) [74303][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52844d4380, pm.get_tid()=74303, tenant_id=500) [2024-09-11 15:49:20.107823] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74303][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.107831] INFO [COMMON] run1 (ob_dedup_queue.cpp:361) [74303][][T0][Y0-0000000000000000-0-0] [lt=2] dedup queue thread start(this=0x55ef0705ed00) [2024-09-11 15:49:20.107853] INFO [COMMON] init (ob_dedup_queue.cpp:111) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] init dedup-queue:(thread_num=1, queue_size=20480, task_map_size=20480, total_mem_limit=335544320, hold_mem_limit=167772160, page_size=7936, this=0x55ef0705ed00, lbt="0x2504ceab 0x13aba403 0x13ab98d1 0x11828252 0x9979d53 0xb8cf11e 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e") [2024-09-11 15:49:20.108144] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] create tg succeed(tg_id=294, tg=0x7f5298fc5d90, thread_cnt=8, tg->attr_={name:DDLTaskExecutor3, type:2}) [2024-09-11 15:49:20.108278] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74304][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=450971566080) [2024-09-11 15:49:20.108334] INFO register_pm (ob_page_manager.cpp:40) [74304][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f5284552380, pm.get_tid()=74304, tenant_id=500) [2024-09-11 15:49:20.108345] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74304][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.108356] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74304][][T0][Y0-0000000000000000-0-0] [lt=2] new reentrant thread created(idx=0) [2024-09-11 15:49:20.108532] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74305][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=455266533376) [2024-09-11 15:49:20.108585] INFO register_pm (ob_page_manager.cpp:40) [74305][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f52845d0380, pm.get_tid()=74305, tenant_id=500) [2024-09-11 15:49:20.108601] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74305][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.108632] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] ObTimer create success(this=0x55ef071d4e00, thread_id=74305, lbt()=0x2504ceab 0x13acfe20 0xacabd13 0x9979e11 0xb8cf11e 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.108802] INFO run1 (ob_timer.cpp:361) [74305][][T0][Y0-0000000000000000-0-0] [lt=3] timer thread started(this=0x55ef071d4e00, tid=74305, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.108812] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74306][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=459561500672) [2024-09-11 15:49:20.108879] INFO register_pm (ob_page_manager.cpp:40) [74306][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f5284256380, pm.get_tid()=74306, tenant_id=500) [2024-09-11 15:49:20.108892] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74306][][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.108911] INFO [COMMON] init (ob_simple_thread_pool.cpp:58) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] simple thread pool init success(name=unknown, thread_num=1, task_num_limit=1) [2024-09-11 15:49:20.109115] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74307][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=463856467968) [2024-09-11 15:49:20.109173] INFO register_pm (ob_page_manager.cpp:40) [74307][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f52842d4380, pm.get_tid()=74307, tenant_id=500) [2024-09-11 15:49:20.109184] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74307][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.109190] INFO [COMMON] init (ob_simple_thread_pool.cpp:58) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] simple thread pool init success(name=unknown, thread_num=1, task_num_limit=1) [2024-09-11 15:49:20.109386] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74308][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=468151435264) [2024-09-11 15:49:20.109440] INFO register_pm (ob_page_manager.cpp:40) [74308][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f5284352380, pm.get_tid()=74308, tenant_id=500) [2024-09-11 15:49:20.109451] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74308][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.109456] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74308][][T0][Y0-0000000000000000-0-0] [lt=3] new reentrant thread created(idx=0) [2024-09-11 15:49:20.109635] INFO [SERVER] init_sql (ob_server.cpp:2510) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] init sql [2024-09-11 15:49:20.114653] INFO [SERVER] init_sql (ob_server.cpp:2519) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] init sql session mgr done [2024-09-11 15:49:20.114668] INFO [SERVER] init_sql (ob_server.cpp:2520) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] init sql location cache done [2024-09-11 15:49:20.114925] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74309][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=472446402560) [2024-09-11 15:49:20.115017] INFO register_pm (ob_page_manager.cpp:40) [74309][][T0][Y0-0000000000000000-0-0] [lt=23] register pm finish(ret=0, &pm=0x7f52843d0380, pm.get_tid()=74309, tenant_id=500) [2024-09-11 15:49:20.115035] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74309][][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.115048] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74309][][T0][Y0-0000000000000000-0-0] [lt=5] new reentrant thread created(idx=0) [2024-09-11 15:49:20.115115] INFO [SERVER] init_sql (ob_server.cpp:2532) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] init sql engine done [2024-09-11 15:49:20.115124] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:210) [74309][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=7] async task queue start [2024-09-11 15:49:20.115129] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:227) [74309][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=1] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=0) [2024-09-11 15:49:20.117220] INFO [LIB] init (ob_libxml2_sax_handler.cpp:116) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] saxhandler init(xmlIsMainThread()=1) [2024-09-11 15:49:20.117233] INFO [SERVER] init_sql (ob_server.cpp:2552) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=12] init sql done [2024-09-11 15:49:20.117241] INFO [SERVER] init_sql_runner (ob_server.cpp:2568) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] init sql runner done [2024-09-11 15:49:20.117330] INFO [SERVER] init_sequence (ob_server.cpp:2581) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] init sequence engine done [2024-09-11 15:49:20.117337] INFO [SERVER] init_pl (ob_server.cpp:2590) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] init pl [2024-09-11 15:49:20.118695] INFO [PL] compile_module (ob_llvm_helper.cpp:628) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] ================Optimized LLVM Module================ [2024-09-11 15:49:20.118770] INFO [PL] dump_module (ob_llvm_helper.cpp:650) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] Dump LLVM Compile Module! (s.str().c_str()="; ModuleID = 'PL/SQL' source_filename = "PL/SQL" target datalayout = "e-m:e-p270:32:32-p271:32:32-p272:64:64-i64:64-f80:128-n8:16:32:64-S128" define i64 @pl_init_func(i64 %0) { entry: ret i64 0 } !llvm.module.flags = !{!0} !0 = !{i32 2, !"Debug Info Version", i32 3} ") [2024-09-11 15:49:20.124582] INFO [SERVER] init_pl (ob_server.cpp:2594) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] init pl engine done [2024-09-11 15:49:20.124968] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74310][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=476741369856) [2024-09-11 15:49:20.125095] INFO register_pm (ob_page_manager.cpp:40) [74310][][T0][Y0-0000000000000000-0-0] [lt=30] register pm finish(ret=0, &pm=0x7f5283256380, pm.get_tid()=74310, tenant_id=500) [2024-09-11 15:49:20.125119] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74310][][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.125140] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74310][][T0][Y0-0000000000000000-0-0] [lt=8] UniqTaskQueue thread start [2024-09-11 15:49:20.125301] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74311][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=481036337152) [2024-09-11 15:49:20.125384] INFO register_pm (ob_page_manager.cpp:40) [74311][][T0][Y0-0000000000000000-0-0] [lt=20] register pm finish(ret=0, &pm=0x7f52832d4380, pm.get_tid()=74311, tenant_id=500) [2024-09-11 15:49:20.125400] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74311][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.125412] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74311][][T0][Y0-0000000000000000-0-0] [lt=5] UniqTaskQueue thread start [2024-09-11 15:49:20.125599] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74312][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=485331304448) [2024-09-11 15:49:20.125660] INFO register_pm (ob_page_manager.cpp:40) [74312][][T0][Y0-0000000000000000-0-0] [lt=11] register pm finish(ret=0, &pm=0x7f5283352380, pm.get_tid()=74312, tenant_id=500) [2024-09-11 15:49:20.125673] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74312][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.125680] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74312][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.125802] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74313][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=489626271744) [2024-09-11 15:49:20.125857] INFO register_pm (ob_page_manager.cpp:40) [74313][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f52833d0380, pm.get_tid()=74313, tenant_id=500) [2024-09-11 15:49:20.125868] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74313][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.125874] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74313][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.126014] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74314][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=493921239040) [2024-09-11 15:49:20.126070] INFO register_pm (ob_page_manager.cpp:40) [74314][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f5283056380, pm.get_tid()=74314, tenant_id=500) [2024-09-11 15:49:20.126081] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74314][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.126087] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74314][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.126212] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74315][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=498216206336) [2024-09-11 15:49:20.126266] INFO register_pm (ob_page_manager.cpp:40) [74315][][T0][Y0-0000000000000000-0-0] [lt=8] register pm finish(ret=0, &pm=0x7f52830d4380, pm.get_tid()=74315, tenant_id=500) [2024-09-11 15:49:20.126277] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74315][][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.126282] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74315][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.126470] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74316][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=502511173632) [2024-09-11 15:49:20.126530] INFO register_pm (ob_page_manager.cpp:40) [74316][][T0][Y0-0000000000000000-0-0] [lt=11] register pm finish(ret=0, &pm=0x7f5283152380, pm.get_tid()=74316, tenant_id=500) [2024-09-11 15:49:20.126542] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74316][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.126549] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74316][][T0][Y0-0000000000000000-0-0] [lt=3] UniqTaskQueue thread start [2024-09-11 15:49:20.126690] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74317][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=506806140928) [2024-09-11 15:49:20.126780] INFO register_pm (ob_page_manager.cpp:40) [74317][][T0][Y0-0000000000000000-0-0] [lt=16] register pm finish(ret=0, &pm=0x7f52831d0380, pm.get_tid()=74317, tenant_id=500) [2024-09-11 15:49:20.126797] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74317][][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.126812] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74317][][T0][Y0-0000000000000000-0-0] [lt=6] UniqTaskQueue thread start [2024-09-11 15:49:20.126953] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74318][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=511101108224) [2024-09-11 15:49:20.127036] INFO register_pm (ob_page_manager.cpp:40) [74318][][T0][Y0-0000000000000000-0-0] [lt=15] register pm finish(ret=0, &pm=0x7f5282c56380, pm.get_tid()=74318, tenant_id=500) [2024-09-11 15:49:20.127052] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74318][][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.127102] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=21] ObTimer create success(this=0x55ef066fc920, thread_id=74318, lbt()=0x2504ceab 0x13acfe20 0x126e05ef 0x126e01ad 0xb8cf551 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.127249] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74319][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=515396075520) [2024-09-11 15:49:20.127307] INFO register_pm (ob_page_manager.cpp:40) [74319][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f5282cd4380, pm.get_tid()=74319, tenant_id=500) [2024-09-11 15:49:20.127313] INFO run1 (ob_timer.cpp:361) [74318][][T0][Y0-0000000000000000-0-0] [lt=5] timer thread started(this=0x55ef066fc920, tid=74318, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.127319] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74319][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.127345] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=12] ObTimer create success(this=0x55ef066fca20, thread_id=74319, lbt()=0x2504ceab 0x13acfe20 0x126e064c 0x126e01ad 0xb8cf551 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.127489] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74320][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=519691042816) [2024-09-11 15:49:20.127532] INFO run1 (ob_timer.cpp:361) [74319][][T0][Y0-0000000000000000-0-0] [lt=3] timer thread started(this=0x55ef066fca20, tid=74319, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.127582] INFO register_pm (ob_page_manager.cpp:40) [74320][][T0][Y0-0000000000000000-0-0] [lt=14] register pm finish(ret=0, &pm=0x7f5282d52380, pm.get_tid()=74320, tenant_id=500) [2024-09-11 15:49:20.127603] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74320][][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.127641] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ObTimer create success(this=0x55ef066fcb20, thread_id=74320, lbt()=0x2504ceab 0x13acfe20 0x126e06a9 0x126e01ad 0xb8cf551 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.127822] INFO run1 (ob_timer.cpp:361) [74320][][T0][Y0-0000000000000000-0-0] [lt=10] timer thread started(this=0x55ef066fcb20, tid=74320, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.129349] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74321][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=523986010112) [2024-09-11 15:49:20.129457] INFO register_pm (ob_page_manager.cpp:40) [74321][][T0][Y0-0000000000000000-0-0] [lt=21] register pm finish(ret=0, &pm=0x7f5282dd0380, pm.get_tid()=74321, tenant_id=500) [2024-09-11 15:49:20.129478] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74321][][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.129494] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74321][][T0][Y0-0000000000000000-0-0] [lt=7] UniqTaskQueue thread start [2024-09-11 15:49:20.129623] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74322][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=528280977408) [2024-09-11 15:49:20.129707] INFO register_pm (ob_page_manager.cpp:40) [74322][][T0][Y0-0000000000000000-0-0] [lt=15] register pm finish(ret=0, &pm=0x7f5282656380, pm.get_tid()=74322, tenant_id=500) [2024-09-11 15:49:20.129722] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74322][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.129736] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74322][][T0][Y0-0000000000000000-0-0] [lt=6] UniqTaskQueue thread start [2024-09-11 15:49:20.129863] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74323][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=532575944704) [2024-09-11 15:49:20.129949] INFO register_pm (ob_page_manager.cpp:40) [74323][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f52826d4380, pm.get_tid()=74323, tenant_id=500) [2024-09-11 15:49:20.129964] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74323][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.129976] INFO [SHARE] run1 (ob_reentrant_thread.cpp:153) [74323][][T0][Y0-0000000000000000-0-0] [lt=6] new reentrant thread created(idx=0) [2024-09-11 15:49:20.130001] INFO [SHARE.LOCATION] init (ob_tablet_location_refresh_service.cpp:300) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] [REFRESH_TABLET_LOCATION] init service(ret=0, ret="OB_SUCCESS") [2024-09-11 15:49:20.130936] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74324][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=536870912000) [2024-09-11 15:49:20.131015] INFO register_pm (ob_page_manager.cpp:40) [74324][][T0][Y0-0000000000000000-0-0] [lt=13] register pm finish(ret=0, &pm=0x7f5282752380, pm.get_tid()=74324, tenant_id=500) [2024-09-11 15:49:20.131033] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74324][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.131048] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74324][][T0][Y0-0000000000000000-0-0] [lt=6] UniqTaskQueue thread start [2024-09-11 15:49:20.131973] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74325][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=541165879296) [2024-09-11 15:49:20.132060] INFO register_pm (ob_page_manager.cpp:40) [74325][][T0][Y0-0000000000000000-0-0] [lt=15] register pm finish(ret=0, &pm=0x7f52827d0380, pm.get_tid()=74325, tenant_id=500) [2024-09-11 15:49:20.132075] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74325][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.132084] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74325][][T0][Y0-0000000000000000-0-0] [lt=6] UniqTaskQueue thread start [2024-09-11 15:49:20.132086] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] Succ to register cache(cache_name="vtable_cache", priority=1000, cache_id=3) [2024-09-11 15:49:20.132232] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74326][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=545460846592) [2024-09-11 15:49:20.132307] INFO register_pm (ob_page_manager.cpp:40) [74326][][T0][Y0-0000000000000000-0-0] [lt=11] register pm finish(ret=0, &pm=0x7f5282056380, pm.get_tid()=74326, tenant_id=500) [2024-09-11 15:49:20.132322] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74326][][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.132333] INFO [SERVER] run1 (ob_uniq_task_queue.h:339) [74326][][T0][Y0-0000000000000000-0-0] [lt=4] UniqTaskQueue thread start [2024-09-11 15:49:20.132549] INFO [SHARE] init (ob_gais_rpc.cpp:200) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] gais request rpc inited success(this=0x55ef0aea4630, self="10.31.35.7:2882") [2024-09-11 15:49:20.132564] INFO [SHARE] init (ob_gais_client.cpp:48) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] gais client init success(self="10.31.35.7:2882", this=0x55ef0aea4000) [2024-09-11 15:49:20.132569] INFO [LIB] ObSliceAlloc (ob_slice_alloc.h:321) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObSliceAlloc init finished(bsize_=7936, isize_=576, slice_limit_=7536, tmallocator_=NULL) [2024-09-11 15:49:20.132578] INFO [LIB] ObSliceAlloc (ob_slice_alloc.h:321) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] ObSliceAlloc init finished(bsize_=7936, isize_=64, slice_limit_=7536, tmallocator_=NULL) [2024-09-11 15:49:20.133548] INFO [LIB] ObSliceAlloc (ob_slice_alloc.h:321) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] ObSliceAlloc init finished(bsize_=7936, isize_=384, slice_limit_=7536, tmallocator_=NULL) [2024-09-11 15:49:20.133643] WDIAG [SERVER] get_network_speed_from_config_file (ob_server.cpp:2894) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9][errcode=-4027] NIC Config file doesn't exist, auto detecting(nic_rate_path="etc/nic.rate.config", ret=-4027, ret="OB_FILE_NOT_EXIST") [2024-09-11 15:49:20.133721] INFO [COMMON] init (utility.cpp:1342) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] init bandwidth(rate_=3932160000, comment_=in) [2024-09-11 15:49:20.133730] INFO [COMMON] init (utility.cpp:1342) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] init bandwidth(rate_=3932160000, comment_=out) [2024-09-11 15:49:20.133733] INFO [SERVER] init_bandwidth_throttle (ob_server.cpp:2974) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] succeed to init_bandwidth_throttle(sys_bkgd_net_percentage_=60, network_speed=6553600000, rate=3932160000) [2024-09-11 15:49:20.133882] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74327][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=549755813888) [2024-09-11 15:49:20.133954] INFO register_pm (ob_page_manager.cpp:40) [74327][][T0][Y0-0000000000000000-0-0] [lt=10] register pm finish(ret=0, &pm=0x7f52820d4380, pm.get_tid()=74327, tenant_id=500) [2024-09-11 15:49:20.133967] WDIAG [STORAGE.TRANS] getClock (ob_clock_generator.h:70) [74327][][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] REACH SYSLOG RATE LIMIT [bandwidth] [2024-09-11 15:49:20.133978] INFO [STORAGE.TRANS] init (ob_clock_generator.cpp:56) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] clock generator inited success [2024-09-11 15:49:20.134014] INFO [SERVER] init_storage (ob_server.cpp:2729) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] clog dir is empty [2024-09-11 15:49:20.134040] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] Succ to register cache(cache_name="index_block_cache", priority=10, cache_id=4) [2024-09-11 15:49:20.134049] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] Succ to register cache(cache_name="user_block_cache", priority=1, cache_id=5) [2024-09-11 15:49:20.134056] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Succ to register cache(cache_name="user_row_cache", priority=1, cache_id=6) [2024-09-11 15:49:20.134066] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] Succ to register cache(cache_name="bf_cache", priority=1, cache_id=7) [2024-09-11 15:49:20.150206] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] Succ to register cache(cache_name="fuse_row_cache", priority=1, cache_id=8) [2024-09-11 15:49:20.150237] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=21] Succ to register cache(cache_name="storage_meta_cache", priority=10, cache_id=9) [2024-09-11 15:49:20.150314] INFO [STORAGE] init (ob_resource_map.h:265) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] init resource map success(ret=0, attr=tenant_id=500, label=TmpFileManager, ctx_id=0, prio=0, bkt_num=12289) [2024-09-11 15:49:20.150331] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] Succ to register cache(cache_name="tmp_page_cache", priority=1, cache_id=10) [2024-09-11 15:49:20.150337] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] Succ to register cache(cache_name="tmp_block_cache", priority=1, cache_id=11) [2024-09-11 15:49:20.150549] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74328][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=554050781184) [2024-09-11 15:49:20.150653] INFO register_pm (ob_page_manager.cpp:40) [74328][][T0][Y0-0000000000000000-0-0] [lt=25] register pm finish(ret=0, &pm=0x7f5282152380, pm.get_tid()=74328, tenant_id=500) [2024-09-11 15:49:20.150741] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] ObTimer create success(this=0x55ef0788ffb0, thread_id=74328, lbt()=0x2504ceab 0x13acfe20 0x1071dd50 0xb8cf98d 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.150847] INFO run1 (ob_timer.cpp:361) [74328][][T0][Y0-0000000000000000-0-0] [lt=15] timer thread started(this=0x55ef0788ffb0, tid=74328, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.150863] INFO [STORAGE] init (ob_disk_usage_reporter.cpp:60) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] ObDistUsageReportTask init successful(ret=0) [2024-09-11 15:49:20.150872] INFO init_storage (ob_server.cpp:2772) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] start tg(lib::TGDefIDs::DiskUseReport=56, tg_name=DiskUseReport) [2024-09-11 15:49:20.151028] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74329][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=558345748480) [2024-09-11 15:49:20.151109] INFO register_pm (ob_page_manager.cpp:40) [74329][][T0][Y0-0000000000000000-0-0] [lt=16] register pm finish(ret=0, &pm=0x7f52821d0380, pm.get_tid()=74329, tenant_id=500) [2024-09-11 15:49:20.151157] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimer create success(this=0x7f529d273e60, thread_id=74329, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0xb8cfa47 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.151319] INFO run1 (ob_timer.cpp:361) [74329][][T0][Y0-0000000000000000-0-0] [lt=12] timer thread started(this=0x7f529d273e60, tid=74329, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.152070] INFO [STORAGE] init (ob_ddl_redo_log_writer.cpp:371) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] succeed to init ObDDLCtrlSpeedHandle(ret=0) [2024-09-11 15:49:20.152080] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] Succ to register cache(cache_name="tx_data_kv_cache", priority=2, cache_id=12) [2024-09-11 15:49:20.152273] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74330][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=562640715776) [2024-09-11 15:49:20.152340] INFO register_pm (ob_page_manager.cpp:40) [74330][][T0][Y0-0000000000000000-0-0] [lt=14] register pm finish(ret=0, &pm=0x7f527f856380, pm.get_tid()=74330, tenant_id=500) [2024-09-11 15:49:20.152364] INFO [COMMON] run1 (ob_dedup_queue.cpp:361) [74330][][T0][Y0-0000000000000000-0-0] [lt=18] dedup queue thread start(this=0x55ef06a26a40) [2024-09-11 15:49:20.152395] INFO [COMMON] init (ob_dedup_queue.cpp:111) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] init dedup-queue:(thread_num=1, queue_size=5, task_map_size=5, total_mem_limit=1073741824, hold_mem_limit=536870912, page_size=65408, this=0x55ef06a26a40, lbt="0x2504ceab 0x13aba403 0x13ab98d1 0x10b5e88a 0xb8cfb68 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e") [2024-09-11 15:49:20.152407] INFO init (ob_locality_manager.cpp:85) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] start tg(lib::TGDefIDs::LocalityReload=54, tg_name=LocalityReload) [2024-09-11 15:49:20.152545] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74331][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=566935683072) [2024-09-11 15:49:20.152601] INFO register_pm (ob_page_manager.cpp:40) [74331][][T0][Y0-0000000000000000-0-0] [lt=9] register pm finish(ret=0, &pm=0x7f527f8d4380, pm.get_tid()=74331, tenant_id=500) [2024-09-11 15:49:20.152621] INFO create (ob_timer.cpp:72) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimer create success(this=0x7f529d26fe60, thread_id=74331, lbt()=0x2504ceab 0x13acfe20 0x1148f902 0x10b5e99d 0xb8cfb68 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e) [2024-09-11 15:49:20.152757] INFO [STORAGE.TRANS] init (ob_location_adapter.cpp:46) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ob location cache adapter inited success [2024-09-11 15:49:20.152771] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:265) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] trans factory statistics(object_name="ObGtsRpcProxy", label="ObModIds::OB_GTS_RPC_PROXY", alloc_count=0, release_count=0, used=0) [2024-09-11 15:49:20.152775] INFO run1 (ob_timer.cpp:361) [74331][][T0][Y0-0000000000000000-0-0] [lt=10] timer thread started(this=0x7f529d26fe60, tid=74331, lbt()=0x2504ceab 0x24d8c127 0x13675d61 0x136716bf 0x7f529dcb71ca 0x7f529d922e73) [2024-09-11 15:49:20.152779] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:266) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] trans factory statistics(object_name="ObGtsRequestRpc", label="ObModIds::OB_GTS_REQUEST_RPC", alloc_count=0, release_count=0, used=0) [2024-09-11 15:49:20.152826] INFO create_tg (thread_mgr.h:1003) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] create tg succeed(tg_id=295, tg=0x7f52829fdc30, thread_cnt=1, tg->attr_={name:TSWorker, type:4}) [2024-09-11 15:49:20.153076] INFO [SHARE] get_next_sess_id (ob_active_session_guard.cpp:336) [74332][][T0][Y0-0000000000000000-0-0] [lt=0] succ to generate background session id(sessid=571230650368) [2024-09-11 15:49:20.153134] INFO register_pm (ob_page_manager.cpp:40) [74332][][T0][Y0-0000000000000000-0-0] [lt=12] register pm finish(ret=0, &pm=0x7f527f952380, pm.get_tid()=74332, tenant_id=500) [2024-09-11 15:49:20.153148] INFO [COMMON] init (ob_simple_thread_pool.cpp:58) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] simple thread pool init success(name=TSWorker, thread_num=1, task_num_limit=10240) [2024-09-11 15:49:20.153153] INFO init (ob_ts_worker.cpp:40) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] start tg(tg_id_=295, tg_name=TSWorker) [2024-09-11 15:49:20.153156] INFO [STORAGE.TRANS] init (ob_ts_worker.cpp:43) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] ts worker thread pool init success [2024-09-11 15:49:20.153159] INFO [STORAGE.TRANS] init (ob_ts_worker.cpp:52) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] ts worker init success(this=0x55ef076a60a8, ts_mgr=0x55ef076a5d00, use_local_worker=true) [2024-09-11 15:49:20.153163] INFO [STORAGE.TRANS] init (ob_gts_rpc.cpp:138) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] gts request rpc inited success(this=0x7f52829fd5c0, self="10.31.35.7:2882", ts_mgr=0x55ef076a5d00) [2024-09-11 15:49:20.153961] INFO [STORAGE.TRANS] init (ob_ts_mgr.cpp:359) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTsMgr inited success(this=0x55ef076a5d00, server="10.31.35.7:2882") [2024-09-11 15:49:20.153972] INFO [SERVER] init_ts_mgr (ob_server.cpp:2694) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] gts cache mgr init success [2024-09-11 15:49:20.153982] INFO [STORAGE.TRANS] init (ob_weak_read_service.cpp:47) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] [WRS] weak read service init succ [2024-09-11 15:49:20.153990] INFO [STORAGE.TRANS] init (ob_black_list.cpp:41) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] BLService init success(*this={is_inited:true, is_running:false}) [2024-09-11 15:49:20.154088] INFO [COMMON] init (ob_kv_storecache.h:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] Succ to register cache(cache_name="external_table_file_cache", priority=1, cache_id=13) [2024-09-11 15:49:20.158490] WDIAG [STORAGE.REDO] check_log_disk (ob_storage_logger_manager.cpp:321) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11][errcode=-4009] fail to get slog directory vfs(ret=-4009, log_dir="/data/oceanbase/slog") [2024-09-11 15:49:20.158503] WDIAG [STORAGE.REDO] init (ob_storage_logger_manager.cpp:69) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13][errcode=-4009] fail to set need reserved(ret=-4009) [2024-09-11 15:49:20.158754] ERROR [LIB] issue_dba_error (ob_log.cpp:1987) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4][errcode=-4388] Unexpected internal error happen, please checkout the internal errcode(errcode=-4009, file="ob_server.cpp", line_no=429, info="init ObStorageLoggerManager failed") [2024-09-11 15:49:20.158766] EDIAG [SERVER] init (ob_server.cpp:429) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=12][errcode=-4009] init ObStorageLoggerManager failed(ret=-4009, ret="OB_IO_ERROR") BACKTRACE:0x2504ceab 0x256e705c 0x24e1f0ea 0x24e1bcd2 0x24e1bc12 0x24e1ba77 0xb8dd03c 0xb8d1c7d 0x7fe4b0e 0x7f529d923d85 0x5e8fa4e [2024-09-11 15:49:20.158836] INFO [SERVER] set_stop (ob_service.cpp:322) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=66] [OBSERVICE_NOTICE] observice need stop now [2024-09-11 15:49:20.158842] INFO [SERVER] set_stop (ob_server.cpp:1233) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [OBSERVER_NOTICE] observer is setted to stop [2024-09-11 15:49:20.158848] INFO [SERVER] destroy (ob_server.cpp:561) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] [OBSERVER_NOTICE] destroy observer begin [2024-09-11 15:49:20.158850] INFO [SERVER] destroy (ob_server.cpp:563) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] begin to destroy config manager [2024-09-11 15:49:20.158853] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] destroy tg(tg_id=119, tg=0x7f529d2fb2c0, tg->attr_={name:ConfigMgr, type:3}) [2024-09-11 15:49:20.158864] INFO stop (ob_timer.cpp:99) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] ObTimer stop success(this=0x7f529d2fb2e0, thread_id=74206) [2024-09-11 15:49:20.158872] INFO cancel_all (ob_timer.cpp:353) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] cancel all(ret=0, this=0x7f529d2fb2e0, thread_id=74206, wakeup_time_=0, tasks_num_=0) [2024-09-11 15:49:20.158887] INFO run1 (ob_timer.cpp:477) [74206][ConfigMgr][T0][Y0-0000000000000000-0-0] [lt=4] timer thread exit(this=0x7f529d2fb2e0, thread_id=74206) [2024-09-11 15:49:20.158920] INFO unregister_pm (ob_page_manager.cpp:50) [74206][ConfigMgr][T0][Y0-0000000000000000-0-0] [lt=11] unregister pm finish(&pm=0x7f529b0d4380, pm.get_tid()=74206) [2024-09-11 15:49:20.159046] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] ObTimer destroy(this=0x7f529d2fb2e0, thread_id=74206) [2024-09-11 15:49:20.159057] INFO [SERVER] destroy (ob_server.cpp:565) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] destroy config manager success [2024-09-11 15:49:20.159060] INFO [SERVER] destroy (ob_server.cpp:573) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] begin to destroy OB_LOGGER [2024-09-11 15:49:20.204065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=0][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:20.204108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:20.204117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:20.204127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:20.255188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=1] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:20.404336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:20.404375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:20.404381] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:20.404389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:20.455300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:20.604610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:20.604648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:20.604654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:20.604662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:20.655405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:20.677625] WDIAG [SHARE] refresh (ob_task_define.cpp:402) [74209][LogLimiterRefre][T0][Y0-0000000000000000-0-0] [lt=4][errcode=0] Throttled WDIAG logs in last second(details {error code, dropped logs, earliest tid}=[{errcode:-4006, dropped:199997, tid:74210}]) [2024-09-11 15:49:20.678407] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:20.804883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:20.804956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:20.804982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:20.804991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:20.855522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:21.005196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:21.005239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:21.005246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:21.005253] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:21.055641] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:21.087685] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726040961087681, bytes: 0, bw: 0.000000 MB/s, add_ts: 1006979, add_bytes: 0 [2024-09-11 15:49:21.089484] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=4] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:21.094462] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726040961094459, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007070, add_bytes: 0 [2024-09-11 15:49:21.205460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:21.205503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:21.205509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:21.205517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:21.255778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:21.405745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:21.405786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:21.405813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:21.405822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:21.455890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:21.606085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:21.606143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:21.606150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:21.606159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:21.656001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:21.679300] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:21.806392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:21.806435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:21.806441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:21.806450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:21.813759] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7296, clean_start_pos=0, clean_num=200000) [2024-09-11 15:49:21.856110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:22.014075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:22.014113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:22.014120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:22.014129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:22.056226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:22.089564] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=12] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:22.095308] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726040962095304, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:49:22.102073] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726040962102071, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:49:22.214367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:22.214409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:22.214429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:22.214439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:22.260715] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4370, replace_start_pos=100000, replace_num=100000) [2024-09-11 15:49:22.260752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:22.414664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:22.414710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:22.414718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:22.414728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:22.460831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:22.614972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:22.615013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:22.615021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:22.615030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:22.660939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:22.680047] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:22.815257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:22.815303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:22.815311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:22.815321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:22.861053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:23.015570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:23.015614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:23.015622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:23.015631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:23.061168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:23.089674] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:23.102914] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726040963102912, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:49:23.109685] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726040963109683, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:49:23.215854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:23.215894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:23.215925] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:23.215936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:23.261256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:23.416157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:23.416200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:23.416208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:23.416217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:23.461349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:23.616460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:23.616520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:23.616528] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:23.616537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:23.661463] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:23.682135] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:23.816836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:23.816883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:23.816891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:23.816922] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:23.823856] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6916, clean_start_pos=200000, clean_num=200000) [2024-09-11 15:49:23.861562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:24.024108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:24.024147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:24.024154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:24.024163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:24.061756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:24.089807] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=30] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:24.110539] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726040964110535, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:49:24.117295] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726040964117293, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:49:24.224392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:24.224430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:24.224452] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:24.224461] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:24.261877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:24.424688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:24.424739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:24.424747] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:24.424756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:24.466471] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4407, replace_start_pos=200000, replace_num=100000) [2024-09-11 15:49:24.466516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:24.625004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:24.625083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:24.625097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:24.625106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51867822899, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:24.659695] INFO unregister_pm (ob_page_manager.cpp:50) [74207][OB_PLOG][T0][Y0-0000000000000000-0-0] [lt=3] unregister pm finish(&pm=0x7f529b152380, pm.get_tid()=74207) [2024-09-11 15:49:24.659814] INFO ob_pthread_join (ob_pthread.cpp:48) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=2] ob_pthread_join succeed(thread=0x7f529d331750) [2024-09-11 15:49:24.659879] INFO [SERVER] destroy (ob_server.cpp:575) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=30] OB_LOGGER destroyed [2024-09-11 15:49:24.659887] INFO [SERVER] destroy (ob_server.cpp:577) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] begin to destroy OB_LOG_COMPRESSOR [2024-09-11 15:49:24.659962] INFO [LIB] run1 (ob_log_compressor.cpp:197) [74208][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=6] syslog compress thread finish [2024-09-11 15:49:24.660014] INFO unregister_pm (ob_page_manager.cpp:50) [74208][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=46] unregister pm finish(&pm=0x7f529b1d0380, pm.get_tid()=74208) [2024-09-11 15:49:24.660106] INFO [LIB] destroy (ob_log_compressor.cpp:108) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] syslog compressor destroyed [2024-09-11 15:49:24.660114] INFO [SERVER] destroy (ob_server.cpp:579) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] OB_LOG_COMPRESSOR destroyed [2024-09-11 15:49:24.660119] INFO [SERVER] destroy (ob_server.cpp:581) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin to destroy task controller [2024-09-11 15:49:24.666599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:24.682818] INFO unregister_pm (ob_page_manager.cpp:50) [74209][LogLimiterRefre][T0][Y0-0000000000000000-0-0] [lt=50] unregister pm finish(&pm=0x7f5297e56380, pm.get_tid()=74209) [2024-09-11 15:49:24.682947] INFO [SERVER] destroy (ob_server.cpp:583) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] task controller destroyed [2024-09-11 15:49:24.682976] INFO [SERVER] destroy (ob_server.cpp:585) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=28] begin destroy signal worker [2024-09-11 15:49:24.682983] INFO [SERVER] destroy (ob_server.cpp:587) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] signal worker destroyed [2024-09-11 15:49:24.682989] INFO [SERVER] destroy (ob_server.cpp:589) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin destroy signal handle [2024-09-11 15:49:24.682994] INFO [SERVER] destroy (ob_server.cpp:591) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] signal handle destroyed [2024-09-11 15:49:24.682999] INFO [SERVER] destroy (ob_server.cpp:593) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] opt stat manager destroyed [2024-09-11 15:49:24.683019] INFO [SERVER] destroy (ob_server.cpp:595) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] opt stat manager destroyed [2024-09-11 15:49:24.683023] INFO [SERVER] destroy (ob_server.cpp:597) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy active session history task [2024-09-11 15:49:24.683038] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] destroy tg(tg_id=102, tg=0x7f529d2b1b10, tg->attr_={name:ActiveSessHist, type:3}) [2024-09-11 15:49:24.683051] INFO [SERVER] destroy (ob_server.cpp:599) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] active session history task destroyed [2024-09-11 15:49:24.683056] INFO [SERVER] destroy (ob_server.cpp:601) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin to destroy timer monitor [2024-09-11 15:49:24.683061] INFO [SERVER] destroy (ob_server.cpp:603) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] timer monitor destroyed [2024-09-11 15:49:24.683065] INFO [SERVER] destroy (ob_server.cpp:605) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin to destroy background thread monitor [2024-09-11 15:49:24.683071] INFO [SHARE] destroy (ob_bg_thread_monitor.cpp:265) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObBGThreadMonitor destroy [2024-09-11 15:49:24.683076] INFO [SHARE] stop (ob_bg_thread_monitor.cpp:259) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObBGThreadMonitor stop [2024-09-11 15:49:24.683081] INFO [SHARE] wait (ob_bg_thread_monitor.cpp:253) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObBGThreadMonitor wait [2024-09-11 15:49:24.683086] INFO [SERVER] destroy (ob_server.cpp:607) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] background thread monitor destroyed [2024-09-11 15:49:24.683090] INFO [SERVER] destroy (ob_server.cpp:609) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy thread hung detector [2024-09-11 15:49:24.683219] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:24.683257] INFO [SERVER] destroy (ob_server.cpp:611) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] thread hung detector destroyed [2024-09-11 15:49:24.683270] INFO [SERVER] destroy (ob_server.cpp:613) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13] begin to destroy table store stat mgr [2024-09-11 15:49:24.709449] INFO [SERVER] destroy (ob_server.cpp:615) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] table store stat mgr destroyed [2024-09-11 15:49:24.709479] INFO [SERVER] destroy (ob_server.cpp:623) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=30] begin to destroy unix domain listener [2024-09-11 15:49:24.709484] INFO [SERVER] destroy (ob_server.cpp:625) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] unix domain listener destroyed [2024-09-11 15:49:24.709487] INFO [SERVER] destroy (ob_server.cpp:627) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] begin to destroy table service [2024-09-11 15:49:24.709491] INFO [SERVER] destroy (ob_server.cpp:629) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] table service destroyed [2024-09-11 15:49:24.709502] INFO [SERVER] destroy (ob_server.cpp:631) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] begin to destroy batch rpc [2024-09-11 15:49:24.709506] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] destroy tg(tg_id=25, tg=0x7f529d2917b0, tg->attr_={name:BRPC, type:2}) [2024-09-11 15:49:24.709773] INFO unregister_pm (ob_page_manager.cpp:50) [74259][BRPC2][T0][Y0-0000000000000000-0-0] [lt=4] unregister pm finish(&pm=0x7f52876d4380, pm.get_tid()=74259) [2024-09-11 15:49:24.710012] INFO unregister_pm (ob_page_manager.cpp:50) [74260][BRPC3][T0][Y0-0000000000000000-0-0] [lt=3] unregister pm finish(&pm=0x7f5287752380, pm.get_tid()=74260) [2024-09-11 15:49:24.710043] INFO unregister_pm (ob_page_manager.cpp:50) [74264][BRPC7][T0][Y0-0000000000000000-0-0] [lt=4] unregister pm finish(&pm=0x7f5287552380, pm.get_tid()=74264) [2024-09-11 15:49:24.710146] INFO unregister_pm (ob_page_manager.cpp:50) [74261][BRPC4][T0][Y0-0000000000000000-0-0] [lt=3] unregister pm finish(&pm=0x7f52877d0380, pm.get_tid()=74261) [2024-09-11 15:49:24.710523] INFO unregister_pm (ob_page_manager.cpp:50) [74257][BRPC0][T0][Y0-0000000000000000-0-0] [lt=8] unregister pm finish(&pm=0x7f52881d0380, pm.get_tid()=74257) [2024-09-11 15:49:24.711371] INFO unregister_pm (ob_page_manager.cpp:50) [74262][BRPC5][T0][Y0-0000000000000000-0-0] [lt=3] unregister pm finish(&pm=0x7f5287456380, pm.get_tid()=74262) [2024-09-11 15:49:24.711507] INFO unregister_pm (ob_page_manager.cpp:50) [74258][BRPC1][T0][Y0-0000000000000000-0-0] [lt=4] unregister pm finish(&pm=0x7f5287656380, pm.get_tid()=74258) [2024-09-11 15:49:24.713652] INFO unregister_pm (ob_page_manager.cpp:50) [74263][BRPC6][T0][Y0-0000000000000000-0-0] [lt=3] unregister pm finish(&pm=0x7f52874d4380, pm.get_tid()=74263) [2024-09-11 15:49:24.713722] INFO [SERVER] destroy (ob_server.cpp:633) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] batch rpc destroyed [2024-09-11 15:49:24.713735] INFO [SERVER] destroy (ob_server.cpp:635) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=12] begin to destroy schema service [2024-09-11 15:49:24.713767] INFO unregister_pm (ob_page_manager.cpp:50) [74235][DDLTransCtr][T0][Y0-0000000000000000-0-0] [lt=5] unregister pm finish(&pm=0x7f528a6d4380, pm.get_tid()=74235) [2024-09-11 15:49:24.713831] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Success to deregister cache, (cache_id=2) [2024-09-11 15:49:24.713838] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] Success to deregister cache, (cache_id=0) [2024-09-11 15:49:24.713856] INFO [SERVER] destroy (ob_server.cpp:637) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] schema service destroyed [2024-09-11 15:49:24.713859] INFO [SERVER] destroy (ob_server.cpp:639) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] begin to destroy table auto increment service [2024-09-11 15:49:24.714009] INFO [SERVER] destroy (ob_server.cpp:641) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] table auto increment service destroyed [2024-09-11 15:49:24.714015] INFO [SERVER] destroy (ob_server.cpp:643) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] begin to destroy server gtimer [2024-09-11 15:49:24.714019] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] destroy tg(tg_id=37, tg=0x7f529d2ad0a0, tg->attr_={name:ServerGTimer, type:3}) [2024-09-11 15:49:24.714028] INFO stop (ob_timer.cpp:99) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ObTimer stop success(this=0x7f529d2ad0c0, thread_id=74201) [2024-09-11 15:49:24.714040] INFO cancel_all (ob_timer.cpp:353) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] cancel all(ret=0, this=0x7f529d2ad0c0, thread_id=74201, wakeup_time_=101622753671, tasks_num_=0) [2024-09-11 15:49:24.714072] INFO run1 (ob_timer.cpp:477) [74201][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=5] timer thread exit(this=0x7f529d2ad0c0, thread_id=74201) [2024-09-11 15:49:24.714093] INFO unregister_pm (ob_page_manager.cpp:50) [74201][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=17] unregister pm finish(&pm=0x7f529b256380, pm.get_tid()=74201) [2024-09-11 15:49:24.714164] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimer destroy(this=0x7f529d2ad0c0, thread_id=74201) [2024-09-11 15:49:24.714179] INFO [SERVER] destroy (ob_server.cpp:645) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] server gtimer destroyed [2024-09-11 15:49:24.714183] INFO [SERVER] destroy (ob_server.cpp:647) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy freeze timer [2024-09-11 15:49:24.714187] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] destroy tg(tg_id=38, tg=0x7f529d2ad210, tg->attr_={name:FreezeTimer, type:3}) [2024-09-11 15:49:24.714193] INFO stop (ob_timer.cpp:99) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimer stop success(this=0x7f529d2ad230, thread_id=74202) [2024-09-11 15:49:24.714201] INFO cancel_all (ob_timer.cpp:353) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] cancel all(ret=0, this=0x7f529d2ad230, thread_id=74202, wakeup_time_=0, tasks_num_=0) [2024-09-11 15:49:24.714212] INFO run1 (ob_timer.cpp:477) [74202][FreezeTimer][T0][Y0-0000000000000000-0-0] [lt=4] timer thread exit(this=0x7f529d2ad230, thread_id=74202) [2024-09-11 15:49:24.714228] INFO unregister_pm (ob_page_manager.cpp:50) [74202][FreezeTimer][T0][Y0-0000000000000000-0-0] [lt=13] unregister pm finish(&pm=0x7f529b2d4380, pm.get_tid()=74202) [2024-09-11 15:49:24.714297] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimer destroy(this=0x7f529d2ad230, thread_id=74202) [2024-09-11 15:49:24.714304] INFO [SERVER] destroy (ob_server.cpp:649) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] freeze timer destroyed [2024-09-11 15:49:24.714308] INFO [SERVER] destroy (ob_server.cpp:651) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] begin to destroy sql memory manager timer [2024-09-11 15:49:24.714311] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] destroy tg(tg_id=39, tg=0x7f529d2ad380, tg->attr_={name:SqlMemTimer, type:3}) [2024-09-11 15:49:24.714316] INFO stop (ob_timer.cpp:99) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer stop success(this=0x7f529d2ad3a0, thread_id=74203) [2024-09-11 15:49:24.714324] INFO cancel_all (ob_timer.cpp:353) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] cancel all(ret=0, this=0x7f529d2ad3a0, thread_id=74203, wakeup_time_=0, tasks_num_=0) [2024-09-11 15:49:24.714333] INFO run1 (ob_timer.cpp:477) [74203][SqlMemTimer][T0][Y0-0000000000000000-0-0] [lt=8] timer thread exit(this=0x7f529d2ad3a0, thread_id=74203) [2024-09-11 15:49:24.714349] INFO unregister_pm (ob_page_manager.cpp:50) [74203][SqlMemTimer][T0][Y0-0000000000000000-0-0] [lt=8] unregister pm finish(&pm=0x7f529b352380, pm.get_tid()=74203) [2024-09-11 15:49:24.714406] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer destroy(this=0x7f529d2ad3a0, thread_id=74203) [2024-09-11 15:49:24.714413] INFO [SERVER] destroy (ob_server.cpp:653) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] sql memory manager timer destroyed [2024-09-11 15:49:24.714417] INFO [SERVER] destroy (ob_server.cpp:655) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] begin to destroy server trace timer [2024-09-11 15:49:24.714420] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] destroy tg(tg_id=40, tg=0x7f529d2ad4f0, tg->attr_={name:ServerTracerTimer, type:3}) [2024-09-11 15:49:24.714424] INFO stop (ob_timer.cpp:99) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer stop success(this=0x7f529d2ad510, thread_id=74204) [2024-09-11 15:49:24.714433] INFO cancel_all (ob_timer.cpp:353) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] cancel all(ret=0, this=0x7f529d2ad510, thread_id=74204, wakeup_time_=101622749315, tasks_num_=0) [2024-09-11 15:49:24.714452] INFO run1 (ob_timer.cpp:477) [74204][ServerTracerTim][T0][Y0-0000000000000000-0-0] [lt=8] timer thread exit(this=0x7f529d2ad510, thread_id=74204) [2024-09-11 15:49:24.714463] INFO unregister_pm (ob_page_manager.cpp:50) [74204][ServerTracerTim][T0][Y0-0000000000000000-0-0] [lt=9] unregister pm finish(&pm=0x7f529b3d0380, pm.get_tid()=74204) [2024-09-11 15:49:24.714569] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] ObTimer destroy(this=0x7f529d2ad510, thread_id=74204) [2024-09-11 15:49:24.714576] INFO [SERVER] destroy (ob_server.cpp:657) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] server trace timer destroyed [2024-09-11 15:49:24.714580] INFO [SERVER] destroy (ob_server.cpp:659) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] begin to destroy ctas clean up timer [2024-09-11 15:49:24.714583] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] destroy tg(tg_id=103, tg=0x7f529d2b1c80, tg->attr_={name:CTASCleanUpTimer, type:3}) [2024-09-11 15:49:24.714588] INFO stop (ob_timer.cpp:99) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer stop success(this=0x7f529d2b1ca0, thread_id=74205) [2024-09-11 15:49:24.714596] INFO cancel_all (ob_timer.cpp:353) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] cancel all(ret=0, this=0x7f529d2b1ca0, thread_id=74205, wakeup_time_=0, tasks_num_=0) [2024-09-11 15:49:24.714605] INFO run1 (ob_timer.cpp:477) [74205][CTASCleanUpTime][T0][Y0-0000000000000000-0-0] [lt=6] timer thread exit(this=0x7f529d2b1ca0, thread_id=74205) [2024-09-11 15:49:24.714615] INFO unregister_pm (ob_page_manager.cpp:50) [74205][CTASCleanUpTime][T0][Y0-0000000000000000-0-0] [lt=7] unregister pm finish(&pm=0x7f529b056380, pm.get_tid()=74205) [2024-09-11 15:49:24.714709] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer destroy(this=0x7f529d2b1ca0, thread_id=74205) [2024-09-11 15:49:24.714716] INFO [SERVER] destroy (ob_server.cpp:661) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] ctas clean up timer destroyed [2024-09-11 15:49:24.714720] INFO [SERVER] destroy (ob_server.cpp:663) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy redef heart beat task [2024-09-11 15:49:24.714723] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] destroy tg(tg_id=113, tg=0x7f529d2fab00, tg->attr_={name:RedefHeartBeatTask, type:3}) [2024-09-11 15:49:24.714728] INFO [SERVER] destroy (ob_server.cpp:665) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] redef heart beat task destroyed [2024-09-11 15:49:24.714731] INFO [SERVER] destroy (ob_server.cpp:667) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] begin to destroy root service [2024-09-11 15:49:24.714771] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74301][LostRepCheck][T0][Y0-0000000000000000-0-0] [lt=6] reentrant thread exited(idx=0) [2024-09-11 15:49:24.714789] INFO unregister_pm (ob_page_manager.cpp:50) [74301][LostRepCheck][T0][Y0-0000000000000000-0-0] [lt=12] unregister pm finish(&pm=0x7f5284dd0380, pm.get_tid()=74301) [2024-09-11 15:49:24.714861] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74302][RootBalance][T0][Y0-0000000000000000-0-0] [lt=9] reentrant thread exited(idx=0) [2024-09-11 15:49:24.714880] INFO unregister_pm (ob_page_manager.cpp:50) [74302][RootBalance][T0][Y0-0000000000000000-0-0] [lt=15] unregister pm finish(&pm=0x7f5284456380, pm.get_tid()=74302) [2024-09-11 15:49:24.714972] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74300][EmptSvrCheck][T0][Y0-0000000000000000-0-0] [lt=6] reentrant thread exited(idx=0) [2024-09-11 15:49:24.714985] INFO unregister_pm (ob_page_manager.cpp:50) [74300][EmptSvrCheck][T0][Y0-0000000000000000-0-0] [lt=11] unregister pm finish(&pm=0x7f5284d52380, pm.get_tid()=74300) [2024-09-11 15:49:24.715049] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74299][RsThreadChecker][T0][Y0-0000000000000000-0-0] [lt=3] reentrant thread exited(idx=0) [2024-09-11 15:49:24.715072] INFO unregister_pm (ob_page_manager.cpp:50) [74299][RsThreadChecker][T0][Y0-0000000000000000-0-0] [lt=19] unregister pm finish(&pm=0x7f5284cd4380, pm.get_tid()=74299) [2024-09-11 15:49:24.715136] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74304][SchemaRec][T0][Y0-0000000000000000-0-0] [lt=6] reentrant thread exited(idx=0) [2024-09-11 15:49:24.715150] INFO unregister_pm (ob_page_manager.cpp:50) [74304][SchemaRec][T0][Y0-0000000000000000-0-0] [lt=11] unregister pm finish(&pm=0x7f5284552380, pm.get_tid()=74304) [2024-09-11 15:49:24.715221] INFO run1 (ob_timer.cpp:477) [74291][RSAsyncTask][T0][Y0-0000000000000000-0-0] [lt=0] timer thread exit(this=0x55ef06a1a590, thread_id=74291) [2024-09-11 15:49:24.715247] INFO unregister_pm (ob_page_manager.cpp:50) [74291][RSAsyncTask][T0][Y0-0000000000000000-0-0] [lt=10] unregister pm finish(&pm=0x7f52852d4380, pm.get_tid()=74291) [2024-09-11 15:49:24.715333] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ObTimer destroy(this=0x55ef06a1a590, thread_id=74291) [2024-09-11 15:49:24.715376] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74292][RSAsyncTask0][T0][Y0-0000000000000000-0-0] [lt=6] reentrant thread exited(idx=0) [2024-09-11 15:49:24.715378] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74293][RSAsyncTask1][T0][Y0-0000000000000000-0-0] [lt=3] reentrant thread exited(idx=1) [2024-09-11 15:49:24.715380] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74295][RSAsyncTask3][T0][Y0-0000000000000000-0-0] [lt=2] reentrant thread exited(idx=3) [2024-09-11 15:49:24.715383] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74294][RSAsyncTask2][T0][Y0-0000000000000000-0-0] [lt=2] reentrant thread exited(idx=2) [2024-09-11 15:49:24.715387] INFO unregister_pm (ob_page_manager.cpp:50) [74292][RSAsyncTask0][T0][Y0-0000000000000000-0-0] [lt=8] unregister pm finish(&pm=0x7f5285352380, pm.get_tid()=74292) [2024-09-11 15:49:24.715400] INFO unregister_pm (ob_page_manager.cpp:50) [74295][RSAsyncTask3][T0][Y0-0000000000000000-0-0] [lt=13] unregister pm finish(&pm=0x7f5284ed4380, pm.get_tid()=74295) [2024-09-11 15:49:24.715406] INFO unregister_pm (ob_page_manager.cpp:50) [74294][RSAsyncTask2][T0][Y0-0000000000000000-0-0] [lt=14] unregister pm finish(&pm=0x7f5284e56380, pm.get_tid()=74294) [2024-09-11 15:49:24.715424] INFO unregister_pm (ob_page_manager.cpp:50) [74293][RSAsyncTask1][T0][Y0-0000000000000000-0-0] [lt=11] unregister pm finish(&pm=0x7f52853d0380, pm.get_tid()=74293) [2024-09-11 15:49:24.715487] INFO [LIB] destroy (ob_work_queue.cpp:62) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] work queue destroy [2024-09-11 15:49:24.715517] INFO run1 (ob_timer.cpp:477) [74296][RSInspectTask][T0][Y0-0000000000000000-0-0] [lt=0] timer thread exit(this=0x55ef06a1b190, thread_id=74296) [2024-09-11 15:49:24.715527] INFO unregister_pm (ob_page_manager.cpp:50) [74296][RSInspectTask][T0][Y0-0000000000000000-0-0] [lt=7] unregister pm finish(&pm=0x7f5284f52380, pm.get_tid()=74296) [2024-09-11 15:49:24.715586] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimer destroy(this=0x55ef06a1b190, thread_id=74296) [2024-09-11 15:49:24.715618] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74297][RSInspectTask][T0][Y0-0000000000000000-0-0] [lt=6] reentrant thread exited(idx=0) [2024-09-11 15:49:24.715634] INFO unregister_pm (ob_page_manager.cpp:50) [74297][RSInspectTask][T0][Y0-0000000000000000-0-0] [lt=13] unregister pm finish(&pm=0x7f5284fd0380, pm.get_tid()=74297) [2024-09-11 15:49:24.715719] INFO [LIB] destroy (ob_work_queue.cpp:62) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] work queue destroy [2024-09-11 15:49:24.715751] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74298][HBChecker][T0][Y0-0000000000000000-0-0] [lt=2] reentrant thread exited(idx=0) [2024-09-11 15:49:24.715765] INFO unregister_pm (ob_page_manager.cpp:50) [74298][HBChecker][T0][Y0-0000000000000000-0-0] [lt=12] unregister pm finish(&pm=0x7f5284c56380, pm.get_tid()=74298) [2024-09-11 15:49:24.765126] INFO unregister_pm (ob_page_manager.cpp:50) [74303][EvtHisUpdTask][T0][Y0-0000000000000000-0-0] [lt=6] unregister pm finish(&pm=0x7f52844d4380, pm.get_tid()=74303) [2024-09-11 15:49:24.765394] INFO run1 (ob_timer.cpp:477) [74305][ObTimer][T0][Y0-0000000000000000-0-0] [lt=0] timer thread exit(this=0x55ef071d4e00, thread_id=74305) [2024-09-11 15:49:24.765427] INFO unregister_pm (ob_page_manager.cpp:50) [74305][ObTimer][T0][Y0-0000000000000000-0-0] [lt=27] unregister pm finish(&pm=0x7f52845d0380, pm.get_tid()=74305) [2024-09-11 15:49:24.765583] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=25] ObTimer destroy(this=0x55ef071d4e00, thread_id=74305) [2024-09-11 15:49:24.812345] INFO unregister_pm (ob_page_manager.cpp:50) [74306][unknown0][T0][Y0-0000000000000000-0-0] [lt=4] unregister pm finish(&pm=0x7f5284256380, pm.get_tid()=74306) [2024-09-11 15:49:24.812510] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=33] destroy tg(tg_id=294, tg=0x7f5298fc5d90, tg->attr_={name:DDLTaskExecutor3, type:2}) [2024-09-11 15:49:24.812529] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=16] destroy tg(tg_id=104, tg=0x7f529d2b1df0, tg->attr_={name:DDLScanTask, type:3}) [2024-09-11 15:49:24.812537] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] destroy tg(tg_id=112, tg=0x7f529d2fa990, tg->attr_={name:HeartBeatCheckTask, type:3}) [2024-09-11 15:49:24.812683] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74308][DRTaskMgr][T0][Y0-0000000000000000-0-0] [lt=2] reentrant thread exited(idx=0) [2024-09-11 15:49:24.812716] INFO unregister_pm (ob_page_manager.cpp:50) [74308][DRTaskMgr][T0][Y0-0000000000000000-0-0] [lt=26] unregister pm finish(&pm=0x7f5284352380, pm.get_tid()=74308) [2024-09-11 15:49:24.825396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:24.825435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:24.825443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:24.825451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51909786419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:24.866699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:24.912455] INFO unregister_pm (ob_page_manager.cpp:50) [74307][unknown0][T0][Y0-0000000000000000-0-0] [lt=3] unregister pm finish(&pm=0x7f52842d4380, pm.get_tid()=74307) [2024-09-11 15:49:24.912589] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=22] destroy tg(tg_id=99, tg=0x7f529d2b1770, tg->attr_={name:GlobalCtxTimer, type:3}) [2024-09-11 15:49:24.912622] INFO [SERVER] destroy (ob_server.cpp:669) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] root service destroyed [2024-09-11 15:49:24.912627] INFO [SERVER] destroy (ob_server.cpp:671) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy ob service [2024-09-11 15:49:24.912631] INFO [SERVER] destroy (ob_service.cpp:418) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] [OBSERVICE_NOTICE] destroy ob_service begin [2024-09-11 15:49:24.912636] INFO [SERVER] destroy (ob_service.cpp:423) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin to destroy schema updater [2024-09-11 15:49:25.025675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:25.025714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:25.025720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:25.025729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51909786419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:25.066808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:25.089919] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:25.096990] INFO [SERVER] run1 (ob_uniq_task_queue.h:477) [74267][SerScheQueue0][T0][Y0-0000000000000000-0-0] [lt=9] UniqTaskQueue thread stop [2024-09-11 15:49:25.097014] INFO unregister_pm (ob_page_manager.cpp:50) [74267][SerScheQueue0][T0][Y0-0000000000000000-0-0] [lt=13] unregister pm finish(&pm=0x7f52868d4380, pm.get_tid()=74267) [2024-09-11 15:49:25.097279] INFO [SERVER] run1 (ob_uniq_task_queue.h:477) [74268][SerScheQueue1][T0][Y0-0000000000000000-0-0] [lt=7] UniqTaskQueue thread stop [2024-09-11 15:49:25.097295] INFO unregister_pm (ob_page_manager.cpp:50) [74268][SerScheQueue1][T0][Y0-0000000000000000-0-0] [lt=12] unregister pm finish(&pm=0x7f5286952380, pm.get_tid()=74268) [2024-09-11 15:49:25.097346] INFO [SERVER] destroy (ob_service.cpp:425) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=17] schema updater destroyed [2024-09-11 15:49:25.097364] INFO [SERVER] destroy (ob_service.cpp:427) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=17] begin to destroy lease state manager [2024-09-11 15:49:25.097372] INFO [SERVER] destroy (ob_service.cpp:429) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] lease state manager destroyed [2024-09-11 15:49:25.097377] INFO [SERVER] destroy (ob_service.cpp:431) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin to destroy cluster event instance [2024-09-11 15:49:25.103144] INFO unregister_pm (ob_page_manager.cpp:50) [74269][EvtHisUpdTask][T0][Y0-0000000000000000-0-0] [lt=7] unregister pm finish(&pm=0x7f52869d0380, pm.get_tid()=74269) [2024-09-11 15:49:25.103278] INFO [SERVER] destroy (ob_service.cpp:433) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] cluster event instance destroyed [2024-09-11 15:49:25.103296] INFO [SERVER] destroy (ob_service.cpp:435) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=18] begin to destroy tenant event instance [2024-09-11 15:49:25.118172] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726040965118168, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 15:49:25.124919] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726040965124915, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:49:25.153256] INFO unregister_pm (ob_page_manager.cpp:50) [74270][EvtHisUpdTask][T0][Y0-0000000000000000-0-0] [lt=3] unregister pm finish(&pm=0x7f5286456380, pm.get_tid()=74270) [2024-09-11 15:49:25.153439] INFO [SERVER] destroy (ob_service.cpp:437) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] tenant event instance destroyed [2024-09-11 15:49:25.153486] INFO [SERVER] destroy (ob_service.cpp:439) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=46] begin to destroy server event instance [2024-09-11 15:49:25.153852] INFO unregister_pm (ob_page_manager.cpp:50) [74271][EvtHisUpdTask][T0][Y0-0000000000000000-0-0] [lt=8] unregister pm finish(&pm=0x7f52864d4380, pm.get_tid()=74271) [2024-09-11 15:49:25.153975] INFO [STORAGE.TRANS] stop (ob_time_wheel.cpp:439) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimeWheel stop success(timer_name="EventTimer") [2024-09-11 15:49:25.153995] INFO [OCCAM] stop (ob_occam_thread_pool.h:110) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=12] occam thread marked stopped(this=0x7f529b4050d0, id=1) [2024-09-11 15:49:25.154007] INFO unregister_pm (ob_page_manager.cpp:50) [74272][Occam][T0][Y0-0000000000000000-0-0] [lt=3] unregister pm finish(&pm=0x7f5286552380, pm.get_tid()=74272) [2024-09-11 15:49:25.225996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:25.226040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:25.226048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:25.226056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51909786419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:25.266914] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:25.426284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:25.426318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:25.426324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:25.426333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51909786419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:25.467007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:25.626615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:25.626665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:25.626672] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:25.626680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51909786419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:25.667117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:25.684135] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:25.827016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:25.827054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:25.827060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:25.827080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51909786419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:25.834060] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6949, clean_start_pos=400000, clean_num=200000) [2024-09-11 15:49:25.867243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:26.034389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:26.034435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:26.034443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:26.034453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51909786419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:26.067374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:26.090023] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=14] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:26.098536] INFO unregister_pm (ob_page_manager.cpp:50) [74273][EventTimer][T0][Y0-0000000000000000-0-0] [lt=2] unregister pm finish(&pm=0x7f52865d0380, pm.get_tid()=74273) [2024-09-11 15:49:26.098656] INFO [STORAGE.TRANS] wait (ob_time_wheel.cpp:463) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] ObTimeWheel wait success [2024-09-11 15:49:26.098756] INFO [OCCAM] stop (ob_occam_thread_pool.h:110) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=27] occam thread marked stopped(this=0x7f529b4050d0, id=1) [2024-09-11 15:49:26.098775] INFO [OCCAM] stop (ob_occam_thread_pool.h:110) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=18] occam thread marked stopped(this=0x7f529b4050d0, id=1) [2024-09-11 15:49:26.098803] INFO [STORAGE.TRANS] destroy (ob_time_wheel.cpp:491) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimeWheel destroy success [2024-09-11 15:49:26.098810] INFO [SERVER] destroy (ob_service.cpp:441) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] server event instance destroyed [2024-09-11 15:49:26.098815] INFO [SERVER] destroy (ob_service.cpp:443) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin to destroy meta table checker [2024-09-11 15:49:26.098821] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] destroy tg(tg_id=292, tg=0x7f5298fb5cb0, tg->attr_={name:SvrMetaCh, type:3}) [2024-09-11 15:49:26.098834] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=11] destroy tg(tg_id=293, tg=0x7f5298fcdcb0, tg->attr_={name:SvrMetaCh, type:3}) [2024-09-11 15:49:26.098840] INFO [SERVER] destroy (ob_server_meta_table_checker.cpp:168) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObServerMetaTableChecker destroy finished(ls_tg_id=292, tablet_tg_id=293) [2024-09-11 15:49:26.098846] INFO [SERVER] destroy (ob_service.cpp:445) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] meta table checker destroyed [2024-09-11 15:49:26.098861] INFO [SERVER] destroy (ob_service.cpp:447) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=15] begin to destroy heartbeat process [2024-09-11 15:49:26.098866] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] destroy tg(tg_id=44, tg=0x7f529d2adab0, tg->attr_={name:ObHeartbeat, type:3}) [2024-09-11 15:49:26.098872] INFO stop (ob_timer.cpp:99) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] ObTimer stop success(this=0x7f529d2adad0, thread_id=74266) [2024-09-11 15:49:26.098890] INFO cancel_all (ob_timer.cpp:353) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] cancel all(ret=0, this=0x7f529d2adad0, thread_id=74266, wakeup_time_=0, tasks_num_=0) [2024-09-11 15:49:26.098958] INFO run1 (ob_timer.cpp:477) [74266][ObHeartbeat][T0][Y0-0000000000000000-0-0] [lt=0] timer thread exit(this=0x7f529d2adad0, thread_id=74266) [2024-09-11 15:49:26.098977] INFO unregister_pm (ob_page_manager.cpp:50) [74266][ObHeartbeat][T0][Y0-0000000000000000-0-0] [lt=12] unregister pm finish(&pm=0x7f5286856380, pm.get_tid()=74266) [2024-09-11 15:49:26.099118] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ObTimer destroy(this=0x7f529d2adad0, thread_id=74266) [2024-09-11 15:49:26.099139] INFO [SERVER] destroy (ob_service.cpp:449) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=16] heartbeat process destroyed [2024-09-11 15:49:26.099145] INFO [SERVER] destroy (ob_service.cpp:451) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] begin to destroy deadlock event service [2024-09-11 15:49:26.109594] INFO unregister_pm (ob_page_manager.cpp:50) [74274][EvtHisUpdTask][T0][Y0-0000000000000000-0-0] [lt=6] unregister pm finish(&pm=0x7f5286056380, pm.get_tid()=74274) [2024-09-11 15:49:26.109753] INFO [SERVER] destroy (ob_service.cpp:453) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] deadlock event service destroyed [2024-09-11 15:49:26.109778] INFO [SERVER] destroy (ob_service.cpp:455) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=24] [OBSERVICE_NOTICE] destroy ob_service end(ret=0, ret="OB_SUCCESS") [2024-09-11 15:49:26.109786] INFO [SERVER] destroy (ob_server.cpp:673) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] ob service destroyed [2024-09-11 15:49:26.109791] INFO [SERVER] destroy (ob_server.cpp:675) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin to destroy session manager [2024-09-11 15:49:26.109954] INFO [SERVER] destroy (ob_server.cpp:677) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] session manager destroyed [2024-09-11 15:49:26.109964] INFO [SERVER] destroy (ob_server.cpp:679) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] begin to destroy locality manager [2024-09-11 15:49:26.109972] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] destroy tg(tg_id=54, tg=0x7f529d26fe40, tg->attr_={name:LocalityReload, type:3}) [2024-09-11 15:49:26.109983] INFO stop (ob_timer.cpp:99) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] ObTimer stop success(this=0x7f529d26fe60, thread_id=74331) [2024-09-11 15:49:26.109999] INFO cancel_all (ob_timer.cpp:353) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] cancel all(ret=0, this=0x7f529d26fe60, thread_id=74331, wakeup_time_=0, tasks_num_=0) [2024-09-11 15:49:26.110013] INFO run1 (ob_timer.cpp:477) [74331][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=4] timer thread exit(this=0x7f529d26fe60, thread_id=74331) [2024-09-11 15:49:26.110039] INFO unregister_pm (ob_page_manager.cpp:50) [74331][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=20] unregister pm finish(&pm=0x7f527f8d4380, pm.get_tid()=74331) [2024-09-11 15:49:26.110144] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=6] ObTimer destroy(this=0x7f529d26fe60, thread_id=74331) [2024-09-11 15:49:26.110159] INFO [STORAGE] destroy (ob_locality_info.cpp:65) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=10] ObLocalityInfo destroy finished [2024-09-11 15:49:26.110257] INFO [SHARE] destroy (ob_server_locality_cache.cpp:171) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=85] ObServerLocalityCache destroy finished [2024-09-11 15:49:26.112001] INFO unregister_pm (ob_page_manager.cpp:50) [74330][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=7] unregister pm finish(&pm=0x7f527f856380, pm.get_tid()=74330) [2024-09-11 15:49:26.112075] INFO [STORAGE] destroy (ob_locality_manager.cpp:63) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] ObLocalityManager destroy finished [2024-09-11 15:49:26.112089] INFO [SERVER] destroy (ob_server.cpp:681) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=13] locality manager destroyed [2024-09-11 15:49:26.112094] INFO [SERVER] destroy (ob_server.cpp:683) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin to destroy sql engine [2024-09-11 15:49:26.115576] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:303) [74309][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=4] async task queue stop [2024-09-11 15:49:26.115595] INFO [SHARE] run1 (ob_reentrant_thread.cpp:168) [74309][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=16] reentrant thread exited(idx=0) [2024-09-11 15:49:26.115607] INFO unregister_pm (ob_page_manager.cpp:50) [74309][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=7] unregister pm finish(&pm=0x7f52843d0380, pm.get_tid()=74309) [2024-09-11 15:49:26.115821] INFO [SERVER] destroy (ob_server.cpp:685) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] sql engine destroyed [2024-09-11 15:49:26.115841] INFO [SERVER] destroy (ob_server.cpp:687) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=19] begin to destroy xml ctx [2024-09-11 15:49:26.115856] INFO [SERVER] destroy (ob_server.cpp:689) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] xml ctx destroyed [2024-09-11 15:49:26.115861] INFO [SERVER] destroy (ob_server.cpp:691) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] begin to destroy pl engine [2024-09-11 15:49:26.115866] INFO [SERVER] destroy (ob_server.cpp:693) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] pl engine destroyed [2024-09-11 15:49:26.115870] INFO [SERVER] destroy (ob_server.cpp:695) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] begin to destroy tenant disk usage report task [2024-09-11 15:49:26.115892] INFO [SERVER] destroy (ob_server.cpp:697) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] tenant disk usage report task destroyed [2024-09-11 15:49:26.115896] INFO [SERVER] destroy (ob_server.cpp:699) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy tmp file manager [2024-09-11 15:49:26.115984] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Success to deregister cache, (cache_id=10) [2024-09-11 15:49:26.115999] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] Success to deregister cache, (cache_id=11) [2024-09-11 15:49:26.116003] INFO [SERVER] destroy (ob_server.cpp:701) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] tmp file manager destroyed [2024-09-11 15:49:26.116007] INFO [SERVER] destroy (ob_server.cpp:703) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy disk usage report task [2024-09-11 15:49:26.116012] INFO destroy_tg (thread_mgr.cpp:91) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] destroy tg(tg_id=56, tg=0x7f529d273e40, tg->attr_={name:DiskUseReport, type:3}) [2024-09-11 15:49:26.116022] INFO stop (ob_timer.cpp:99) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=9] ObTimer stop success(this=0x7f529d273e60, thread_id=74329) [2024-09-11 15:49:26.116038] INFO cancel_all (ob_timer.cpp:353) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] cancel all(ret=0, this=0x7f529d273e60, thread_id=74329, wakeup_time_=0, tasks_num_=0) [2024-09-11 15:49:26.116052] INFO run1 (ob_timer.cpp:477) [74329][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=9] timer thread exit(this=0x7f529d273e60, thread_id=74329) [2024-09-11 15:49:26.116093] INFO unregister_pm (ob_page_manager.cpp:50) [74329][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=36] unregister pm finish(&pm=0x7f52821d0380, pm.get_tid()=74329) [2024-09-11 15:49:26.116215] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] ObTimer destroy(this=0x7f529d273e60, thread_id=74329) [2024-09-11 15:49:26.116227] INFO [SERVER] destroy (ob_server.cpp:705) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] disk usage report task destroyed [2024-09-11 15:49:26.116231] INFO [SERVER] destroy (ob_server.cpp:707) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy store cache [2024-09-11 15:49:26.116237] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Success to deregister cache, (cache_id=4) [2024-09-11 15:49:26.116242] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Success to deregister cache, (cache_id=5) [2024-09-11 15:49:26.116247] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] Success to deregister cache, (cache_id=6) [2024-09-11 15:49:26.116251] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Success to deregister cache, (cache_id=7) [2024-09-11 15:49:26.121385] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Success to deregister cache, (cache_id=8) [2024-09-11 15:49:26.121409] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=23] Success to deregister cache, (cache_id=9) [2024-09-11 15:49:26.121415] INFO [SERVER] destroy (ob_server.cpp:709) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=5] store cache destroyed [2024-09-11 15:49:26.121420] INFO [SERVER] destroy (ob_server.cpp:711) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy tx data kv cache [2024-09-11 15:49:26.121424] INFO [COMMON] deregister_cache (ob_kv_storecache.cpp:658) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] Success to deregister cache, (cache_id=12) [2024-09-11 15:49:26.121428] INFO [SERVER] destroy (ob_server.cpp:713) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=3] tx data kv cache destroyed [2024-09-11 15:49:26.121432] INFO [SERVER] destroy (ob_server.cpp:715) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] begin to destroy location service [2024-09-11 15:49:26.121462] INFO run1 (ob_timer.cpp:477) [74318][AutoLSLoc][T0][Y0-0000000000000000-0-0] [lt=1] timer thread exit(this=0x55ef066fc920, thread_id=74318) [2024-09-11 15:49:26.121484] INFO unregister_pm (ob_page_manager.cpp:50) [74318][AutoLSLoc][T0][Y0-0000000000000000-0-0] [lt=17] unregister pm finish(&pm=0x7f5282c56380, pm.get_tid()=74318) [2024-09-11 15:49:26.121576] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=4] ObTimer destroy(this=0x55ef066fc920, thread_id=74318) [2024-09-11 15:49:26.121608] INFO run1 (ob_timer.cpp:477) [74319][AutoLSLocRpc][T0][Y0-0000000000000000-0-0] [lt=0] timer thread exit(this=0x55ef066fca20, thread_id=74319) [2024-09-11 15:49:26.121629] INFO unregister_pm (ob_page_manager.cpp:50) [74319][AutoLSLocRpc][T0][Y0-0000000000000000-0-0] [lt=17] unregister pm finish(&pm=0x7f5282cd4380, pm.get_tid()=74319) [2024-09-11 15:49:26.121727] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=8] ObTimer destroy(this=0x55ef066fca20, thread_id=74319) [2024-09-11 15:49:26.121753] INFO run1 (ob_timer.cpp:477) [74320][DumpLSLoc][T0][Y0-0000000000000000-0-0] [lt=1] timer thread exit(this=0x55ef066fcb20, thread_id=74320) [2024-09-11 15:49:26.121771] INFO unregister_pm (ob_page_manager.cpp:50) [74320][DumpLSLoc][T0][Y0-0000000000000000-0-0] [lt=14] unregister pm finish(&pm=0x7f5282d52380, pm.get_tid()=74320) [2024-09-11 15:49:26.121842] INFO destroy (ob_timer.cpp:140) [74200][observer][T0][Y0-0000000000000001-0-0] [lt=7] ObTimer destroy(this=0x55ef066fcb20, thread_id=74320) [2024-09-11 15:49:26.125780] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726040966125778, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:49:26.132532] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726040966132530, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:49:26.234763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:26.234807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:26.234815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:26.234825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:26.267511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:26.435129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:26.435173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:26.435181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:26.435190] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:26.467653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:26.635438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:26.635479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:26.635487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:26.635496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:26.671973] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4196, replace_start_pos=300000, replace_num=100000) [2024-09-11 15:49:26.672019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:26.685255] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:26.835727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:26.835772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:26.835779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:26.835801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:26.872101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:27.036042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:27.036077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:27.036083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:27.036091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:27.072198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:27.090139] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:27.133449] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726040967133446, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 15:49:27.140154] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726040967140150, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:49:27.236330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:27.236368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:27.236374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:27.236382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:27.272291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:27.436615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:27.436655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:27.436662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:27.436685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:27.472391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:27.636939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:27.636989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:27.636996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:27.637005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:27.672497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:27.686186] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:27.837233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:27.837271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:27.837278] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:27.837286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:27.844811] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7512, clean_start_pos=600000, clean_num=200000) [2024-09-11 15:49:27.872606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:28.045072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:28.045119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:28.045127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:28.045135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:28.072703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:28.090226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=15] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:28.141080] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726040968141076, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:49:28.147765] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726040968147763, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:49:28.245370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:28.245416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:28.245424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:28.245433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:28.272805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:28.445678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:28.445723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:28.445731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:28.445740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:28.472927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:28.645997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:28.646042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:28.646049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:28.646058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:28.673124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:28.687036] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:28.846313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:28.846358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:28.846366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:28.846375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:28.877585] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4344, replace_start_pos=400000, replace_num=100000) [2024-09-11 15:49:28.877619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:29.046619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:29.046658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:29.046665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:29.046674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:29.077717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:29.090328] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=30] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:29.148686] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726040969148682, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:49:29.155395] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726040969155391, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 15:49:29.246940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:29.246979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:29.246987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:29.246996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:29.277809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:29.447242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:29.447286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:29.447294] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:29.447302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:29.477921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:29.647553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:29.647644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=90][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:29.647651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:29.647684] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:29.678058] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:29.687917] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:29.729738] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=1] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:49:29.729782] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:49:29.729825] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=0, max_check_version=0, global_version=1) [2024-09-11 15:49:29.731617] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 32 117 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 1 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1792 [2024-09-11 15:49:29.731656] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:49:29.731729] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:49:29.731762] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:49:29.731845] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 350,453,760 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 92,397,568 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:49:29.731942] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 92,397,568 used= 77,541,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 408,704 used= 403,328 count= 3 avg_used= 134,442 block_cnt= 3 chunk_cnt= 2 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 72,208 used= 63,128 count= 7 avg_used= 9,018 block_cnt= 7 chunk_cnt= 3 mod=MallocInfoMap [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,541,440 used= 76,131,748 count= 1,530 avg_used= 49,759 mod=SUMMARY [2024-09-11 15:49:29.731990] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,330,400 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,016 used= 242,506 count= 924 avg_used= 262 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,330,400 used= 1,214,055 count= 14,556 avg_used= 83 mod=SUMMARY [2024-09-11 15:49:29.731999] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:49:29.732008] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:49:29.732043] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,699,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 mod=SUMMARY [2024-09-11 15:49:29.732093] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:49:29.732111] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:49:29.848010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:29.848054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:29.848061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:29.848071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:29.855436] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7353, clean_start_pos=800000, clean_num=200000) [2024-09-11 15:49:29.878238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:30.055689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:30.055733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:30.055741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:30.055750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:30.078363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:30.090418] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=22] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:30.156255] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726040970156251, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007569, add_bytes: 0 [2024-09-11 15:49:30.163018] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726040970163015, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:49:30.256013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:30.256045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:30.256052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:30.256060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:30.278458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:30.456295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:30.456339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:30.456347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:30.456356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:30.478627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:30.656584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:30.656629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:30.656636] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:30.656645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:30.678740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:30.688896] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:30.856887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:30.856947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:30.856955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:30.856995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:30.878840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:31.057301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:31.057346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:31.057354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:31.057364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:31.083254] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4322, replace_start_pos=500000, replace_num=100000) [2024-09-11 15:49:31.083301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:31.090509] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=18] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:31.163846] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726040971163842, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007591, add_bytes: 0 [2024-09-11 15:49:31.170633] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726040971170628, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:49:31.257664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:31.257704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:31.257712] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:31.257722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:31.283384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:31.457968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:31.458026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:31.458037] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:31.458046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:31.483499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:31.658276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:31.658328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:31.658335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:31.658344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:31.683588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:31.689823] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:31.858565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:31.858599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:31.858605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:31.858614] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:31.866781] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8155, clean_start_pos=1000000, clean_num=200000) [2024-09-11 15:49:31.883675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:32.067037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:32.067066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:32.067073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:32.067082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:32.083766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:32.090612] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:32.171465] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726040972171461, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:49:32.178240] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726040972178236, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:49:32.267315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:32.267358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:32.267366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:32.267375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:32.283924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:32.467612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:32.467655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:32.467663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:32.467672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:32.484057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:32.667895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:32.667956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:32.667964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:32.667973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:32.684174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:32.690875] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:32.868273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:32.868320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:32.868328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:32.868338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:32.884278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:33.068569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:33.068616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:33.068624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:33.068633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:33.084419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:33.090708] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=12] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:33.179096] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726040973179091, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:49:33.185954] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726040973185949, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007713, add_bytes: 0 [2024-09-11 15:49:33.269016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:33.269062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:33.269069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:33.269079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:33.288549] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3947, replace_start_pos=600000, replace_num=100000) [2024-09-11 15:49:33.288596] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:33.469323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:33.469367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:33.469375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:33.469384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:33.488691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:33.669698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:33.669755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:33.669763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:33.669773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:33.688876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:33.691914] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:33.870031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:33.870068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:33.870076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:33.870085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:33.878395] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8291, clean_start_pos=1200000, clean_num=200000) [2024-09-11 15:49:33.889006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:34.078646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:34.078683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:34.078689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:34.078697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51951770419, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:34.089095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:34.090810] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:34.186704] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726040974186700, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:49:34.193468] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726040974193463, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007514, add_bytes: 0 [2024-09-11 15:49:34.278941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:34.278996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:34.279003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:34.279012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:34.289188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:34.479248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:34.479289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:34.479298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:34.479307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:34.489287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:34.679527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:34.679614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=87][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:34.679622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:34.679630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:34.689388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:34.692666] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:34.879855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:34.879916] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:34.879924] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:34.879934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:34.889485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:35.080166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:35.080209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:35.080217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:35.080241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:35.089571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:35.090891] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=11] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:35.194379] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726040975194375, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:49:35.201078] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726040975201074, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:49:35.280537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:35.280578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:35.280586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:35.280596] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:35.289663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:35.480827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:35.480871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:35.480879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:35.480888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:35.494137] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4361, replace_start_pos=700000, replace_num=100000) [2024-09-11 15:49:35.494170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:35.681138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:35.681209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:35.681216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:35.681224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:35.693776] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:35.694255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:35.881475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:35.881521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:35.881529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:35.881538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:35.889389] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7838, clean_start_pos=1400000, clean_num=200000) [2024-09-11 15:49:35.894348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:36.089697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:36.089740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:36.089746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:36.089753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:36.090992] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:36.094505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:36.201997] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726040976201993, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:49:36.208685] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726040976208682, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:49:36.289999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:36.290043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:36.290049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:36.290057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:36.294608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:36.490380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:36.490426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:36.490434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:36.490444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:36.494715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:36.690765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:36.690802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:36.690809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:36.690817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:36.694739] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:36.694823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:36.891074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:36.891127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:36.891136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:36.891145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:36.894929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:37.091106] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=30] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:37.091346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:37.091366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:37.091373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:37.091382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:37.095039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:37.209550] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726040977209546, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:49:37.216322] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726040977216319, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 15:49:37.291635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:37.291674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:37.291680] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:37.291689] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:37.295122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:37.491938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:37.491982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:37.491990] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:37.491999] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:37.495207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:37.692226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:37.692278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:37.692285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:37.692294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:37.695619] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:37.699621] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4332, replace_start_pos=800000, replace_num=100000) [2024-09-11 15:49:37.699654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:37.892528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:37.892570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:37.892577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:37.892602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:37.899812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:37.900358] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7744, clean_start_pos=1600000, clean_num=200000) [2024-09-11 15:49:38.091225] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:38.099922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:38.100657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:38.100691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:38.100699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:38.100709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:38.217176] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726040978217172, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:49:38.223937] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726040978223934, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:49:38.300097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:38.300957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:38.300988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:38.300995] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:38.301004] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:38.500281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:38.501224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:38.501256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:38.501264] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:38.501273] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:38.696486] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:38.700425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:38.701499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:38.701527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:38.701533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:38.701542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:38.900636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:38.901762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:38.901797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:38.901805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:38.901814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:39.091339] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:39.100820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:39.102047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:39.102066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:39.102073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:39.102082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:39.224786] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726040979224782, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:49:39.231541] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726040979231537, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:49:39.300946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:39.302316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:39.302336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:39.302342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:39.302350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:39.501129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:39.502566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:39.502591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:39.502598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:39.502608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:39.697794] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:39.701252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:39.702841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:39.702865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:39.702873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:39.702881] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:39.746820] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:49:39.746867] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:49:39.746915] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=0, max_check_version=1, global_version=2) [2024-09-11 15:49:39.748945] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 117 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 1 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2029 [2024-09-11 15:49:39.748995] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:49:39.749031] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:49:39.749069] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:49:39.749153] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:49:39.749259] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,679,248 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,679,248 used= 76,265,964 count= 1,548 avg_used= 49,267 mod=SUMMARY [2024-09-11 15:49:39.749313] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,330,400 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,016 used= 242,506 count= 924 avg_used= 262 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,330,400 used= 1,214,055 count= 14,556 avg_used= 83 mod=SUMMARY [2024-09-11 15:49:39.749324] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:49:39.749335] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:49:39.749370] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,699,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 mod=SUMMARY [2024-09-11 15:49:39.749430] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:49:39.749452] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:49:39.903111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:39.903156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:39.903163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:39.903172] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:39.904808] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3366, replace_start_pos=900000, replace_num=100000) [2024-09-11 15:49:39.904845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:39.911458] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8273, clean_start_pos=1800000, clean_num=200000) [2024-09-11 15:49:40.091463] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:40.104995] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:40.111718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:40.111752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:40.111758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:40.111767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:40.112154] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=63, refresh_score_time=75, wash_time=0) [2024-09-11 15:49:40.232395] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726040980232391, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:49:40.239226] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726040980239221, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:49:40.305176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:40.312390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:40.312421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:40.312427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:40.312435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:40.505376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:40.512650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:40.512689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:40.512699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:40.512707] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:40.698705] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=145] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:40.705605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:40.712950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:40.712981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:40.712988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:40.712997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:40.905782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:40.913216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:40.913258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:40.913266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:40.913276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:41.091569] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:41.105978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:41.113512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:41.113551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:41.113558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:41.113567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:41.240021] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726040981240017, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:49:41.246839] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726040981246835, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:49:41.306172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:41.313792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:41.313832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:41.313839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:41.313848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:41.506368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:41.514087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:41.514130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:41.514137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:41.514147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:41.699456] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:41.706500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:41.714362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:41.714396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:41.714403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:41.714411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:41.906621] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:41.914613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:41.914654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:41.914661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:41.914669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:41.923376] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8696, clean_start_pos=2000000, clean_num=200000) [2024-09-11 15:49:42.091686] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:42.110781] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3934, replace_start_pos=1000000, replace_num=100000) [2024-09-11 15:49:42.110819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:42.123633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:42.123671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:42.123678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:42.123687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:42.247626] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726040982247623, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:49:42.254389] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726040982254385, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 15:49:42.310930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:42.323937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:42.323981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:42.323988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:42.324014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:42.511050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:42.524235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:42.524279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:42.524286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:42.524295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:42.700247] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:42.711181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:42.724521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:42.724562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:42.724570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:42.724579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:42.911304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:42.924813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:42.924851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:42.924859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:42.924868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:43.091810] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:43.111424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:43.125170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:43.125216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:43.125224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:43.125250] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:43.255309] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726040983255305, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:49:43.262000] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726040983261996, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:49:43.311602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:43.325488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:43.325532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:43.325539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:43.325549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:43.511781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:43.525772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:43.525812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:43.525819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:43.525828] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:43.701204] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:43.711961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:43.726064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:43.726099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:43.726105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:43.726114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:43.912162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:43.926342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:43.926386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:43.926394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:43.926420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:43.933330] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6896, clean_start_pos=2200000, clean_num=200000) [2024-09-11 15:49:44.091943] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:44.112343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:44.133586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:44.133625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:44.133632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:44.133641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:44.262923] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726040984262919, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:49:44.269633] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726040984269629, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 15:49:44.316786] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4268, replace_start_pos=1100000, replace_num=100000) [2024-09-11 15:49:44.316832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:44.333965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:44.334012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:44.334022] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:44.334032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:44.516977] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:44.534278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:44.534323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:44.534331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:44.534340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:44.702215] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:44.717120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:44.734660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:44.734704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:44.734712] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:44.734721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:44.917251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:44.935000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:44.935047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:44.935055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:44.935064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:45.092126] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:45.117371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:45.135363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:45.135407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:45.135415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:45.135432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:45.270539] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726040985270535, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:49:45.277297] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726040985277294, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 15:49:45.317544] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:45.335740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:45.335788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:45.335796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:45.335806] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:45.517673] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:45.536068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:45.536113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:45.536120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:45.536129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:45.703472] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=115] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:45.717868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:45.736432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:45.736477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:45.736485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:45.736495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:45.918070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:45.936743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:45.936787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:45.936795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:45.936804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:45.944722] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7905, clean_start_pos=2400000, clean_num=200000) [2024-09-11 15:49:46.092260] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:46.118195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:46.144983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:46.145014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:46.145020] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:46.145027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:46.278099] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726040986278095, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 15:49:46.284848] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726040986284844, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 15:49:46.318313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:46.345264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:46.345302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:46.345311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:46.345321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:46.522716] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4287, replace_start_pos=1200000, replace_num=100000) [2024-09-11 15:49:46.522764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:46.545549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:46.545593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:46.545601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:46.545628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:46.704562] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=102] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:46.722844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:46.745938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:46.745981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:46.745987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:46.745994] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:46.923011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:46.946315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:46.946360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:46.946368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:46.946377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:47.092438] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:47.123195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:47.146620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:47.146664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:47.146671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:47.146680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:47.285782] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726040987285777, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:49:47.292533] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726040987292528, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:49:47.323326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:47.347004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:47.347065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:47.347072] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:47.347081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:47.523453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:47.547372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:47.547418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:47.547425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:47.547435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:47.705816] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:47.723634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:47.747668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:47.747710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:47.747718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:47.747727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:47.923816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:47.948039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:47.948083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:47.948090] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:47.948100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:47.956358] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8246, clean_start_pos=2600000, clean_num=200000) [2024-09-11 15:49:48.092622] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:48.123952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:48.156619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:48.156663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:48.156671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:48.156680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:48.293391] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726040988293386, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:49:48.300107] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726040988300103, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 15:49:48.324149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:48.356990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:48.357034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:48.357041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:48.357050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:48.524282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:48.557352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:48.557398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:48.557406] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:48.557416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:48.707060] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=121] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:48.728748] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4347, replace_start_pos=1300000, replace_num=100000) [2024-09-11 15:49:48.728796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:48.757647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:48.757687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:48.757695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:48.757703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:48.928882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:48.957996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:48.958044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:48.958052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:48.958062] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:49.092740] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:49.129099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:49.158291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:49.158336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:49.158344] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:49.158353] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:49.300998] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726040989300994, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:49:49.307805] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726040989307801, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007698, add_bytes: 0 [2024-09-11 15:49:49.329285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:49.358646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:49.358694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:49.358703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:49.358712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:49.529466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:49.559057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:49.559101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:49.559108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:49.559117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:49.708369] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:49.729599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:49.759412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:49.759459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:49.759467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:49.759477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:49.763639] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:49:49.763672] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:49:49.763753] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=1, max_check_version=2, global_version=3) [2024-09-11 15:49:49.765766] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 117 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 1 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2013 [2024-09-11 15:49:49.765798] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:49:49.765834] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:49:49.765895] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:49:49.766255] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:49:49.766364] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,695,024 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,695,024 used= 76,281,340 count= 1,550 avg_used= 49,213 mod=SUMMARY [2024-09-11 15:49:49.766421] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,330,400 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,016 used= 242,506 count= 924 avg_used= 262 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,330,400 used= 1,214,055 count= 14,556 avg_used= 83 mod=SUMMARY [2024-09-11 15:49:49.766436] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:49:49.766447] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:49:49.766482] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,699,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 mod=SUMMARY [2024-09-11 15:49:49.766543] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:49:49.766564] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:49:49.929782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:49.959721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:49.959765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:49.959773] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:49.959800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:49.967754] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7939, clean_start_pos=2800000, clean_num=200000) [2024-09-11 15:49:50.092858] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:50.129963] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:50.168029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:50.168073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:50.168080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:50.168089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:50.168272] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | [2024-09-11 15:49:50.308620] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726040990308616, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:49:50.315321] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726040990315317, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007516, add_bytes: 0 [2024-09-11 15:49:50.330078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:50.368517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:50.368563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:50.368571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:50.368580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:50.530251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:50.568818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:50.568864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:50.568871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:50.568880] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:50.709401] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=118] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:50.730503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:50.769147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:50.769188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:50.769196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:50.769205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:50.935065] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4379, replace_start_pos=1400000, replace_num=100000) [2024-09-11 15:49:50.935117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:50.969439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:50.969483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:50.969491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:50.969500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:51.093054] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:51.135266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:51.169798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:51.169836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:51.169844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:51.169853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:51.316176] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726040991316172, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 15:49:51.322949] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726040991322944, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:49:51.335401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:51.370090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:51.370129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:51.370136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:51.370145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:51.535528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:51.570445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:51.570485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:51.570494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:51.570503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:51.710560] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:51.735716] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:51.770838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:51.770884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:51.770892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:51.770919] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:51.935838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:51.971251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:51.971294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:51.971302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:51.971311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:51.978190] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6846, clean_start_pos=3000000, clean_num=200000) [2024-09-11 15:49:52.093180] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:52.136032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:52.178512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:52.178558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:52.178577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:52.178590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:52.323786] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1726040992323781, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:49:52.330567] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726040992330564, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:49:52.336172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:52.378836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:52.378872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:52.378879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:52.378888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:52.536300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:52.579160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:52.579204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:52.579212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:52.579237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:52.711693] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:52.736429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:52.779445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:52.779488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:52.779510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:52.779517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:52.936554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:52.979753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:52.979798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:52.979805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:52.979815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:53.093363] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:53.141150] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4410, replace_start_pos=1500000, replace_num=100000) [2024-09-11 15:49:53.141195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:53.180120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:53.180163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:53.180171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:53.180180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:53.331406] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726040993331402, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:49:53.338175] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726040993338172, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:49:53.341283] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:53.380478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:53.380517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:53.380525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:53.380534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:53.541406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:53.580786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:53.580831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:53.580839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:53.580848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:53.712840] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:53.741526] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:53.781065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:53.781101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:53.781107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:53.781116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:53.941642] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:53.981408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:53.981453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:53.981461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:53.981471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:53.989333] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7849, clean_start_pos=3200000, clean_num=200000) [2024-09-11 15:49:54.093552] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:54.141759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:54.189660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:54.189706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:54.189714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:54.189725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:54.339019] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726040994339014, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:49:54.341899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:54.345797] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726040994345792, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:49:54.390041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:54.390086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:54.390093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:54.390102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:54.542020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:54.590335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:54.590381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:54.590389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:54.590398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:54.714123] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=110] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:54.742137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:54.790611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:54.790655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:54.790662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:54.790687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:54.942251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:54.990952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:54.990995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:54.991002] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:54.991011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:55.093739] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:55.142363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:55.191308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:55.191353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:55.191361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:55.191370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:55.346445] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3964, replace_start_pos=1600000, replace_num=100000) [2024-09-11 15:49:55.346489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:55.346635] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726040995346632, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:49:55.353397] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726040995353394, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:49:55.391670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:55.391714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:55.391721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:55.391751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:55.546583] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:55.592093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:55.592137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:55.592144] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:55.592153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:55.715372] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:55.746720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:55.792405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:55.792453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:55.792462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:55.792470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:55.946850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:55.992791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:55.992832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:55.992839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:55.992849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:56.001187] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8325, clean_start_pos=3400000, clean_num=200000) [2024-09-11 15:49:56.093868] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:56.146985] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:56.201522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:56.201566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:56.201590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:56.201599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:56.347115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:56.354248] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726040996354244, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:49:56.361007] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726040996361006, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:49:56.401830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:56.401874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:56.401880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:56.401887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:56.547239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:56.602196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:56.602243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:56.602251] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:56.602261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:56.716397] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=125] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:56.747384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:56.802525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:56.802575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:56.802582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:56.802591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:56.947553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:57.002933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:57.002980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:57.003007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:57.003018] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:57.094002] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:57.147688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:57.203333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:57.203379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:57.203387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:57.203397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:57.347816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:57.361861] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726040997361857, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:49:57.368622] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726040997368621, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:49:57.403700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:57.403742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:57.403750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:57.403760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:57.552335] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4386, replace_start_pos=1700000, replace_num=100000) [2024-09-11 15:49:57.552383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:57.604078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:57.604119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:57.604124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:57.604132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:57.717237] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:57.752486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:49:57.804431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:57.804475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:57.804483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:57.804493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:57.952610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:49:58.004798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:58.004842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:58.004850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:58.004859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:58.013402] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8529, clean_start_pos=3600000, clean_num=200000) [2024-09-11 15:49:58.094211] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:58.152797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:49:58.213658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:58.213701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:58.213708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:58.213715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:58.352990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:49:58.369480] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726040998369475, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:49:58.376268] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726040998376265, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 15:49:58.413967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:58.414009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:58.414016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:58.414023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:58.553183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:49:58.614244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:58.614288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:58.614295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:58.614304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:58.718396] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:58.753311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:49:58.814523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:58.814567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:58.814573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:58.814581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:58.953533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:49:59.014872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:59.014938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:59.014948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:59.014958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:59.094413] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:49:59.153721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:49:59.215216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:59.215259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:59.215266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:59.215276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:59.353860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:49:59.377167] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726040999377163, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 15:49:59.383856] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726040999383852, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007587, add_bytes: 0 [2024-09-11 15:49:59.415500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:59.415539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:59.415546] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:59.415554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:59.554088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:49:59.615796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:59.615843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:59.615851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:59.615860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:59.719250] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:49:59.758106] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3896, replace_start_pos=1800000, replace_num=100000) [2024-09-11 15:49:59.758139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:49:59.780734] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:49:59.780818] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=83] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:49:59.780899] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=2, max_check_version=3, global_version=4) [2024-09-11 15:49:59.783030] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 117 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 1 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2129 [2024-09-11 15:49:59.783078] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:49:59.783115] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:49:59.783156] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:49:59.783244] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:49:59.783366] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,679,248 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,679,248 used= 76,265,964 count= 1,548 avg_used= 49,267 mod=SUMMARY [2024-09-11 15:49:59.783420] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,330,400 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,016 used= 242,506 count= 924 avg_used= 262 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,330,400 used= 1,214,055 count= 14,556 avg_used= 83 mod=SUMMARY [2024-09-11 15:49:59.783433] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:49:59.783446] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:49:59.783483] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,699,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 mod=SUMMARY [2024-09-11 15:49:59.783551] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:49:59.783580] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:49:59.816106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:49:59.816166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:49:59.816181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:49:59.816190] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:49:59.958338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:00.016447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:00.016496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:00.016504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:00.016513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:00.024834] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8306, clean_start_pos=3800000, clean_num=200000) [2024-09-11 15:50:00.094536] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:00.158531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:00.225092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:00.225136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:00.225142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:00.225150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:00.358750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:00.384712] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041000384707, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 15:50:00.384770] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:50:00.386958] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=5] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:50:00.389155] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=5] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:50:00.391471] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041000391470, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:50:00.391486] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=15] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:50:00.425393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:00.425441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:00.425448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:00.425456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:00.425635] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=78, refresh_score_time=60, wash_time=0) [2024-09-11 15:50:00.558883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:00.625994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:00.626049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:00.626082] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:00.626093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:00.720022] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:00.759008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:00.826316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:00.826379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:00.826387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:00.826397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:00.959140] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:01.026710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:01.026762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:01.026771] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:01.026781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:01.094662] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:01.159379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:01.227020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:01.227063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:01.227069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:01.227076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:01.359581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:01.392337] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726041001392333, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:50:01.399088] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726041001399085, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:50:01.427310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:01.427347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:01.427353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:01.427361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:01.559776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:01.627656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:01.627698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:01.627705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:01.627713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:01.759898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:01.820989] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:01.827965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:01.828009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:01.828016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:01.828023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:01.963496] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3454, replace_start_pos=1900000, replace_num=100000) [2024-09-11 15:50:01.963550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:02.028262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:02.028305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:02.028313] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:02.028322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:02.036805] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8470, clean_start_pos=4000000, clean_num=200000) [2024-09-11 15:50:02.094841] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:02.163652] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:02.237082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:02.237125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:02.237131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:02.237139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:02.363832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:02.400011] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041002400006, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 15:50:02.406707] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726041002406703, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:50:02.437391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:02.437434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:02.437440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:02.437447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:02.563933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:02.637679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:02.637725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:02.637733] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:02.637742] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:02.764080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:02.821817] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:02.838015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:02.838057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:02.838063] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:02.838086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:02.964294] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:03.038390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:03.038433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:03.038440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:03.038448] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:03.095096] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:03.164483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:03.238758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:03.238808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:03.238817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:03.238827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:03.364613] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:03.407646] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041003407641, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 15:50:03.414329] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041003414326, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:50:03.439049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:03.439084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:03.439091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:03.439114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:03.564804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:03.639383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:03.639440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:03.639448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:03.639458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:03.764995] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:03.823160] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:03.839696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:03.839742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:03.839748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:03.839756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:03.965146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:04.040010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:04.040050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:04.040057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:04.040065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:04.046722] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6644, clean_start_pos=4200000, clean_num=200000) [2024-09-11 15:50:04.095283] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:04.169316] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3981, replace_start_pos=2000000, replace_num=100000) [2024-09-11 15:50:04.169365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:04.247013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:04.247069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:04.247076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:04.247085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:04.369518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:04.415246] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041004415242, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 15:50:04.421955] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041004421950, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:50:04.447288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:04.447330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:04.447336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:04.447343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:04.569712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:04.647592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:04.647635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:04.647643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:04.647652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:04.769926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:04.824292] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:04.847865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:04.847936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:04.847944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:04.847952] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:04.970161] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:05.048176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:05.048213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:05.048219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:05.048226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:05.095489] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:05.170385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:05.248463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:05.248508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:05.248516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:05.248525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:05.370578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:05.422866] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041005422862, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:50:05.429570] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041005429565, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:50:05.448749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:05.448787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:05.448795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:05.448803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:05.570713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:05.649104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:05.649149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:05.649157] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:05.649166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:05.770856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:05.825487] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:05.849471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:05.849517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:05.849525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:05.849535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:05.971050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:06.049857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:06.049928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:06.049939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:06.049948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:06.058454] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8492, clean_start_pos=4400000, clean_num=200000) [2024-09-11 15:50:06.095607] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:06.171180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:06.258713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:06.258757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:06.258765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:06.258775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:06.375750] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4381, replace_start_pos=2100000, replace_num=100000) [2024-09-11 15:50:06.375795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:06.430480] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1726041006430476, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:50:06.437185] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041006437182, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:50:06.459090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:06.459133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:06.459141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:06.459150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:06.575942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:06.659448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:06.659492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:06.659500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:06.659510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:06.776129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:06.826614] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:06.859767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:06.859807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:06.859814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:06.859823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:06.976318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:07.060116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:07.060161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:07.060169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:07.060196] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:07.095780] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:07.176455] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:07.260499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:07.260542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:07.260550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:07.260559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:07.376657] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:07.438088] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041007438084, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:50:07.444784] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041007444781, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 15:50:07.460801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:07.460835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:07.460844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:07.460852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:07.576846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:07.661180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:07.661224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:07.661233] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:07.661266] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:07.777031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:07.827731] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:07.861505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:07.861548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:07.861570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:07.861578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:07.977189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:08.061877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:08.061947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:08.061956] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:08.061965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:08.070601] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8621, clean_start_pos=4600000, clean_num=200000) [2024-09-11 15:50:08.095962] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:08.177382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:08.270965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:08.271011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:08.271019] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:08.271028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:08.377571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:08.445715] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041008445711, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:50:08.452402] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041008452398, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:50:08.471339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:08.471380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:08.471388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:08.471397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:08.581802] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4087, replace_start_pos=2200000, replace_num=100000) [2024-09-11 15:50:08.581847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:08.671612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:08.671650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:08.671656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:08.671663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:08.781949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:08.828780] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:08.871929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:08.871973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:08.871981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:08.871990] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:08.982157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:09.072223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:09.072267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:09.072274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:09.072283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:09.096183] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:09.182353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:09.272516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:09.272555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:09.272563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:09.272572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:09.382585] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:09.453330] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041009453326, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:50:09.460027] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1726041009460024, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:50:09.472856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:09.472895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:09.472922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:09.472931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:09.582781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:09.673245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:09.673314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:09.673323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:09.673333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:09.782920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:09.797501] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:09.797551] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:09.797634] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=3, max_check_version=4, global_version=5) [2024-09-11 15:50:09.799608] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 117 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 1 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1973 [2024-09-11 15:50:09.799641] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:09.799674] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:50:09.799708] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:50:09.799785] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:09.799889] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,687,136 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,687,136 used= 76,273,652 count= 1,549 avg_used= 49,240 mod=SUMMARY [2024-09-11 15:50:09.799959] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,330,400 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,016 used= 242,506 count= 924 avg_used= 262 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,330,400 used= 1,214,055 count= 14,556 avg_used= 83 mod=SUMMARY [2024-09-11 15:50:09.799971] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:50:09.799981] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:50:09.800017] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,699,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 mod=SUMMARY [2024-09-11 15:50:09.800070] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:50:09.800088] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:50:09.830066] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:09.873634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:09.873679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:09.873688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:09.873698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:09.983152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:10.074061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:10.074100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:10.074107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:10.074117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:10.082644] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8512, clean_start_pos=4800000, clean_num=200000) [2024-09-11 15:50:10.096383] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:10.183275] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:10.282975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:10.283021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:10.283029] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:10.283061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:10.383473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:10.460949] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041010460945, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:50:10.467636] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041010467633, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:50:10.483275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:10.483312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:10.483319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:10.483326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:10.583659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:10.683554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:10.683594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:10.683602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:10.683611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:10.787146] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3362, replace_start_pos=2300000, replace_num=100000) [2024-09-11 15:50:10.787195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:10.833434] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=2082] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:10.883856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:10.883900] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:10.883927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:10.883936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:10.987344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:11.084171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:11.084230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:11.084238] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:11.084248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:11.096523] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:11.187472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:11.284485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:11.284534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:11.284545] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:11.284558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:11.387663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:11.468607] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041011468603, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007658, add_bytes: 0 [2024-09-11 15:50:11.475269] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041011475265, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 15:50:11.484884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:11.484948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:11.484955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:11.484964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:11.587787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:11.685182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:11.685245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:11.685251] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:11.685259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:11.787994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:11.834757] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:11.885559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:11.885600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:11.885607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:11.885615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:11.988219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:12.085942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:12.085990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:12.085998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:12.086008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:12.094200] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8180, clean_start_pos=5000000, clean_num=200000) [2024-09-11 15:50:12.096706] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:12.188351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:12.294452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:12.294495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:12.294503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:12.294512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:12.388468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:12.476179] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041012476176, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007573, add_bytes: 0 [2024-09-11 15:50:12.482934] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041012482931, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 15:50:12.494835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:12.494876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:12.494884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:12.494893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:12.588592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:12.695214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:12.695259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:12.695268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:12.695278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:12.788767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:12.836157] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:12.895609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:12.895655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:12.895663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:12.895673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:12.993017] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4116, replace_start_pos=2400000, replace_num=100000) [2024-09-11 15:50:12.993061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:13.096018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:13.096063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:13.096071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:13.096080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:13.096876] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:13.193217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:13.296322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:13.296361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:13.296369] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:13.296377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:13.393359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:13.483785] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041013483780, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:50:13.490487] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041013490484, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:50:13.496687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:13.496722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:13.496730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:13.496739] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:13.593550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:13.697016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:13.697060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:13.697068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:13.697077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:13.793693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:13.837402] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:13.897331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:13.897377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:13.897401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:13.897410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:13.993899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:14.097030] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:14.097733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:14.097768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:14.097776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:14.097786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:14.106012] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8213, clean_start_pos=5200000, clean_num=200000) [2024-09-11 15:50:14.194111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:14.306307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:14.306353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:14.306360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:14.306370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:14.394338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:14.491337] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041014491332, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:50:14.498170] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041014498167, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 15:50:14.506578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:14.506623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:14.506629] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:14.506637] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:14.594533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:14.706879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:14.706945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:14.706953] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:14.706962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:14.794729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:14.838784] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:14.907170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:14.907214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:14.907220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:14.907227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:14.994933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:15.097147] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:15.107438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:15.107468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:15.107475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:15.107486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:15.199379] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4251, replace_start_pos=2500000, replace_num=100000) [2024-09-11 15:50:15.199421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:15.307709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:15.307752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:15.307758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:15.307766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:15.399585] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:15.498993] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041015498989, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 15:50:15.505728] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041015505725, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:50:15.508033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:15.508075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:15.508081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:15.508090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:15.599778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:15.708419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:15.708472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:15.708482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:15.708492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:15.799970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:15.840323] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:15.908741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:15.908785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:15.908791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:15.908799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:16.000130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:16.097264] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:16.109102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:16.109146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:16.109154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:16.109163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:16.117687] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8510, clean_start_pos=5400000, clean_num=200000) [2024-09-11 15:50:16.200344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:16.318029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:16.318081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:16.318087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:16.318095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:16.400488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:16.506632] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041016506628, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 15:50:16.513331] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726041016513326, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 15:50:16.518315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:16.518352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:16.518358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:16.518365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:16.600679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:16.718585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:16.718626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:16.718633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:16.718640] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:16.800799] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:16.841696] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:16.918859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:16.918926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:16.918933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:16.918941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:17.000971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:17.097450] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:17.119157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:17.119200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:17.119216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:17.119224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:17.201160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:17.319459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:17.319498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:17.319506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:17.319515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:17.405639] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4285, replace_start_pos=2600000, replace_num=100000) [2024-09-11 15:50:17.405682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:17.514255] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041017514251, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:50:17.519762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:17.519794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:17.519801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:17.519809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:17.520943] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041017520940, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:50:17.605857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:17.720083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:17.720136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:17.720144] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:17.720153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:17.806065] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:17.842887] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:17.920390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:17.920434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:17.920442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:17.920451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:18.006217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:18.097569] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:18.120743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:18.120781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:18.120806] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:18.120817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:18.128415] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7583, clean_start_pos=5600000, clean_num=200000) [2024-09-11 15:50:18.206352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:18.328754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:18.328799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:18.328807] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:18.328817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:18.406482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:18.521798] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041018521793, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 15:50:18.528564] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041018528563, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:50:18.529073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:18.529104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:18.529111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:18.529121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:18.606606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:18.729355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:18.729416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:18.729424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:18.729433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:18.806752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:18.844138] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=100] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:18.929660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:18.929702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:18.929709] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:18.929717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:19.006895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:19.097691] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:19.130049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:19.130101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:19.130109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:19.130118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:19.207035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:19.330348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:19.330393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:19.330401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:19.330410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:19.407249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:19.529422] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041019529417, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:50:19.530697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:19.530730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:19.530737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:19.530746] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:19.536205] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726041019536201, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 15:50:19.611507] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4054, replace_start_pos=2700000, replace_num=100000) [2024-09-11 15:50:19.611555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:19.731013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:19.731052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:19.731059] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:19.731069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:19.811720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:19.814045] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:19.814084] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:19.814164] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=4, max_check_version=5, global_version=6) [2024-09-11 15:50:19.816232] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 117 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 1 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2067 [2024-09-11 15:50:19.816286] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=40] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:19.816321] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:50:19.816359] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:50:19.816449] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:19.816568] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,687,136 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,687,136 used= 76,273,652 count= 1,549 avg_used= 49,240 mod=SUMMARY [2024-09-11 15:50:19.816624] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,330,400 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,016 used= 242,506 count= 924 avg_used= 262 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,330,400 used= 1,214,055 count= 14,556 avg_used= 83 mod=SUMMARY [2024-09-11 15:50:19.816636] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:50:19.816647] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:50:19.816682] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,699,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 mod=SUMMARY [2024-09-11 15:50:19.816742] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:50:19.816767] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:50:19.845336] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:19.931387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:19.931437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:19.931445] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:19.931465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:20.011944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=79] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:20.097881] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:20.131712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:20.131759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:20.131766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:20.131773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:20.139628] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7842, clean_start_pos=5800000, clean_num=200000) [2024-09-11 15:50:20.212090] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:20.339934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:20.339975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:20.339983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:20.339993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:20.340177] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | [2024-09-11 15:50:20.412231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:20.537032] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=85] PNIO [ratelimit] time: 1726041020537029, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:50:20.540777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:20.540826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:20.540832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:20.540839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:20.543799] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041020543797, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 15:50:20.612415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:20.741065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:20.741113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:20.741120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:20.741129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:20.741344] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=82, refresh_score_time=63, wash_time=0) [2024-09-11 15:50:20.812554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:20.846135] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:20.941566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:20.941609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:20.941615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:20.941623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:21.012683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:21.098086] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:21.141870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:21.141922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:21.141929] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:21.141936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:21.212869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:21.342170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:21.342213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:21.342219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:21.342227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:21.413116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=87] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:21.542504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:21.542550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:21.542557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:21.542566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:21.544645] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041021544643, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:50:21.551483] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041021551479, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:50:21.613324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:21.740994] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e05100 fd=94 [2024-09-11 15:50:21.741037] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4816 [2024-09-11 15:50:21.741066] INFO acceptfd_handle_first_readable_event (handle-event.c:411) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] auth mothod is NONE, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4816 [2024-09-11 15:50:21.741074] INFO dispatch_accept_fd_to_certain_group (group.c:696) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] PNIO dispatch fd to certain group, fd:94, gid:0x100000000 [2024-09-11 15:50:21.741143] INFO pkts_sk_init (pkts_sk_factory.h:23) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO set pkts_sk_t sock_id s=0x7f5288a04808, s->id=65535 [2024-09-11 15:50:21.741171] INFO pkts_sk_new (pkts_sk_factory.h:51) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO sk_new: s=0x7f5288a04808 [2024-09-11 15:50:21.741190] INFO eloop_regist (eloop.c:47) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO sock regist: 0x7f5288a04808 fd=94 [2024-09-11 15:50:21.741213] INFO on_accept (listenfd.c:39) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO accept new connection, ns=0x7f5288a04808, fd=fd:94:local:"10.31.35.6:4816":remote:"10.31.35.6:4816" [2024-09-11 15:50:21.741261] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=5][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:920595803, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599999904, timestamp:1726041021737735, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14266, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041021483983}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041021741257, enqueue_timestamp_:0, request_arrival_time_:1726041021741257, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:21.741299] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:602) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=37][errcode=-8002] can't deliver request(req={packet:{hdr_:{checksum_:920595803, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599999904, timestamp:1726041021737735, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14266, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041021483983}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041021741257, enqueue_timestamp_:0, request_arrival_time_:1726041021741257, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:21.741389] WDIAG [SERVER] deliver (ob_srv_deliver.cpp:766) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=14][errcode=-8002] deliver rpc request fail(&req=0x7f527ea04098, ret=-8002) [2024-09-11 15:50:21.741400] WDIAG listenfd_handle_event (listenfd.c:71) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] PNIO do_accept failed, err=11, errno=11, fd=-1 [2024-09-11 15:50:21.742799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:21.742828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:21.742836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:21.742845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:21.744024] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e05100 fd=95 [2024-09-11 15:50:21.744043] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] [ussl] accept new connection, fd:95, src_addr:10.31.35.6:4820 [2024-09-11 15:50:21.744063] INFO acceptfd_handle_first_readable_event (handle-event.c:411) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] auth mothod is NONE, the fd will be dispatched, fd:95, src_addr:10.31.35.6:4820 [2024-09-11 15:50:21.744079] INFO dispatch_accept_fd_to_certain_group (group.c:696) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] PNIO dispatch fd to certain group, fd:95, gid:0x100000001 [2024-09-11 15:50:21.744112] INFO pkts_sk_init (pkts_sk_factory.h:23) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO set pkts_sk_t sock_id s=0x7f5288a05218, s->id=65535 [2024-09-11 15:50:21.744127] INFO pkts_sk_new (pkts_sk_factory.h:51) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO sk_new: s=0x7f5288a05218 [2024-09-11 15:50:21.744146] INFO eloop_regist (eloop.c:47) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO sock regist: 0x7f5288a05218 fd=95 [2024-09-11 15:50:21.744156] INFO on_accept (listenfd.c:39) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=5] PNIO accept new connection, ns=0x7f5288a05218, fd=fd:95:local:"10.31.35.6:4820":remote:"10.31.35.6:4820" [2024-09-11 15:50:21.744199] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=4][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:1749923562, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599996072, timestamp:1726041021741546, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14267, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041021741035}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041021744197, enqueue_timestamp_:0, request_arrival_time_:1726041021744197, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:21.744254] WDIAG listenfd_handle_event (listenfd.c:71) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] PNIO do_accept failed, err=11, errno=11, fd=-1 [2024-09-11 15:50:21.767956] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=96 [2024-09-11 15:50:21.767997] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:96, src_addr:10.31.35.6:4826 [2024-09-11 15:50:21.768023] INFO acceptfd_handle_first_readable_event (handle-event.c:411) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] auth mothod is NONE, the fd will be dispatched, fd:96, src_addr:10.31.35.6:4826 [2024-09-11 15:50:21.768031] INFO dispatch_accept_fd_to_certain_group (group.c:696) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] PNIO dispatch fd to certain group, fd:96, gid:0x100000002 [2024-09-11 15:50:21.768093] INFO pkts_sk_init (pkts_sk_factory.h:23) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO set pkts_sk_t sock_id s=0x7f5288a62048, s->id=65535 [2024-09-11 15:50:21.768117] INFO pkts_sk_new (pkts_sk_factory.h:51) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO sk_new: s=0x7f5288a62048 [2024-09-11 15:50:21.768130] INFO eloop_regist (eloop.c:47) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=5] PNIO sock regist: 0x7f5288a62048 fd=96 [2024-09-11 15:50:21.768138] INFO on_accept (listenfd.c:39) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=5] PNIO accept new connection, ns=0x7f5288a62048, fd=fd:96:local:"10.31.35.6:4826":remote:"10.31.35.6:4826" [2024-09-11 15:50:21.768180] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=4][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:819595274, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599972681, timestamp:1726041021764936, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14268, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041021743803}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041021768177, enqueue_timestamp_:0, request_arrival_time_:1726041021768177, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:21.768255] WDIAG listenfd_handle_event (listenfd.c:71) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=37][errcode=0] PNIO do_accept failed, err=11, errno=11, fd=-1 [2024-09-11 15:50:21.796510] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=6][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:3876879610, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599942259, timestamp:1726041021795360, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14269, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041021767479}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041021796505, enqueue_timestamp_:0, request_arrival_time_:1726041021796505, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:21.817899] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4382, replace_start_pos=2800000, replace_num=100000) [2024-09-11 15:50:21.817969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:21.846928] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:21.856863] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=6][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:150009819, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599881837, timestamp:1726041021855785, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14270, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041021796310}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041021856858, enqueue_timestamp_:0, request_arrival_time_:1726041021856858, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:21.919356] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=97 [2024-09-11 15:50:21.919494] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=125] [ussl] accept new connection, fd:97, src_addr:10.31.35.6:4832 [2024-09-11 15:50:21.943071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:21.943112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:21.943118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:21.943126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:21.957721] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=5][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:1676504025, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599780974, timestamp:1726041021956648, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14271, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041021856060}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041021957716, enqueue_timestamp_:0, request_arrival_time_:1726041021957716, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.018124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:22.058985] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=66][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2464873870, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599679734, timestamp:1726041022057887, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14274, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041021987361}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041022058980, enqueue_timestamp_:0, request_arrival_time_:1726041022058980, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.098208] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:22.117463] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] [ussl] recv non-negotiation message, the fd will be dispatched, fd:97, src_addr:10.31.35.6:4832, magic:0x78563412 [2024-09-11 15:50:22.117505] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:97 [2024-09-11 15:50:22.117512] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:97, ret:0 [2024-09-11 15:50:22.143343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:22.143385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:22.143390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:22.143398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:22.153337] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9927, clean_start_pos=6000000, clean_num=200000) [2024-09-11 15:50:22.160024] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=66][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:3405598779, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599578714, timestamp:1726041022158908, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14275, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041022058408}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041022160019, enqueue_timestamp_:0, request_arrival_time_:1726041022160019, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.218340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:22.270837] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=56][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:855209681, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599467863, timestamp:1726041022269762, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14277, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041022208747}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041022270830, enqueue_timestamp_:0, request_arrival_time_:1726041022270830, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.353642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:22.353689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:22.353697] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:22.353706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:22.381809] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=76][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:1067889138, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599356979, timestamp:1726041022380644, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14278, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041022270743}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041022381804, enqueue_timestamp_:0, request_arrival_time_:1726041022381804, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.418546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:22.492598] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=76][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:1006312275, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599246168, timestamp:1726041022491452, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14282, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041022480676}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041022492593, enqueue_timestamp_:0, request_arrival_time_:1726041022492593, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.519498] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=97 [2024-09-11 15:50:22.519541] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:97, src_addr:10.31.35.6:4842 [2024-09-11 15:50:22.552332] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726041022552327, bytes: 2772, bw: 0.002623 MB/s, add_ts: 1007684, add_bytes: 2772 [2024-09-11 15:50:22.553987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:22.554016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:22.554023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:22.554032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:22.559023] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041022559021, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 15:50:22.603336] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=56][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:1031632639, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599135376, timestamp:1726041022602247, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14283, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041022492478}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041022603332, enqueue_timestamp_:0, request_arrival_time_:1726041022603332, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.618682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:22.704143] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=46][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2457109519, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:599034634, timestamp:1726041022702991, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14284, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041022602970}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041022704138, enqueue_timestamp_:0, request_arrival_time_:1726041022704138, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.717821] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:97, src_addr:10.31.35.6:4842, magic:0x78563412 [2024-09-11 15:50:22.717861] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:97 [2024-09-11 15:50:22.717868] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:97, ret:0 [2024-09-11 15:50:22.754278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:22.754322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:22.754329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:22.754338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:22.804855] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=75][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:3137264090, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598933852, timestamp:1726041022803772, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14285, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041022703865}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041022804851, enqueue_timestamp_:0, request_arrival_time_:1726041022804851, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.818820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:22.847721] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:22.909135] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=61][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:3165603862, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598829585, timestamp:1726041022908039, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14286, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041022804286}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041022909129, enqueue_timestamp_:0, request_arrival_time_:1726041022909129, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:22.954572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:22.954618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:22.954626] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:22.954636] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:23.010482] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=62][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:955440441, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598728223, timestamp:1726041023009400, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14289, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041022987467}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023010477, enqueue_timestamp_:0, request_arrival_time_:1726041023010477, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.019009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:23.098422] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:23.111217] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=76][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2253355622, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598627489, timestamp:1726041023110134, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14290, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023009974}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023111212, enqueue_timestamp_:0, request_arrival_time_:1726041023111212, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.119381] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=97 [2024-09-11 15:50:23.119422] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:97, src_addr:10.31.35.6:4844 [2024-09-11 15:50:23.154976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:23.155018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:23.155026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:23.155035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:23.219147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:23.222048] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=63][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2127820327, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598516645, timestamp:1726041023220978, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14292, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023144951}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023222043, enqueue_timestamp_:0, request_arrival_time_:1726041023222043, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.318082] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:97, src_addr:10.31.35.6:4844, magic:0x78563412 [2024-09-11 15:50:23.318132] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:97 [2024-09-11 15:50:23.318157] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25][errcode=0] [ussl] dispatch fd to default group failed, fd:97, ret:0 [2024-09-11 15:50:23.333036] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=60][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:3860723325, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598405651, timestamp:1726041023331971, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14293, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023221596}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023333032, enqueue_timestamp_:0, request_arrival_time_:1726041023333032, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.355240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:23.355279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:23.355285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:23.355293] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:23.419340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:23.433837] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=54][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2089715204, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598304849, timestamp:1726041023432773, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14295, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023422704}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023433832, enqueue_timestamp_:0, request_arrival_time_:1726041023433832, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.534649] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=79][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:4216236156, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598204059, timestamp:1726041023533565, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14298, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023480907}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023534644, enqueue_timestamp_:0, request_arrival_time_:1726041023534644, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.555522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:23.555577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:23.555585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:23.555594] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:23.559965] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726041023559963, bytes: 5292, bw: 0.002385 MB/s, add_ts: 1007636, add_bytes: 2520 [2024-09-11 15:50:23.566660] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041023566657, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 15:50:23.619537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:23.635477] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=28][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:4218520619, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598103320, timestamp:1726041023634304, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14299, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023534496}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023635473, enqueue_timestamp_:0, request_arrival_time_:1726041023635473, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.720094] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=97 [2024-09-11 15:50:23.720135] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:97, src_addr:10.31.35.6:4856 [2024-09-11 15:50:23.736583] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=73][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2777391899, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:598002633, timestamp:1726041023734990, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14300, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023635233}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023736577, enqueue_timestamp_:0, request_arrival_time_:1726041023736577, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.755832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:23.755880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:23.755888] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:23.755898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:23.819801] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:23.836855] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=71][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:3520798378, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:597901850, timestamp:1726041023835772, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14302, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023811334}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023836850, enqueue_timestamp_:0, request_arrival_time_:1726041023836850, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.848577] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:23.918532] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:97, src_addr:10.31.35.6:4856, magic:0x78563412 [2024-09-11 15:50:23.918569] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:97 [2024-09-11 15:50:23.918575] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:97, ret:0 [2024-09-11 15:50:23.937695] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=69][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:442032571, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:597801095, timestamp:1726041023936527, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14303, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023836706}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041023937691, enqueue_timestamp_:0, request_arrival_time_:1726041023937691, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:23.956173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:23.956219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:23.956227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:23.956236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:24.023779] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3783, replace_start_pos=2900000, replace_num=100000) [2024-09-11 15:50:24.023828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:24.038416] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=68][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2652369581, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:597700330, timestamp:1726041024037292, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14306, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041023984295}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041024038411, enqueue_timestamp_:0, request_arrival_time_:1726041024038411, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:24.098612] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:24.139243] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=51][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:1746579493, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:597599545, timestamp:1726041024138079, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14307, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041024037934}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041024139238, enqueue_timestamp_:0, request_arrival_time_:1726041024139238, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:24.156542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:24.156588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:24.156602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:24.156648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:24.165273] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8606, clean_start_pos=6200000, clean_num=200000) [2024-09-11 15:50:24.223923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:24.240852] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=51][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2439631477, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:597497839, timestamp:1726041024239782, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14309, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041024209237}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041024240848, enqueue_timestamp_:0, request_arrival_time_:1726041024240848, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:24.319966] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=97 [2024-09-11 15:50:24.320007] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:97, src_addr:10.31.35.6:4870 [2024-09-11 15:50:24.351793] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=63][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:3703508815, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:597386898, timestamp:1726041024350725, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14310, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041024240720}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041024351788, enqueue_timestamp_:0, request_arrival_time_:1726041024351788, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:24.365537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:24.365582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:24.365589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:24.365599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:24.424116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:24.462760] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=65][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2807848859, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:597276009, timestamp:1726041024461614, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14312, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041024422498}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041024462754, enqueue_timestamp_:0, request_arrival_time_:1726041024462754, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:24.517879] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:97, src_addr:10.31.35.6:4870, magic:0x78563412 [2024-09-11 15:50:24.517930] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:97 [2024-09-11 15:50:24.517938] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:97, ret:0 [2024-09-11 15:50:24.563513] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=58][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:185262740, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:597175236, timestamp:1726041024562385, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14315, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041024487435}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041024563509, enqueue_timestamp_:0, request_arrival_time_:1726041024563509, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:24.566007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:24.566030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:24.566037] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:24.566045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:24.567558] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=74] PNIO [ratelimit] time: 1726041024567556, bytes: 7812, bw: 0.002385 MB/s, add_ts: 1007593, add_bytes: 2520 [2024-09-11 15:50:24.574263] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041024574260, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:50:24.624237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:24.664293] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74255][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=60][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:2276247697, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:597074468, timestamp:1726041024663156, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14316, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041024562878}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041024664288, enqueue_timestamp_:0, request_arrival_time_:1726041024664288, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:24.765125] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74253][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=42][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:680684762, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:596973576, timestamp:1726041024764047, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14317, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041024663971}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041024765120, enqueue_timestamp_:0, request_arrival_time_:1726041024765120, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:24.766261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:24.766290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:24.766297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:24.766304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:24.824426] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:24.849366] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:24.865944] WDIAG [SERVER] deliver_rpc_request (ob_srv_deliver.cpp:530) [74254][pnio1][T0][YB420A1F2306-000621D2D95384B4-0-0] [lt=56][errcode=-8002] receive request when server is stopping(req={packet:{hdr_:{checksum_:572073213, pcode_:259, hlen_:184, priority_:5, flags_:6215, tenant_id_:1, priv_tenant_id_:0, session_id_:0, trace_id_:12378265559814, timeout_:596872811, timestamp:1726041024864811, dst_cluster_id:-1, cost_time:{len:40, arrival_push_diff:0, push_pop_diff:0, pop_process_start_diff:0, process_start_end_diff:0, process_end_response_diff:0, packet_id:14318, request_arrival_time:0}, compressor_type_:0, original_len_:0, src_cluster_id_:1719994443, seq_no_:1726041024765100}, chid_:0, clen_:52, assemble:false, msg_count:0, payload:0}, type:0, group:0, sql_req_level:0, connection_phase:0, recv_timestamp_:1726041024865940, enqueue_timestamp_:0, request_arrival_time_:1726041024865940, trace_id_:Y0-0000000000000000-0-0}, ret=-8002) [2024-09-11 15:50:24.920371] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=97 [2024-09-11 15:50:24.920424] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:97, src_addr:10.31.35.6:4872 [2024-09-11 15:50:24.966509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:24.966569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:24.966575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:24.966583] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:25.024706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:25.098811] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:25.118540] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:97, src_addr:10.31.35.6:4872, magic:0x78563412 [2024-09-11 15:50:25.118577] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:97 [2024-09-11 15:50:25.118583] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:97, ret:0 [2024-09-11 15:50:25.166799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:25.166840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:25.166846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:25.166854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:25.224931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:25.367064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:25.367107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:25.367113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:25.367121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:25.425128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:25.520778] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=97 [2024-09-11 15:50:25.520820] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:97, src_addr:10.31.35.6:7140 [2024-09-11 15:50:25.567466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:25.567510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:25.567516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:25.567524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:25.575109] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726041025575106, bytes: 8568, bw: 0.000716 MB/s, add_ts: 1007550, add_bytes: 756 [2024-09-11 15:50:25.581885] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041025581881, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:50:25.625300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:25.718961] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:97, src_addr:10.31.35.6:7140, magic:0x78563412 [2024-09-11 15:50:25.719018] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:97 [2024-09-11 15:50:25.719025] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:97, ret:0 [2024-09-11 15:50:25.748723] WDIAG pkts_sk_consume (handle_io.t.h:66) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43][errcode=0] PNIO do_decode fail: 61 [2024-09-11 15:50:25.748771] INFO eloop_handle_sock_event (eloop.c:111) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO sock destroy: sock=0x7f5288a04808, connection=fd:94:local:"10.31.35.6:4816":remote:"10.31.35.6:4816", err=61 [2024-09-11 15:50:25.748833] INFO pkts_sk_delete (pkts_sk_factory.h:57) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO sk_destroy: s=0x7f5288a04808 io=0x7f5288604448 [2024-09-11 15:50:25.759026] WDIAG pkts_sk_consume (handle_io.t.h:66) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=51][errcode=0] PNIO do_decode fail: 61 [2024-09-11 15:50:25.759066] INFO eloop_handle_sock_event (eloop.c:111) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO sock destroy: sock=0x7f5288a05218, connection=fd:95:local:"10.31.35.6:4820":remote:"10.31.35.6:4820", err=61 [2024-09-11 15:50:25.759116] INFO pkts_sk_delete (pkts_sk_factory.h:57) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO sk_destroy: s=0x7f5288a05218 io=0x7f5288204448 [2024-09-11 15:50:25.761263] WDIAG pkts_sk_consume (handle_io.t.h:66) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=56][errcode=0] PNIO do_decode fail: 61 [2024-09-11 15:50:25.761312] INFO eloop_handle_sock_event (eloop.c:111) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO sock destroy: sock=0x7f5288a62048, connection=fd:96:local:"10.31.35.6:4826":remote:"10.31.35.6:4826", err=61 [2024-09-11 15:50:25.761351] INFO pkts_sk_delete (pkts_sk_factory.h:57) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO sk_destroy: s=0x7f5288a62048 io=0x7f5287c04448 [2024-09-11 15:50:25.767733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:25.767763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:25.767769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:25.767777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:25.825438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:25.850151] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:25.968084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:25.968133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:25.968140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:25.968148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:26.025578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:26.098936] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:26.121250] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:26.121294] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7142 [2024-09-11 15:50:26.168356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:26.168387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:26.168394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:26.168401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:26.174959] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6547, clean_start_pos=6400000, clean_num=200000) [2024-09-11 15:50:26.230084] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4368, replace_start_pos=3000000, replace_num=100000) [2024-09-11 15:50:26.230131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:26.319358] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7142, magic:0x78563412 [2024-09-11 15:50:26.319396] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:26.319404] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:26.375181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:26.375211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:26.375216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:26.375224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:26.430299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:26.575520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:26.575562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:26.575569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:26.575577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:26.582803] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041026582799, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 15:50:26.589505] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041026589501, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:50:26.630551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:26.721692] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:26.721736] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7156 [2024-09-11 15:50:26.775798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:26.775865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:26.775898] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:26.775929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:26.830773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:26.850939] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:26.919759] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7156, magic:0x78563412 [2024-09-11 15:50:26.919815] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:26.919824] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:26.976159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:26.976202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:26.976209] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:26.976216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:27.030988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:27.099068] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:27.176430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:27.176468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:27.176475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:27.176482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:27.231178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:27.321843] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:27.321883] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7160 [2024-09-11 15:50:27.376719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:27.376771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:27.376778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:27.376837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:27.431321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:27.520308] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7160, magic:0x78563412 [2024-09-11 15:50:27.520352] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:27.520359] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:27.577087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:27.577131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:27.577137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:27.577146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:27.590416] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041027590412, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:50:27.597113] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041027597109, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:50:27.631459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:27.777357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:27.777400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:27.777407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:27.777415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:27.831656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:27.852239] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:27.922013] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:27.922069] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7164 [2024-09-11 15:50:27.977640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:27.977687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:27.977693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:27.977715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:28.031803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:28.099185] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:28.120617] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7164, magic:0x78563412 [2024-09-11 15:50:28.120662] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:28.120670] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:28.178069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:28.178105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:28.178111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:28.178119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:28.184706] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6574, clean_start_pos=6600000, clean_num=200000) [2024-09-11 15:50:28.231927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:28.384992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:28.385025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:28.385032] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:28.385041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:28.436379] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4333, replace_start_pos=3100000, replace_num=100000) [2024-09-11 15:50:28.436425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:28.522382] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:28.522430] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7170 [2024-09-11 15:50:28.585416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:28.585465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:28.585473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:28.585482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:28.598035] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041028598030, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:50:28.604731] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041028604728, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:50:28.636534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:28.721085] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7170, magic:0x78563412 [2024-09-11 15:50:28.721120] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:28.721127] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:28.785793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:28.785841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:28.785849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:28.785857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:28.836716] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:28.853695] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:28.986095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:28.986139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:28.986147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:28.986157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:29.036852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:29.099367] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:29.122896] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:29.122969] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=67] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7182 [2024-09-11 15:50:29.186400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:29.186446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:29.186454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:29.186463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:29.236999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:29.321477] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7182, magic:0x78563412 [2024-09-11 15:50:29.321515] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:29.321523] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:29.386697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:29.386740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:29.386747] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:29.386755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:29.437117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:29.587009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:29.587049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:29.587071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:29.587079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:29.605658] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041029605653, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:50:29.612401] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041029612397, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 15:50:29.637246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:29.723611] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:29.723642] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7186 [2024-09-11 15:50:29.787295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:29.787330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:29.787336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:29.787344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:29.831620] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:29.831683] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=61] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:29.831762] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] update_check_range(min_check_version=5, max_check_version=6, global_version=7) [2024-09-11 15:50:29.833646] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1882 [2024-09-11 15:50:29.833700] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:29.833733] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:50:29.833768] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:50:29.833846] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:29.833961] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:50:29.834018] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:50:29.834028] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:50:29.834038] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:50:29.834071] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:50:29.834124] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:50:29.834145] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:50:29.837371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:29.855093] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:29.922151] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7186, magic:0x78563412 [2024-09-11 15:50:29.922213] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:29.922220] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:29.987575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:29.987617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:29.987623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:29.987630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:30.037549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:30.099482] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:30.187874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:30.187947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:30.187957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:30.187966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:30.196127] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8149, clean_start_pos=6800000, clean_num=200000) [2024-09-11 15:50:30.237742] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:30.324552] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:30.324595] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7198 [2024-09-11 15:50:30.396446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:30.396493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:30.396502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:30.396533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:30.437871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:30.522839] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7198, magic:0x78563412 [2024-09-11 15:50:30.522876] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:30.522882] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:30.596780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:30.596828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:30.596835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:30.596843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:30.613263] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041030613258, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:50:30.619963] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041030619958, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:50:30.642394] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4378, replace_start_pos=3200000, replace_num=100000) [2024-09-11 15:50:30.642444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:30.797096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:30.797143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:30.797152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:30.797163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:30.842530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:30.856339] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:30.923732] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:30.923775] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7212 [2024-09-11 15:50:30.997486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:30.997524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:30.997546] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:30.997554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:31.042651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:31.099615] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:31.122469] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7212, magic:0x78563412 [2024-09-11 15:50:31.122513] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:31.122521] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:31.197870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:31.197933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:31.197941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:31.197948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:31.242774] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:31.398273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:31.398324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:31.398333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:31.398343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:31.442965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:31.524354] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:31.524410] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7216 [2024-09-11 15:50:31.598565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:31.598614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:31.598621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:31.598630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:31.620811] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041031620807, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:50:31.627574] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041031627570, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:50:31.643165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:31.722750] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7216, magic:0x78563412 [2024-09-11 15:50:31.722794] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:31.722802] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:31.798853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:31.798899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:31.798922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:31.798930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:31.843369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:31.857303] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:31.999151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:31.999189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:31.999196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:31.999203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:32.043524] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:32.099731] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:32.127158] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:32.127186] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7218 [2024-09-11 15:50:32.199418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:32.199459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:32.199465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:32.199472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:32.205989] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6505, clean_start_pos=7000000, clean_num=200000) [2024-09-11 15:50:32.243717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:32.321982] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7218, magic:0x78563412 [2024-09-11 15:50:32.322017] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:32.322025] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:32.406265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:32.406313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:32.406320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:32.406328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:32.443927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:32.606578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:32.606630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:32.606657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:32.606667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:32.628428] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041032628423, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:50:32.635206] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041032635201, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:50:32.644119] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:32.724042] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:32.724087] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7226 [2024-09-11 15:50:32.806991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:32.807037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:32.807045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:32.807054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:32.848414] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4173, replace_start_pos=3300000, replace_num=100000) [2024-09-11 15:50:32.848461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:32.858163] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:32.921469] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7226, magic:0x78563412 [2024-09-11 15:50:32.921513] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:32.921521] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:33.007289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:33.007332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:33.007338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:33.007346] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:33.048546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:33.099981] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:33.207585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:33.207629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:33.207636] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:33.207645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:33.248655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:33.323786] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:33.323826] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7242 [2024-09-11 15:50:33.407879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:33.407938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:33.407947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:33.407956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:33.448762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:33.521958] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7242, magic:0x78563412 [2024-09-11 15:50:33.521996] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:33.522003] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:33.608185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:33.608225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:33.608232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:33.608239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:33.636063] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041033636059, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 15:50:33.642817] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041033642815, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:50:33.648876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:33.808559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:33.808608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:33.808617] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:33.808628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:33.848986] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:33.859514] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:33.923967] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:33.924012] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7250 [2024-09-11 15:50:34.008849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:34.008889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:34.008895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:34.008918] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:34.049185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:34.100181] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:34.122438] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7250, magic:0x78563412 [2024-09-11 15:50:34.122479] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:34.122487] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:34.209207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:34.209250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:34.209257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:34.209283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:34.216554] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7258, clean_start_pos=7200000, clean_num=200000) [2024-09-11 15:50:34.249375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:34.416760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:34.416805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:34.416812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:34.416821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:34.449503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:34.524417] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:34.524451] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7254 [2024-09-11 15:50:34.617052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:34.617088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:34.617095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:34.617103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:34.643726] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041034643723, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 15:50:34.649627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:34.650418] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041034650415, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 15:50:34.722784] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7254, magic:0x78563412 [2024-09-11 15:50:34.722832] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:34.722840] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:34.817346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:34.817395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:34.817403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:34.817412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:34.849749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:34.860539] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:35.017637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:35.017681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:35.017689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:35.017698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:35.054227] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4304, replace_start_pos=3400000, replace_num=100000) [2024-09-11 15:50:35.054264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:35.100368] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:35.124789] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:35.124835] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7258 [2024-09-11 15:50:35.217946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:35.217996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:35.218003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:35.218011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:35.254351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:35.323147] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7258, magic:0x78563412 [2024-09-11 15:50:35.323195] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:35.323202] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:35.418238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:35.418278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:35.418285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:35.418295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:35.454454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:35.618536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:35.618576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:35.618584] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:35.618593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:35.651350] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041035651335, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:50:35.654637] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:35.658051] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041035658047, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 15:50:35.725140] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:35.725184] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8580 [2024-09-11 15:50:35.818821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:35.818865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:35.818894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:35.818920] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:35.854759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:35.861548] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:35.923378] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8580, magic:0x78563412 [2024-09-11 15:50:35.923428] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:35.923436] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:36.019145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:36.019191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:36.019198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:36.019208] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:36.054863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:36.100492] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:36.219485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:36.219532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:36.219540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:36.219549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:36.227604] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8041, clean_start_pos=7400000, clean_num=200000) [2024-09-11 15:50:36.254962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:36.325432] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:36.325477] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8584 [2024-09-11 15:50:36.427948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:36.428003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:36.428046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:36.428057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:36.455084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:36.523954] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8584, magic:0x78563412 [2024-09-11 15:50:36.523993] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:36.524002] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:36.628306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:36.628350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:36.628358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:36.628367] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:36.655204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:36.658895] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041036658891, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 15:50:36.665666] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041036665660, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:50:36.828586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:36.828625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:36.828631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:36.828639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:36.855316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:36.862641] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:36.926154] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:36.926198] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8592 [2024-09-11 15:50:37.028878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:37.028935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:37.028955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:37.028964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:37.055445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:37.100669] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:37.124581] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8592, magic:0x78563412 [2024-09-11 15:50:37.124623] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:37.124631] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:37.229179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:37.229222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:37.229229] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:37.229236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:37.259921] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4368, replace_start_pos=3500000, replace_num=100000) [2024-09-11 15:50:37.259963] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:37.429551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:37.429592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:37.429599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:37.429607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:37.460047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:37.526394] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:37.526435] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8600 [2024-09-11 15:50:37.629932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:37.629995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:37.630006] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:37.630018] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:37.660180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:37.666502] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041037666499, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:50:37.673275] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041037673271, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:50:37.724791] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8600, magic:0x78563412 [2024-09-11 15:50:37.724831] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:37.724839] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:37.830245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:37.830287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:37.830295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:37.830303] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:37.860301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:37.863582] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:38.030540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:38.030581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:38.030588] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:38.030597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:38.060497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:38.100795] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:38.125542] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:38.125582] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8602 [2024-09-11 15:50:38.231011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:38.231047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:38.231053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:38.231061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:38.237599] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6525, clean_start_pos=7600000, clean_num=200000) [2024-09-11 15:50:38.260703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:38.324202] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8602, magic:0x78563412 [2024-09-11 15:50:38.324244] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:38.324251] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:38.437952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:38.438004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:38.438012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:38.438021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:38.460852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:38.638335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:38.638394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:38.638402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:38.638410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:38.660994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:38.674123] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041038674119, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:50:38.680955] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041038680951, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 15:50:38.726304] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:38.726345] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8604 [2024-09-11 15:50:38.838738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:38.838783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:38.838791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:38.838800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:38.861125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:38.864626] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:38.924695] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8604, magic:0x78563412 [2024-09-11 15:50:38.924735] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:38.924742] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:39.039104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:39.039141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:39.039147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:39.039155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:39.061248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:39.100976] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:39.239386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:39.239442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:39.239449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:39.239457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:39.261366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:39.327715] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:39.327758] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8612 [2024-09-11 15:50:39.439679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:39.439717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:39.439723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:39.439730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:39.465796] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4314, replace_start_pos=3600000, replace_num=100000) [2024-09-11 15:50:39.465838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:39.525164] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8612, magic:0x78563412 [2024-09-11 15:50:39.525200] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:39.525208] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:39.639974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:39.640020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:39.640026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:39.640048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:39.665926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:39.681798] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041039681794, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:50:39.688516] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041039688512, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:50:39.840258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:39.840296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:39.840303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:39.840310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:39.846867] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:39.846923] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:39.847005] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=6, max_check_version=7, global_version=8) [2024-09-11 15:50:39.848925] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1920 [2024-09-11 15:50:39.848953] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:39.849002] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:50:39.849036] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:50:39.849111] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:39.849194] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 15:50:39.849240] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:50:39.849249] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:50:39.849257] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:50:39.849289] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:50:39.849336] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:50:39.849354] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:50:39.865862] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:39.866109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:39.927057] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:39.927101] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8614 [2024-09-11 15:50:40.040613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:40.040664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:40.040694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:40.040705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:40.066221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:40.101183] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:40.125586] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8614, magic:0x78563412 [2024-09-11 15:50:40.125634] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:40.125642] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:40.240954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:40.240998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:40.241004] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:40.241011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:40.247528] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6501, clean_start_pos=7800000, clean_num=200000) [2024-09-11 15:50:40.266337] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:40.447787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:40.447831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:40.447837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:40.447845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:40.466449] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:40.527975] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:40.528014] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8616 [2024-09-11 15:50:40.648142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:40.648183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:40.648190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:40.648199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:40.666577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:40.689374] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041040689371, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007577, add_bytes: 0 [2024-09-11 15:50:40.696185] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041040696182, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 15:50:40.726076] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8616, magic:0x78563412 [2024-09-11 15:50:40.726118] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:40.726124] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:40.848422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:40.848463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:40.848470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:40.848478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:40.866697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:40.866970] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=131] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:41.048722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:41.048761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:41.048768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:41.048775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:41.049011] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=69, refresh_score_time=65, wash_time=0) [2024-09-11 15:50:41.066884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:41.101302] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:41.127842] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:41.127880] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8628 [2024-09-11 15:50:41.249258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:41.249317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:41.249326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:41.249335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:41.267044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:41.326444] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8628, magic:0x78563412 [2024-09-11 15:50:41.326484] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:41.326491] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:41.449565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:41.449610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:41.449617] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:41.449627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:41.467176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:41.649825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:41.649864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:41.649890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:41.649898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:41.671315] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4033, replace_start_pos=3700000, replace_num=100000) [2024-09-11 15:50:41.671359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:41.697036] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041041697032, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 15:50:41.703745] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041041703742, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 15:50:41.727654] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:41.727694] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8640 [2024-09-11 15:50:41.850166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:41.850211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:41.850218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:41.850227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:41.867942] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:41.871441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:41.924863] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8640, magic:0x78563412 [2024-09-11 15:50:41.924915] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:41.924922] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:42.050458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:42.050501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:42.050507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:42.050515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:42.071545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:42.101433] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:42.250735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:42.250775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:42.250782] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:42.250789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:42.257541] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6740, clean_start_pos=8000000, clean_num=200000) [2024-09-11 15:50:42.271683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:42.326522] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:42.326557] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8642 [2024-09-11 15:50:42.457925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:42.457971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:42.457979] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:42.457988] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:42.471789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:42.525100] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8642, magic:0x78563412 [2024-09-11 15:50:42.525139] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:42.525146] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:42.658231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:42.658276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:42.658300] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:42.658309] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:42.671897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:42.704656] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041042704653, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:50:42.711473] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041042711469, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007727, add_bytes: 0 [2024-09-11 15:50:42.858629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:42.858676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:42.858684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:42.858693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:42.869023] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:42.872017] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:42.927614] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:42.927654] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8652 [2024-09-11 15:50:43.058977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:43.059022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:43.059030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:43.059039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:43.072113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:43.101611] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:43.125732] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8652, magic:0x78563412 [2024-09-11 15:50:43.125776] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:43.125784] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:43.259254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:43.259315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:43.259321] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:43.259328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:43.272214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:43.459655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:43.459700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:43.459707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:43.459716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:43.472322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:43.527554] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:43.527592] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8654 [2024-09-11 15:50:43.659964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:43.660007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:43.660013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:43.660022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:43.672431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:43.712264] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041043712260, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 15:50:43.718964] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041043718961, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007492, add_bytes: 0 [2024-09-11 15:50:43.726220] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8654, magic:0x78563412 [2024-09-11 15:50:43.726256] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:43.726263] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:43.860367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:43.860414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:43.860420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:43.860428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:43.870301] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:43.876947] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4335, replace_start_pos=3800000, replace_num=100000) [2024-09-11 15:50:43.876983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:44.060654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:44.060708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:44.060716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:44.060728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:44.077091] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:44.101726] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:44.127324] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:44.127351] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8668 [2024-09-11 15:50:44.261007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:44.261053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:44.261061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:44.261069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:44.268523] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7441, clean_start_pos=8200000, clean_num=200000) [2024-09-11 15:50:44.277227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:44.325717] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8668, magic:0x78563412 [2024-09-11 15:50:44.325762] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:44.325768] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:44.468806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:44.468849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:44.468855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:44.468863] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:44.477437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:44.669093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:44.669134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:44.669141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:44.669149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:44.677561] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:44.719830] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041044719827, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 15:50:44.726366] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:44.726403] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8684 [2024-09-11 15:50:44.726572] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041044726569, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:50:44.869391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:44.869458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:44.869466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:44.869475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:44.871113] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:44.877667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:44.923935] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8684, magic:0x78563412 [2024-09-11 15:50:44.923971] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:44.923978] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:45.069738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:45.069777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:45.069784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:45.069791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:45.077772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:45.101839] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:45.270036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:45.270073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:45.270080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:45.270088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:45.277917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:45.325935] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:45.325975] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8698 [2024-09-11 15:50:45.470314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:45.470365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:45.470402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:45.470410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:45.478036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:45.524416] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8698, magic:0x78563412 [2024-09-11 15:50:45.524458] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:45.524467] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:45.670661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:45.670711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:45.670718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:45.670728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:45.678164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:45.727436] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041045727432, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:50:45.734291] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041045734287, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007718, add_bytes: 0 [2024-09-11 15:50:45.870990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:45.871048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:45.871054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:45.871062] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:45.871891] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:45.878287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:45.926617] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:45.926662] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:33978 [2024-09-11 15:50:46.071314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:46.071356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:46.071378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:46.071386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:46.082362] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3963, replace_start_pos=3900000, replace_num=100000) [2024-09-11 15:50:46.082399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:46.101938] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=28] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:46.125033] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:33978, magic:0x78563412 [2024-09-11 15:50:46.125061] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:46.125068] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:46.271695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:46.271736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:46.271743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:46.271750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:46.278967] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7203, clean_start_pos=8400000, clean_num=200000) [2024-09-11 15:50:46.282481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:46.479233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:46.479265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:46.479270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:46.479278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:46.482592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:46.526646] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:46.526690] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:33992 [2024-09-11 15:50:46.679595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:46.679644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:46.679652] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:46.679661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:46.682702] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:46.725269] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:33992, magic:0x78563412 [2024-09-11 15:50:46.725312] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:46.725318] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:46.735053] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041046735048, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:50:46.741879] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041046741876, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007589, add_bytes: 0 [2024-09-11 15:50:46.872789] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:46.879991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:46.880030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:46.880038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:46.880048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:46.882826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:47.080337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:47.080384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:47.080392] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:47.080403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:47.082994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:47.102100] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=23] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:47.127695] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:47.127739] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34008 [2024-09-11 15:50:47.280746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:47.280791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:47.280799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:47.280809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:47.283162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:47.325765] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34008, magic:0x78563412 [2024-09-11 15:50:47.325799] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:47.325807] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:47.481124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:47.481167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:47.481175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:47.481184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:47.483322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:47.681487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:47.681548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:47.681556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:47.681567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:47.683489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:47.727641] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:47.727681] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34020 [2024-09-11 15:50:47.742798] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041047742795, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007747, add_bytes: 0 [2024-09-11 15:50:47.749446] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041047749442, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 15:50:47.873787] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:47.881858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:47.881898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:47.881925] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:47.881935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:47.883646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:47.926293] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34020, magic:0x78563412 [2024-09-11 15:50:47.926338] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:47.926347] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:48.082253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:48.082300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:48.082308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:48.082317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:48.083765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:48.102233] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:48.282563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:48.282607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:48.282615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:48.282625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:48.288259] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4364, replace_start_pos=4000000, replace_num=100000) [2024-09-11 15:50:48.288301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:48.291144] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8508, clean_start_pos=8600000, clean_num=200000) [2024-09-11 15:50:48.327818] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:48.327865] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34034 [2024-09-11 15:50:48.488394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:48.491453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:48.491479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:48.491487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:48.491496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:48.526507] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34034, magic:0x78563412 [2024-09-11 15:50:48.526554] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:48.526562] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:48.688509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:48.691725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:48.691764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:48.691773] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:48.691782] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:48.750370] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041048750366, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007571, add_bytes: 0 [2024-09-11 15:50:48.757062] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041048757059, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:50:48.874885] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:48.888658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:48.892139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:48.892175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:48.892183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:48.892192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:48.928580] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:48.928622] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34036 [2024-09-11 15:50:49.088787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:49.092492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:49.092520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:49.092527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:49.092537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:49.102379] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:49.126831] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34036, magic:0x78563412 [2024-09-11 15:50:49.126874] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:49.126882] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:49.288934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:49.292833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:49.292867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:49.292875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:49.292885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:49.489061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:49.493184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:49.493224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:49.493232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:49.493242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:49.529115] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:49.529156] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34040 [2024-09-11 15:50:49.689180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:49.693544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:49.693571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:49.693579] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:49.693588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:49.727357] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34040, magic:0x78563412 [2024-09-11 15:50:49.727407] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:49.727416] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:49.757963] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041049757959, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 15:50:49.764729] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041049764725, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 15:50:49.863169] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:49.863221] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:49.863302] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=7, max_check_version=8, global_version=9) [2024-09-11 15:50:49.865332] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2030 [2024-09-11 15:50:49.865369] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:49.865405] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:50:49.865463] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:50:49.865548] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:49.865655] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 15:50:49.865706] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:50:49.865717] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:50:49.865732] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:50:49.865769] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:50:49.865829] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:50:49.865851] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:50:49.876226] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=101] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:49.889366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:49.893930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:49.893964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:49.893971] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:49.893980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:50.089555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:50.094222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:50.094252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:50.094260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:50.094268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:50.102558] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:50.129242] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:50.129286] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34048 [2024-09-11 15:50:50.289746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:50.294583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:50.294615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:50.294623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:50.294632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:50.303202] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8557, clean_start_pos=8800000, clean_num=200000) [2024-09-11 15:50:50.327603] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34048, magic:0x78563412 [2024-09-11 15:50:50.327638] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:50.327644] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:50.494295] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4353, replace_start_pos=4100000, replace_num=100000) [2024-09-11 15:50:50.494357] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:50.503530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:50.503574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:50.503583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:50.503593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:50.503805] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:50:50.694512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:50.704106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:50.704147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:50.704155] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:50.704165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:50.729809] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:50.729851] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34056 [2024-09-11 15:50:50.765521] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041050765515, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 15:50:50.772281] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041050772276, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 15:50:50.877574] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:50.894641] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:50.904390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:50.904434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:50.904442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:50.904451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:50.928163] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34056, magic:0x78563412 [2024-09-11 15:50:50.928198] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:50.928206] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:51.094843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:51.102676] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:51.104680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:51.104707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:51.104731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:51.104740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:51.294962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:51.304986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:51.305023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:51.305032] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:51.305041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:51.329374] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:51.329422] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34062 [2024-09-11 15:50:51.495068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:51.505331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:51.505368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:51.505376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:51.505385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:51.527723] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34062, magic:0x78563412 [2024-09-11 15:50:51.527763] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:51.527769] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:51.695179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:51.705677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:51.705716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:51.705724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:51.705734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:51.773140] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041051773136, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:50:51.779912] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041051779899, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:50:51.878517] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:51.895369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:51.905987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:51.906030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:51.906037] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:51.906046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:51.929383] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:51.929419] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34076 [2024-09-11 15:50:52.095486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:52.102781] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:52.106343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:52.106380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:52.106388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:52.106397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:52.127959] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34076, magic:0x78563412 [2024-09-11 15:50:52.128000] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:52.128006] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:52.295602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:52.306697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:52.306735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:52.306743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:52.306753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:52.315292] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8525, clean_start_pos=9000000, clean_num=200000) [2024-09-11 15:50:52.495723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:52.515621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:52.515656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:52.515665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:52.515674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:52.529780] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:52.529820] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34080 [2024-09-11 15:50:52.700150] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4314, replace_start_pos=4200000, replace_num=100000) [2024-09-11 15:50:52.700198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:52.715919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:52.715964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:52.715972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:52.715997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:52.728387] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34080, magic:0x78563412 [2024-09-11 15:50:52.728420] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:52.728426] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:52.780747] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041052780743, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 15:50:52.787513] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041052787509, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:50:52.879271] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:52.900281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:52.916234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:52.916271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:52.916279] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:52.916288] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:53.100398] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:53.102860] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=14] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:53.116511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:53.116547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:53.116555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:53.116563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:53.130451] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:53.130497] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34090 [2024-09-11 15:50:53.300507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:53.316862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:53.316925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:53.316951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:53.316961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:53.328943] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34090, magic:0x78563412 [2024-09-11 15:50:53.328974] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:53.328981] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:53.500610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:53.517193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:53.517228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:53.517236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:53.517245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:53.700722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:53.717565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:53.717605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:53.717613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:53.717622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:53.731089] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:53.731127] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34096 [2024-09-11 15:50:53.788362] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041053788358, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:50:53.795189] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041053795186, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 15:50:53.880403] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:53.900824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:53.917959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:53.918012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:53.918043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:53.918054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:53.929420] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34096, magic:0x78563412 [2024-09-11 15:50:53.929459] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:53.929466] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:54.100930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:54.102942] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=12] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:54.118348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:54.118392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:54.118400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:54.118410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:54.301044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:54.318640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:54.318680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:54.318688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:54.318698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:54.326250] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7538, clean_start_pos=9200000, clean_num=200000) [2024-09-11 15:50:54.331761] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:54.331812] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34102 [2024-09-11 15:50:54.501163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:54.526617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:54.526651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:54.526659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:54.526668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:54.529752] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34102, magic:0x78563412 [2024-09-11 15:50:54.529784] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:54.529793] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:54.701346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:54.726886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:54.726939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:54.726946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:54.726955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:54.796059] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726041054796054, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 15:50:54.802735] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041054802730, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 15:50:54.881527] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:54.905783] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4320, replace_start_pos=4300000, replace_num=100000) [2024-09-11 15:50:54.905827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:54.927181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:54.927228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:54.927235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:54.927245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:54.932088] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:54.932129] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34106 [2024-09-11 15:50:55.103042] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:55.105873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:55.127573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:55.127617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:55.127624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:55.127631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:55.130197] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34106, magic:0x78563412 [2024-09-11 15:50:55.130234] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:55.130243] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:55.306069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:55.327950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:55.327991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:55.327998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:55.328008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:55.506250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:55.528224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:55.528288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:55.528295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:55.528302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:55.532001] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:55.532030] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25268 [2024-09-11 15:50:55.706401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:55.728598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:55.728643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:55.728651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:55.728660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:55.730688] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25268, magic:0x78563412 [2024-09-11 15:50:55.730720] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:55.730727] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:55.803656] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041055803651, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 15:50:55.810415] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041055810413, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 15:50:55.883855] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:55.906598] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:55.928922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:55.928968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:55.928975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:55.928984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:56.103154] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:56.106821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:56.129277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:56.129321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:56.129327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:56.129335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:56.132982] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:56.133013] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25270 [2024-09-11 15:50:56.307027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:56.329630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:56.329670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:56.329677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:56.329685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:56.330978] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25270, magic:0x78563412 [2024-09-11 15:50:56.331006] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:56.331012] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:56.336963] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7265, clean_start_pos=9400000, clean_num=200000) [2024-09-11 15:50:56.507242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:56.537225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:56.537266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:56.537272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:56.537299] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:56.707451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:56.732797] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:56.732829] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25278 [2024-09-11 15:50:56.737546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:56.737586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:56.737594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:56.737603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:56.811301] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041056811296, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007645, add_bytes: 0 [2024-09-11 15:50:56.817982] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041056817978, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 15:50:56.884618] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=105] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:56.907632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:56.931304] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25278, magic:0x78563412 [2024-09-11 15:50:56.931349] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:56.931357] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:56.937844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:56.937889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:56.937897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:56.937930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:57.103273] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:57.112102] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4351, replace_start_pos=4400000, replace_num=100000) [2024-09-11 15:50:57.112144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:57.138200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:57.138280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:57.138290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:57.138300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:57.312243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:57.333096] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:57.333135] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25282 [2024-09-11 15:50:57.338526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:57.338557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:57.338564] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:57.338572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:57.512438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:57.531725] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25282, magic:0x78563412 [2024-09-11 15:50:57.531768] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:57.531776] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:57.538869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:57.538924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:57.538933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:57.538942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:57.712581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:57.739224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:57.739268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:57.739276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:57.739285] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:57.818846] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041057818841, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 15:50:57.825584] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041057825580, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:50:57.885351] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:57.912775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:50:57.933727] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:57.933783] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25286 [2024-09-11 15:50:57.939507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:57.939539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:57.939544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:57.939552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:58.103386] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:58.112971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:50:58.132148] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25286, magic:0x78563412 [2024-09-11 15:50:58.132187] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:58.132193] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:58.139763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:58.139796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:58.139802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:58.139824] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:58.313150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:50:58.340048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:58.340090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:58.340097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:58.340105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:58.347351] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7233, clean_start_pos=9600000, clean_num=200000) [2024-09-11 15:50:58.513348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:50:58.534088] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:58.534133] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25296 [2024-09-11 15:50:58.547629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:58.547680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:58.547687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:58.547694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:58.713536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:50:58.732577] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25296, magic:0x78563412 [2024-09-11 15:50:58.732615] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:58.732621] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:58.747951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:58.747996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:58.748002] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:58.748010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:58.826442] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041058826437, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 15:50:58.833275] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041058833272, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 15:50:58.886490] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:58.913726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:50:58.948266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:58.948309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:58.948315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:58.948322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:59.103488] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:50:59.113878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:50:59.134921] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:59.134964] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25310 [2024-09-11 15:50:59.148559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:59.148605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:59.148613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:59.148622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:59.318511] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4434, replace_start_pos=4500000, replace_num=100000) [2024-09-11 15:50:59.318551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:50:59.332885] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25310, magic:0x78563412 [2024-09-11 15:50:59.332948] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:59.332955] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:59.348862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:59.348939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:59.348947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:59.348955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:59.518707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:50:59.549210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:59.549259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:59.549267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:59.549276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:59.718823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:50:59.734812] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:50:59.734850] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25314 [2024-09-11 15:50:59.749526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:59.749569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:59.749576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:59.749584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:50:59.834138] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041059834133, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 15:50:59.840883] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041059840878, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:50:59.881067] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:59.881113] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:50:59.881195] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=8, max_check_version=9, global_version=10) [2024-09-11 15:50:59.883274] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2078 [2024-09-11 15:50:59.883334] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:59.883369] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:50:59.883406] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:50:59.883507] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:50:59.883600] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 15:50:59.883647] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:50:59.883656] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:50:59.883668] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:50:59.883699] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:50:59.883747] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:50:59.883764] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:50:59.887452] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:50:59.918999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:50:59.933349] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25314, magic:0x78563412 [2024-09-11 15:50:59.933394] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:50:59.933400] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:50:59.949826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:50:59.949869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:50:59.949877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:50:59.949886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:00.103609] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:00.119139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:00.150145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:00.150189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:00.150215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:00.150224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:00.319265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:00.335486] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:00.335531] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25326 [2024-09-11 15:51:00.350459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:00.350505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:00.350514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:00.350523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:00.357866] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7328, clean_start_pos=9800000, clean_num=200000) [2024-09-11 15:51:00.519494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:00.533799] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25326, magic:0x78563412 [2024-09-11 15:51:00.533856] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:00.533871] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:00.558133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:00.558175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:00.558181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:00.558189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:00.719693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:00.758516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:00.758559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:00.758566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:00.758574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:00.827610] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=5] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 15:51:00.841762] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041060841758, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:51:00.841810] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 15:51:00.846126] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 15:51:00.848456] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=77] PNIO [ratelimit] time: 1726041060848454, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007576, add_bytes: 0 [2024-09-11 15:51:00.848487] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:51:00.888326] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:00.919884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:00.936152] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:00.936198] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25342 [2024-09-11 15:51:00.958814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:00.958865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:00.958874] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:00.958883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:01.103722] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:01.120050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:01.134369] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25342, magic:0x78563412 [2024-09-11 15:51:01.134413] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:01.134436] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:01.159180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:01.159224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:01.159232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:01.159242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:01.320263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:01.359457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:01.359499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:01.359505] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:01.359513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:01.359687] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=70, refresh_score_time=56, wash_time=0) [2024-09-11 15:51:01.524805] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4401, replace_start_pos=4600000, replace_num=100000) [2024-09-11 15:51:01.524852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:01.536350] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:01.536392] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25352 [2024-09-11 15:51:01.559948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:01.559994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:01.560001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:01.560028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:01.725012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:01.734805] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25352, magic:0x78563412 [2024-09-11 15:51:01.734844] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:01.734852] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:01.760243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:01.760288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:01.760294] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:01.760302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:01.849293] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726041061849288, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 15:51:01.856114] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041061856111, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 15:51:01.889238] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:01.925165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:01.960544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:01.960586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:01.960593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:01.960605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:02.103895] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:02.125461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:02.136680] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:02.136725] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25356 [2024-09-11 15:51:02.160827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:02.160870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:02.160877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:02.160916] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:02.325608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:02.334957] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25356, magic:0x78563412 [2024-09-11 15:51:02.334990] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:02.334997] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:02.361128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:02.361195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:02.361203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:02.361211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:02.367816] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6593, clean_start_pos=10000000, clean_num=200000) [2024-09-11 15:51:02.525745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:02.568057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:02.568099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:02.568106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:02.568113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:02.725930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:02.737223] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:02.737281] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25366 [2024-09-11 15:51:02.768342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:02.768385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:02.768391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:02.768399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:02.856994] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041062856989, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007701, add_bytes: 0 [2024-09-11 15:51:02.863729] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041062863724, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:51:02.890593] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=98] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:02.926068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:02.935480] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25366, magic:0x78563412 [2024-09-11 15:51:02.935523] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:02.935532] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:02.968644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:02.968686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:02.968694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:02.968703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:03.104020] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:03.126218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:03.168989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:03.169034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:03.169042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:03.169051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:03.326350] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:03.337816] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:03.337859] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25370 [2024-09-11 15:51:03.369298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:03.369341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:03.369348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:03.369358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:03.526607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:03.536072] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25370, magic:0x78563412 [2024-09-11 15:51:03.536111] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:03.536119] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:03.569587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:03.569632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:03.569639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:03.569646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:03.731179] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4386, replace_start_pos=4700000, replace_num=100000) [2024-09-11 15:51:03.731225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:03.769881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:03.769944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:03.769968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:03.769976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:03.864592] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041063864588, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 15:51:03.871297] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041063871293, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007569, add_bytes: 0 [2024-09-11 15:51:03.891830] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:03.931328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:03.938178] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:03.938213] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25386 [2024-09-11 15:51:03.970219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:03.970263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:03.970271] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:03.970280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:04.104123] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:04.131527] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:04.136445] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25386, magic:0x78563412 [2024-09-11 15:51:04.136481] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:04.136488] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:04.170584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:04.170629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:04.170637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:04.170647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:04.331656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:04.370894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:04.370954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:04.370977] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:04.370985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:04.377573] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6576, clean_start_pos=10200000, clean_num=200000) [2024-09-11 15:51:04.531843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:04.538371] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:04.538409] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25400 [2024-09-11 15:51:04.577872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:04.577937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:04.577946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:04.577956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:04.732032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:04.736732] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25400, magic:0x78563412 [2024-09-11 15:51:04.736764] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:04.736772] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:04.778181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:04.778229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:04.778237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:04.778247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:04.872238] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041064872234, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007646, add_bytes: 0 [2024-09-11 15:51:04.878967] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041064878964, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 15:51:04.892982] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=109] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:04.932167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:04.978514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:04.978582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:04.978590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:04.978599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:05.104228] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:05.132373] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:05.139174] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:05.139220] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25414 [2024-09-11 15:51:05.178806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:05.178850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:05.178856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:05.178864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:05.332551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:05.337246] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25414, magic:0x78563412 [2024-09-11 15:51:05.337276] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:05.337285] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:05.379088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:05.379133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:05.379141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:05.379177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:05.532735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:05.579391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:05.579449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:05.579456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:05.579465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:05.732876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:05.738945] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:05.738991] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23892 [2024-09-11 15:51:05.779671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:05.779704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:05.779710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:05.779718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:05.879856] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041065879851, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:51:05.886584] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041065886581, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:51:05.894319] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:05.937448] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23892, magic:0x78563412 [2024-09-11 15:51:05.937487] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:05.937492] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:05.937517] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4414, replace_start_pos=4800000, replace_num=100000) [2024-09-11 15:51:05.937553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:05.980071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:05.980114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:05.980139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:05.980146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:06.104344] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:06.137643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:06.180344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:06.180380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:06.180386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:06.180395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:06.337750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:06.339351] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:06.339387] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23902 [2024-09-11 15:51:06.380596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:06.380635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:06.380643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:06.380651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:06.389242] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8578, clean_start_pos=10400000, clean_num=200000) [2024-09-11 15:51:06.537868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:06.537952] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23902, magic:0x78563412 [2024-09-11 15:51:06.537998] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:06.538005] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:06.589502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:06.589547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:06.589555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:06.589565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:06.738000] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:06.789793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:06.789832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:06.789839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:06.789849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:06.887435] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726041066887431, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007580, add_bytes: 0 [2024-09-11 15:51:06.894198] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041066894194, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:51:06.895792] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:06.938114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:06.940080] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:06.940116] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23916 [2024-09-11 15:51:06.990148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:06.990193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:06.990201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:06.990211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:07.104457] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:07.138227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:07.138578] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23916, magic:0x78563412 [2024-09-11 15:51:07.138612] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:07.138619] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:07.190544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:07.190585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:07.190592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:07.190601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:07.338350] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:07.390895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:07.390971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:07.390980] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:07.390989] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:07.538466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:07.540277] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:07.540312] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23922 [2024-09-11 15:51:07.591287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:07.591330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:07.591338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:07.591348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:07.738588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:07.738665] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23922, magic:0x78563412 [2024-09-11 15:51:07.738680] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:07.738687] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:07.791660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:07.791700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:07.791709] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:07.791718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:07.894991] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041067894987, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 15:51:07.896984] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:07.901809] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041067901807, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:51:07.938708] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:07.992045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:07.992086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:07.992093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:07.992102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:08.104560] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:08.140760] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:08.140806] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23934 [2024-09-11 15:51:08.142183] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3355, replace_start_pos=4900000, replace_num=100000) [2024-09-11 15:51:08.142287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=99] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:08.192352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:08.192397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:08.192421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:08.192431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:08.339102] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23934, magic:0x78563412 [2024-09-11 15:51:08.339139] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:08.339144] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:08.342551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:08.392727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:08.392767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:08.392775] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:08.392785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:08.401301] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8502, clean_start_pos=10600000, clean_num=200000) [2024-09-11 15:51:08.542663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:08.601613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:08.601657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:08.601665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:08.601675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:08.740638] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:08.740698] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23938 [2024-09-11 15:51:08.742777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:08.802007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:08.802053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:08.802061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:08.802071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:08.898237] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:08.902619] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726041068902615, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 15:51:08.909433] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041068909429, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:51:08.939513] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23938, magic:0x78563412 [2024-09-11 15:51:08.939559] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:08.939566] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:08.942884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:09.002366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:09.002409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:09.002418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:09.002428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:09.104674] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:09.143009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:09.202737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:09.202781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:09.202789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:09.202799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:09.341595] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:09.341638] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23946 [2024-09-11 15:51:09.343125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:09.403063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:09.403107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:09.403114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:09.403123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:09.540024] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23946, magic:0x78563412 [2024-09-11 15:51:09.540070] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:09.540078] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:09.543233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:09.603420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:09.603462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:09.603470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:09.603479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:09.743340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:09.803736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:09.803781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:09.803788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:09.803814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:09.899421] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:09.899534] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:09.899575] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:09.899673] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] update_check_range(min_check_version=9, max_check_version=10, global_version=11) [2024-09-11 15:51:09.901690] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2016 [2024-09-11 15:51:09.901720] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:09.901756] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:51:09.901794] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:51:09.901878] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:09.902010] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 15:51:09.902062] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:51:09.902073] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:51:09.902084] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:51:09.902121] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:51:09.902185] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:51:09.902207] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:51:09.910226] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041069910223, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:51:09.917012] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041069917008, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007579, add_bytes: 0 [2024-09-11 15:51:09.941816] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:09.941852] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23962 [2024-09-11 15:51:09.943449] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:10.004059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:10.004100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:10.004108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:10.004117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:10.104920] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:10.140374] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23962, magic:0x78563412 [2024-09-11 15:51:10.140413] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:10.140435] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:10.143567] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:10.204412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:10.204453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:10.204461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:10.204470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:10.348127] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4428, replace_start_pos=5000000, replace_num=100000) [2024-09-11 15:51:10.348175] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:10.404768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:10.404813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:10.404821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:10.404831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:10.411742] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6896, clean_start_pos=10800000, clean_num=200000) [2024-09-11 15:51:10.543164] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:10.543207] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23974 [2024-09-11 15:51:10.548253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:10.612091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:10.612137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:10.612164] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:10.612175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:10.740982] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23974, magic:0x78563412 [2024-09-11 15:51:10.741035] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:10.741047] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:10.748358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:10.812405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:10.812447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:10.812454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:10.812463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:10.900334] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:10.917940] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041070917935, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007712, add_bytes: 0 [2024-09-11 15:51:10.924615] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041070924611, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:51:10.948466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:11.012698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:11.012741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:11.012749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:11.012758] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:11.105037] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:11.142869] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:11.142931] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23988 [2024-09-11 15:51:11.148581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:11.213066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:11.213136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:11.213145] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:11.213155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:11.341159] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23988, magic:0x78563412 [2024-09-11 15:51:11.341200] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:11.341207] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:11.348685] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:11.413467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:11.413509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:11.413517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:11.413526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:11.548789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:11.613748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:11.613793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:11.613799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:11.613807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:11.743165] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:11.743202] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23996 [2024-09-11 15:51:11.748976] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:11.814050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:11.814092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:11.814101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:11.814110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:11.901488] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:11.925449] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041071925444, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007509, add_bytes: 0 [2024-09-11 15:51:11.932280] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041071932277, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 15:51:11.941497] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23996, magic:0x78563412 [2024-09-11 15:51:11.941533] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:11.941540] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:11.949088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:12.014344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:12.014387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:12.014393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:12.014402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:12.105149] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:12.149192] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:12.214620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:12.214663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:12.214670] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:12.214677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:12.343242] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:12.343290] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:24006 [2024-09-11 15:51:12.349359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:12.414944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:12.414988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:12.414996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:12.415007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:12.422265] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7241, clean_start_pos=11000000, clean_num=200000) [2024-09-11 15:51:12.541883] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:24006, magic:0x78563412 [2024-09-11 15:51:12.541935] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:12.541943] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:12.553215] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3749, replace_start_pos=5100000, replace_num=100000) [2024-09-11 15:51:12.553253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:12.622524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:12.622569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:12.622576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:12.622583] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:12.753331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:12.822816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:12.822881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:12.822888] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:12.822896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:12.902708] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:12.933131] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041072933127, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 15:51:12.939891] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041072939886, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:51:12.943850] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:12.943884] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:24020 [2024-09-11 15:51:12.953442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:13.023143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:13.023171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:13.023177] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:13.023184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:13.105260] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:13.142415] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:24020, magic:0x78563412 [2024-09-11 15:51:13.142452] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:13.142459] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:13.153540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:13.223410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:13.223450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:13.223457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:13.223465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:13.353641] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:13.423697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:13.423742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:13.423749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:13.423758] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:13.544652] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:13.544692] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:24024 [2024-09-11 15:51:13.553764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:13.624026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:13.624073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:13.624080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:13.624089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:13.742788] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:24024, magic:0x78563412 [2024-09-11 15:51:13.742822] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:13.742829] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:13.753861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:13.824405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:13.824450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:13.824458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:13.824468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:13.903718] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:13.940748] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=71] PNIO [ratelimit] time: 1726041073940744, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:51:13.947514] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726041073947510, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:51:13.953989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:14.024810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:14.024884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:14.024895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:14.024921] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:14.105367] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:14.145213] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:14.145256] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:24028 [2024-09-11 15:51:14.154098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:14.225147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:14.225184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:14.225190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:14.225198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:14.343489] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:24028, magic:0x78563412 [2024-09-11 15:51:14.343532] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:14.343540] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:14.354215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:14.425507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:14.425561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:14.425570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:14.425605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:14.432584] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6963, clean_start_pos=11200000, clean_num=200000) [2024-09-11 15:51:14.554326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:14.632833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:14.632876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:14.632883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:14.632890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:14.745307] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:14.745346] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:24038 [2024-09-11 15:51:14.758768] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4323, replace_start_pos=5200000, replace_num=100000) [2024-09-11 15:51:14.758814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:14.833140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:14.833193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:14.833199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:14.833207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:14.904875] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:14.943896] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:24038, magic:0x78563412 [2024-09-11 15:51:14.943954] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:14.943961] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:14.948297] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041074948295, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 15:51:14.955127] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726041074955124, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:51:14.958894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:15.033436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:15.033500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:15.033507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:15.033515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:15.105492] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:15.159070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:15.233790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:15.233836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:15.233844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:15.233852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:15.345700] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:15.345740] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:24044 [2024-09-11 15:51:15.359189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:15.434096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:15.434139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:15.434147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:15.434156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:15.543177] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:24044, magic:0x78563412 [2024-09-11 15:51:15.543218] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:15.543241] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:15.559308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:15.634391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:15.634437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:15.634444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:15.634452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:15.759421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:15.834685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:15.834730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:15.834737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:15.834745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:15.905953] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=121] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:15.945243] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:15.945292] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44692 [2024-09-11 15:51:15.955932] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041075955927, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 15:51:15.959544] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:15.962778] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041075962775, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007651, add_bytes: 0 [2024-09-11 15:51:16.035021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:16.035061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:16.035069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:16.035078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:16.105698] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:16.143511] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44692, magic:0x78563412 [2024-09-11 15:51:16.143569] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:16.143577] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:16.159711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:16.235318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:16.235363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:16.235370] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:16.235379] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:16.359843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:16.435586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:16.435629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:16.435635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:16.435643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:16.442578] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6923, clean_start_pos=11400000, clean_num=200000) [2024-09-11 15:51:16.544446] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:16.544490] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44706 [2024-09-11 15:51:16.560023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:16.642806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:16.642835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:16.642841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:16.642864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:16.742826] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44706, magic:0x78563412 [2024-09-11 15:51:16.742862] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:16.742868] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:16.760137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:16.843083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:16.843122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:16.843130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:16.843139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:16.907020] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:16.963530] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041076963527, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 15:51:16.964581] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4342, replace_start_pos=5300000, replace_num=100000) [2024-09-11 15:51:16.964619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:16.970295] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041076970291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007516, add_bytes: 0 [2024-09-11 15:51:17.043369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:17.043409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:17.043417] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:17.043426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:17.105880] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:17.144832] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:17.144873] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44714 [2024-09-11 15:51:17.164705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:17.243739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:17.243799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:17.243807] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:17.243817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:17.343260] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44714, magic:0x78563412 [2024-09-11 15:51:17.343298] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:17.343303] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:17.364833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:17.444053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:17.444099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:17.444106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:17.444115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:17.564960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:17.644348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:17.644395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:17.644403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:17.644414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:17.745428] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:17.745487] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44730 [2024-09-11 15:51:17.765075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:17.844671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:17.844713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:17.844720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:17.844729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:17.908241] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:17.943704] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44730, magic:0x78563412 [2024-09-11 15:51:17.943736] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:17.943742] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:17.965201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:17.971260] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041077971257, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007730, add_bytes: 0 [2024-09-11 15:51:17.977970] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041077977967, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 15:51:18.045009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:18.045054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:18.045062] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:18.045072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:18.106019] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:18.165322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:18.245332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:18.245377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:18.245385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:18.245396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:18.346278] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:18.346334] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44746 [2024-09-11 15:51:18.365443] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:18.445630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:18.445673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:18.445681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:18.445690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:18.453417] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7714, clean_start_pos=11600000, clean_num=200000) [2024-09-11 15:51:18.544497] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44746, magic:0x78563412 [2024-09-11 15:51:18.544537] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:18.544544] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:18.565556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:18.653781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:18.653825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:18.653833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:18.653843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:18.765683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:18.854165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:18.854206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:18.854232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:18.854243] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:18.909235] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:18.946028] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:18.946069] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44748 [2024-09-11 15:51:18.966273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:18.978785] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041078978781, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007524, add_bytes: 0 [2024-09-11 15:51:18.985590] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041078985587, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:51:19.054544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:19.054589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:19.054596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:19.054606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:19.106212] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:19.144682] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44748, magic:0x78563412 [2024-09-11 15:51:19.144725] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:19.144731] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:19.170805] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=90] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4354, replace_start_pos=5400000, replace_num=100000) [2024-09-11 15:51:19.170852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:19.254847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:19.254886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:19.254894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:19.254934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:19.370934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:19.455184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:19.455224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:19.455232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:19.455241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:19.547063] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:19.547108] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44760 [2024-09-11 15:51:19.571071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:19.655594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:19.655638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:19.655646] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:19.655656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:19.745150] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44760, magic:0x78563412 [2024-09-11 15:51:19.745199] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:19.745206] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:19.771181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:19.855887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:19.855946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:19.855954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:19.855978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:19.910117] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:19.916890] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:19.916944] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:19.917040] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] update_check_range(min_check_version=10, max_check_version=11, global_version=12) [2024-09-11 15:51:19.918809] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1769 [2024-09-11 15:51:19.918847] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:19.918879] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:51:19.918928] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:51:19.919009] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:19.919107] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 15:51:19.919154] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:51:19.919164] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:51:19.919174] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:51:19.919207] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:51:19.919263] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:51:19.919283] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:51:19.971295] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:19.986438] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041079986434, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007653, add_bytes: 0 [2024-09-11 15:51:19.993252] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041079993249, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007662, add_bytes: 0 [2024-09-11 15:51:20.056282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:20.056328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:20.056337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:20.056346] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:20.106392] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:20.147097] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:20.147138] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44766 [2024-09-11 15:51:20.171419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:20.256580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:20.256625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:20.256651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:20.256660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:20.345508] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44766, magic:0x78563412 [2024-09-11 15:51:20.345557] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:20.345569] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:20.371539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:20.457021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:20.457068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:20.457076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:20.457086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:20.465629] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8530, clean_start_pos=11800000, clean_num=200000) [2024-09-11 15:51:20.571654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:20.665973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:20.666019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:20.666027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:20.666036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:20.666221] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:51:20.747308] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:20.747352] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44780 [2024-09-11 15:51:20.771771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:20.866542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:20.866598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:20.866607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:20.866616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:20.910948] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:20.945949] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44780, magic:0x78563412 [2024-09-11 15:51:20.945991] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:20.945999] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:20.971892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:20.993998] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041080993995, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:51:21.000751] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041081000747, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007498, add_bytes: 0 [2024-09-11 15:51:21.066925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:21.066973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:21.066981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:21.066991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:21.106577] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:21.172023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:21.267288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:21.267334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:21.267343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:21.267369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:21.348030] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:21.348075] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44796 [2024-09-11 15:51:21.376466] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4322, replace_start_pos=5500000, replace_num=100000) [2024-09-11 15:51:21.376512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:21.467663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:21.467708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:21.467716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:21.467725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:21.546427] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44796, magic:0x78563412 [2024-09-11 15:51:21.546471] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:21.546479] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:21.576595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:21.668058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:21.668099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:21.668106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:21.668116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:21.668328] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=73, refresh_score_time=62, wash_time=0) [2024-09-11 15:51:21.776713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:21.868638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:21.868677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:21.868685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:21.868695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:21.912012] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:21.948537] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:21.948578] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44800 [2024-09-11 15:51:21.976831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:22.001611] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041082001608, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:51:22.008377] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041082008375, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 15:51:22.069024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:22.069068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:22.069076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:22.069085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:22.106775] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:22.146843] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44800, magic:0x78563412 [2024-09-11 15:51:22.146886] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:22.146894] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:22.176950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:22.269392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:22.269440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:22.269448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:22.269457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:22.377069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:22.469777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:22.469818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:22.469826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:22.469836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:22.478489] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8639, clean_start_pos=12000000, clean_num=200000) [2024-09-11 15:51:22.548505] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:22.548551] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44816 [2024-09-11 15:51:22.577187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:22.678753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:22.678798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:22.678807] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:22.678817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:22.747249] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44816, magic:0x78563412 [2024-09-11 15:51:22.747291] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:22.747298] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:22.777301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:22.879119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:22.879163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:22.879172] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:22.879182] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:22.912919] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:22.977438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:23.009236] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041083009232, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:51:23.015990] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041083015986, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:51:23.079485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:23.079531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:23.079540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:23.079550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:23.106920] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:23.147952] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:23.147999] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44820 [2024-09-11 15:51:23.177554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:23.279854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:23.279923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:23.279935] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:23.279944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:23.346477] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44820, magic:0x78563412 [2024-09-11 15:51:23.346513] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:23.346521] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:23.377669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:23.480253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:23.480300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:23.480308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:23.480318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:23.581811] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4009, replace_start_pos=5600000, replace_num=100000) [2024-09-11 15:51:23.581854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:23.680625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:23.680665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:23.680673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:23.680683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:23.748647] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:23.748693] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44824 [2024-09-11 15:51:23.781935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:23.881016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:23.881064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:23.881072] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:23.881083] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:23.913858] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:23.947091] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44824, magic:0x78563412 [2024-09-11 15:51:23.947131] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:23.947138] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:23.982047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:24.016851] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041084016847, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:51:24.023598] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041084023595, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:51:24.081402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:24.081449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:24.081456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:24.081466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:24.107034] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:24.182245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:24.281797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:24.281838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:24.281847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:24.281856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:24.348196] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:24.348240] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44836 [2024-09-11 15:51:24.382383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:24.482147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:24.482187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:24.482195] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:24.482206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:24.490809] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8575, clean_start_pos=12200000, clean_num=200000) [2024-09-11 15:51:24.546525] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44836, magic:0x78563412 [2024-09-11 15:51:24.546567] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:24.546574] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:24.582569] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:24.691130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:24.691173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:24.691181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:24.691191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:24.782701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:24.891488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:24.891529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:24.891536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:24.891546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:24.914704] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:24.948647] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:24.948684] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44850 [2024-09-11 15:51:24.982878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:25.024518] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041085024512, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 15:51:25.031298] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041085031295, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 15:51:25.091850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:25.091893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:25.091923] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:25.091951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:25.107205] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:25.146849] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44850, magic:0x78563412 [2024-09-11 15:51:25.146892] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:25.146899] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:25.183089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:25.292187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:25.292233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:25.292241] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:25.292250] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:25.383236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:25.492542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:25.492588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:25.492597] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:25.492607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:25.547995] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:25.548039] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11962 [2024-09-11 15:51:25.583387] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:25.692839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:25.692878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:25.692886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:25.692895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:25.746319] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11962, magic:0x78563412 [2024-09-11 15:51:25.746362] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:25.746370] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:25.787945] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4396, replace_start_pos=5700000, replace_num=100000) [2024-09-11 15:51:25.787992] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:25.893156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:25.893200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:25.893207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:25.893217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:25.915891] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=110] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:25.988137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:26.032143] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041086032138, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:51:26.038929] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041086038924, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 15:51:26.093534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:26.093584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:26.093592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:26.093602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:26.107382] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:26.148476] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:26.148537] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11972 [2024-09-11 15:51:26.188278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:26.293833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:26.293875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:26.293883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:26.293892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:26.346721] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11972, magic:0x78563412 [2024-09-11 15:51:26.346768] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:26.346780] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:26.388409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:26.494210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:26.494254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:26.494262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:26.494271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:26.502097] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7814, clean_start_pos=12400000, clean_num=200000) [2024-09-11 15:51:26.588542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:26.702409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:26.702456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:26.702480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:26.702490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:26.748580] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:26.748620] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11988 [2024-09-11 15:51:26.788733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:26.902823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:26.902868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:26.902876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:26.902885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:26.919774] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=3006] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:26.947135] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11988, magic:0x78563412 [2024-09-11 15:51:26.947176] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:26.947183] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:26.988921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:27.039706] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041087039702, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 15:51:27.046526] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041087046522, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 15:51:27.103131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:27.103172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:27.103179] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:27.103189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:27.107560] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:27.189106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:27.303497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:27.303561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:27.303570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:27.303579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:27.349344] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:27.349386] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11990 [2024-09-11 15:51:27.389296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:27.503871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:27.503935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:27.503944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:27.503955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:27.547649] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11990, magic:0x78563412 [2024-09-11 15:51:27.547697] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:27.547707] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:27.589435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:27.704185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:27.704229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:27.704237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:27.704246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:27.789634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:27.904580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:27.904625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:27.904632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:27.904642] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:27.920587] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:27.949340] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:27.949374] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11994 [2024-09-11 15:51:27.993937] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4166, replace_start_pos=5800000, replace_num=100000) [2024-09-11 15:51:27.993977] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:28.047373] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041088047369, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 15:51:28.054132] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041088054128, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:51:28.104955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:28.105001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:28.105009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:28.105019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:28.107716] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=27] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:28.148044] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11994, magic:0x78563412 [2024-09-11 15:51:28.148086] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:28.148092] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:28.194124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:28.305335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:28.305384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:28.305393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:28.305427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:28.394265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:28.505652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:28.505689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:28.505695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:28.505702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:28.512350] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6635, clean_start_pos=0, clean_num=200000) [2024-09-11 15:51:28.548932] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:28.548970] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11998 [2024-09-11 15:51:28.594444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:28.712602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:28.712649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:28.712656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:28.712664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:28.747564] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11998, magic:0x78563412 [2024-09-11 15:51:28.747608] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:28.747615] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:28.794671] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:28.912895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:28.912957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:28.912963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:28.912971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:28.921332] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:28.994859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:29.054940] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041089054935, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 15:51:29.061684] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041089061679, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 15:51:29.107885] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=27] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:29.113191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:29.113228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:29.113235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:29.113242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:29.149795] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:29.149837] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12010 [2024-09-11 15:51:29.195058] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:29.313641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:29.313687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:29.313695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:29.313704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:29.348082] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12010, magic:0x78563412 [2024-09-11 15:51:29.348121] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:29.348127] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:29.395241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:29.513953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:29.513995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:29.514003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:29.514012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:29.595423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:29.714313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:29.714358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:29.714366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:29.714375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:29.749868] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:29.749931] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12022 [2024-09-11 15:51:29.795637] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:29.914691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:29.914735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:29.914771] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:29.914781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:29.922140] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:29.934769] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:29.934821] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:29.934927] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=11, max_check_version=12, global_version=13) [2024-09-11 15:51:29.936890] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1964 [2024-09-11 15:51:29.936959] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=55] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:29.936995] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:51:29.937033] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:51:29.937117] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:29.937224] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:51:29.937278] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:51:29.937290] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:51:29.937301] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:51:29.937337] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:51:29.937400] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:51:29.937418] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:51:29.948486] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12022, magic:0x78563412 [2024-09-11 15:51:29.948523] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:29.948530] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:29.995821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:30.062617] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041090062612, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 15:51:30.069399] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041090069394, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007715, add_bytes: 0 [2024-09-11 15:51:30.108030] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:30.115069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:30.115109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:30.115118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:30.115130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:30.200302] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4340, replace_start_pos=5900000, replace_num=100000) [2024-09-11 15:51:30.200343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:30.315460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:30.315523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:30.315532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:30.315542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:30.350663] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:30.350710] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12038 [2024-09-11 15:51:30.400526] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:30.515835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:30.515881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:30.515889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:30.515899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:30.524027] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8091, clean_start_pos=200000, clean_num=200000) [2024-09-11 15:51:30.549103] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12038, magic:0x78563412 [2024-09-11 15:51:30.549146] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:30.549155] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:30.600712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:30.724334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:30.724381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:30.724390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:30.724417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:30.800895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:30.923136] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:30.924723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:30.925087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=363][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:30.925114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:30.925125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:30.951004] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:30.951048] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12042 [2024-09-11 15:51:31.001095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:31.070284] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041091070279, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 15:51:31.076989] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041091076984, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 15:51:31.108210] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:31.125418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:31.125462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:31.125470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:31.125480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:31.149349] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12042, magic:0x78563412 [2024-09-11 15:51:31.149393] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:31.149401] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:31.201288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:31.325796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:31.325841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:31.325849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:31.325876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:31.401475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:31.526108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:31.526152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:31.526160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:31.526169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:31.550224] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:31.550269] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12052 [2024-09-11 15:51:31.601670] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:31.726401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:31.726445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:31.726453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:31.726462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:31.748671] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12052, magic:0x78563412 [2024-09-11 15:51:31.748713] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:31.748723] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:31.801811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:31.923997] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:31.926767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:31.926801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:31.926810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:31.926819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:32.002014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:32.077839] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041092077834, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:51:32.084526] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041092084522, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007538, add_bytes: 0 [2024-09-11 15:51:32.108391] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:32.127109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:32.127153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:32.127160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:32.127167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:32.150565] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:32.150611] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12066 [2024-09-11 15:51:32.202213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:32.327383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:32.327436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:32.327442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:32.327449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:32.349110] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12066, magic:0x78563412 [2024-09-11 15:51:32.349155] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:32.349162] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:32.406451] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4034, replace_start_pos=6000000, replace_num=100000) [2024-09-11 15:51:32.406505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:32.527757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:32.527803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:32.527810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:32.527819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:32.536376] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8544, clean_start_pos=400000, clean_num=200000) [2024-09-11 15:51:32.606614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:32.736626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:32.736670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:32.736676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:32.736684] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:32.750920] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:32.750960] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12070 [2024-09-11 15:51:32.806806] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:32.925016] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:32.936933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:32.936981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:32.936989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:32.936998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:32.949636] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12070, magic:0x78563412 [2024-09-11 15:51:32.949675] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:32.949682] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:33.006954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:33.085497] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041093085492, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007658, add_bytes: 0 [2024-09-11 15:51:33.092144] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041093092140, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:51:33.108576] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:33.137210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:33.137254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:33.137261] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:33.137268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:33.207166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:33.337561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:33.337606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:33.337614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:33.337624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:33.352144] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:33.352186] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12078 [2024-09-11 15:51:33.407419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:33.537950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:33.537996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:33.538003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:33.538031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:33.550283] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12078, magic:0x78563412 [2024-09-11 15:51:33.550318] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:33.550325] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:33.607600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:33.738238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:33.738282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:33.738288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:33.738295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:33.807791] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:33.925881] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:33.938599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:33.938640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:33.938648] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:33.938657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:33.951721] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:33.951764] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12086 [2024-09-11 15:51:34.007931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:34.093016] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041094093011, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007519, add_bytes: 0 [2024-09-11 15:51:34.099766] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041094099762, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:51:34.108750] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:34.138880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:34.138948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:34.138975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:34.138983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:34.149416] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12086, magic:0x78563412 [2024-09-11 15:51:34.149461] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:34.149468] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:34.208067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:34.339221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:34.339264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:34.339272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:34.339281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:34.408250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:34.539587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:34.539631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:34.539639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:34.539648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:34.546910] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7247, clean_start_pos=600000, clean_num=200000) [2024-09-11 15:51:34.556705] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:34.556748] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12092 [2024-09-11 15:51:34.612778] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4342, replace_start_pos=6100000, replace_num=100000) [2024-09-11 15:51:34.612820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:34.747167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:34.747210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:34.747217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:34.747225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:34.750123] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12092, magic:0x78563412 [2024-09-11 15:51:34.750157] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:34.750166] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:34.812922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:34.947470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:34.947541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:34.947549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:34.947558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:35.013056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:35.026878] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=112] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:35.100632] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041095100628, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:51:35.107445] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041095107442, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 15:51:35.108928] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:35.147765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:35.147806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:35.147813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:35.147821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:35.152184] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:35.152217] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:12104 [2024-09-11 15:51:35.213196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:35.348064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:35.348107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:35.348114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:35.348124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:35.350569] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:12104, magic:0x78563412 [2024-09-11 15:51:35.350603] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:35.350611] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:35.413330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:35.548373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:35.548420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:35.548428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:35.548436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:35.613467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:35.748686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:35.748732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:35.748756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:35.748765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:35.752703] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:35.752734] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30262 [2024-09-11 15:51:35.813605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:35.948726] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30262, magic:0x78563412 [2024-09-11 15:51:35.948787] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:35.948800] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:35.949091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:35.949130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:35.949140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:35.949151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:36.013788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:36.027755] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=106] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:36.108303] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041096108298, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 15:51:36.109021] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=25] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:36.114988] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041096114986, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 15:51:36.149370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:36.149402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:36.149408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:36.149416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:36.213979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:36.349665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:36.349729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:36.349738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:36.349747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:36.350553] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:36.350584] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30270 [2024-09-11 15:51:36.414163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:36.549005] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30270, magic:0x78563412 [2024-09-11 15:51:36.549047] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:36.549054] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:36.550064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:36.550099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:36.550107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:36.550116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:36.558016] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7887, clean_start_pos=800000, clean_num=200000) [2024-09-11 15:51:36.614372] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:36.758264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:36.758308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:36.758316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:36.758326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:36.818926] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4357, replace_start_pos=6200000, replace_num=100000) [2024-09-11 15:51:36.818975] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:36.950669] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:36.950714] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30276 [2024-09-11 15:51:36.958573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:36.958605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:36.958613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:36.958621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:37.019208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:37.028723] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:37.109204] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:37.115864] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041097115861, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 15:51:37.122608] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041097122606, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:51:37.149847] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30276, magic:0x78563412 [2024-09-11 15:51:37.149889] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:37.149896] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:37.158847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:37.158887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:37.158895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:37.158927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:37.219340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:37.359161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:37.359205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:37.359235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:37.359244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:37.419542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:37.550523] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:37.550568] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30290 [2024-09-11 15:51:37.559577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:37.559613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:37.559621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:37.559630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:37.619740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:37.749003] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30290, magic:0x78563412 [2024-09-11 15:51:37.749045] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:37.749052] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:37.759859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:37.759894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:37.759923] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:37.759934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:37.819923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:37.960253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:37.960309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:37.960318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:37.960328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:38.020136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:38.029522] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:38.109318] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:38.123463] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041098123460, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 15:51:38.130247] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041098130243, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 15:51:38.150803] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:38.150843] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30292 [2024-09-11 15:51:38.160627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:38.160681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:38.160689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:38.160699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:38.220359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:38.349483] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30292, magic:0x78563412 [2024-09-11 15:51:38.349523] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:38.349530] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:38.361040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:38.361082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:38.361089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:38.361098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:38.420549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:38.561409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:38.561455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:38.561463] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:38.561472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:38.569255] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7769, clean_start_pos=1000000, clean_num=200000) [2024-09-11 15:51:38.620738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:38.752463] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:38.752506] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30296 [2024-09-11 15:51:38.769591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:38.769629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:38.769638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:38.769647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:38.820887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:38.949880] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30296, magic:0x78563412 [2024-09-11 15:51:38.949933] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:38.949941] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:38.969964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:38.970019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:38.970026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:38.970035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:39.025504] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4401, replace_start_pos=6300000, replace_num=100000) [2024-09-11 15:51:39.025548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:39.030270] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:39.109421] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:39.131158] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041099131155, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 15:51:39.137935] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041099137932, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 15:51:39.170334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:39.170378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:39.170387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:39.170397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:39.225701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:39.352469] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:39.352510] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30300 [2024-09-11 15:51:39.370690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:39.370727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:39.370735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:39.370744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:39.425834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:39.550454] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30300, magic:0x78563412 [2024-09-11 15:51:39.550486] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:39.550508] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:39.571072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:39.571111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:39.571119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:39.571128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:39.625973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:39.771366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:39.771408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:39.771416] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:39.771424] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:39.826201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:39.952131] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:39.952185] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30302 [2024-09-11 15:51:39.952609] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:39.952648] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:39.952731] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=12, max_check_version=13, global_version=14) [2024-09-11 15:51:39.954748] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2018 [2024-09-11 15:51:39.954802] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=40] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:39.954838] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:51:39.954876] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:51:39.954973] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:39.955081] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:51:39.955137] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:51:39.955149] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:51:39.955160] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:51:39.955196] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:51:39.955260] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:51:39.955284] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:51:39.971661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:39.971717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:39.971724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:39.971734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:40.026342] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:40.031027] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:40.109525] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:40.138696] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041100138693, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007538, add_bytes: 0 [2024-09-11 15:51:40.145535] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041100145531, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 15:51:40.150784] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30302, magic:0x78563412 [2024-09-11 15:51:40.150814] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:40.150822] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:40.171987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:40.172025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:40.172032] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:40.172041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:40.226472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:40.372273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:40.372315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:40.372322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:40.372345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:40.426601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:40.554514] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:40.554550] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30314 [2024-09-11 15:51:40.572634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:40.572671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:40.572679] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:40.572689] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:40.580930] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8228, clean_start_pos=1200000, clean_num=200000) [2024-09-11 15:51:40.626803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:40.751267] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30314, magic:0x78563412 [2024-09-11 15:51:40.751305] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:40.751311] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:40.781244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:40.781282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:40.781290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:40.781300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:40.827005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:40.981623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:40.981681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:40.981696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:40.981706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:41.027144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:41.031812] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:41.109638] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:41.146379] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041101146375, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:51:41.153090] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041101153086, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:51:41.153306] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:41.153338] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30318 [2024-09-11 15:51:41.181979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:41.182018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:41.182026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:41.182035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:41.231699] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4415, replace_start_pos=6400000, replace_num=100000) [2024-09-11 15:51:41.231752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:41.351778] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30318, magic:0x78563412 [2024-09-11 15:51:41.351821] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:41.351828] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:41.382279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:41.382315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:41.382323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:41.382347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:41.431921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:41.582652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:41.582691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:41.582699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:41.582709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:41.632108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:41.753608] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:41.753651] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30332 [2024-09-11 15:51:41.783031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:41.783077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:41.783085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:41.783094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:41.832313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:41.952006] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30332, magic:0x78563412 [2024-09-11 15:51:41.952048] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:41.952056] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:41.983396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:41.983471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:41.983480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:41.983489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:41.983708] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=111, refresh_score_time=65, wash_time=0) [2024-09-11 15:51:42.032505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:42.032582] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:42.109750] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:42.153944] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041102153940, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 15:51:42.160694] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041102160690, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:51:42.184053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:42.184097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:42.184104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:42.184114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:42.232697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:42.353818] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:42.353862] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30346 [2024-09-11 15:51:42.384425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:42.384469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:42.384476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:42.384487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:42.432896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:42.552436] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30346, magic:0x78563412 [2024-09-11 15:51:42.552476] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:42.552500] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:42.584801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:42.584840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:42.584849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:42.584858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:42.593279] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8408, clean_start_pos=1400000, clean_num=200000) [2024-09-11 15:51:42.633104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:42.793605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:42.793649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:42.793657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:42.793666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:42.833308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:42.954775] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:42.954820] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30354 [2024-09-11 15:51:42.993990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:42.994031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:42.994038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:42.994048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:43.033498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:43.033498] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:43.109859] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:43.153114] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30354, magic:0x78563412 [2024-09-11 15:51:43.153135] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:43.153160] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:43.161552] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041103161549, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:51:43.168372] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041103168368, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:51:43.194438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:43.194478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:43.194486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:43.194495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:43.233688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:43.394794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:43.394843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:43.394851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:43.394860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:43.438213] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4335, replace_start_pos=6500000, replace_num=100000) [2024-09-11 15:51:43.438261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:43.553851] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:43.553891] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30360 [2024-09-11 15:51:43.595151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:43.595189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:43.595215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:43.595225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:43.638426] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:43.752357] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30360, magic:0x78563412 [2024-09-11 15:51:43.752407] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:43.752414] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:43.795526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:43.795568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:43.795577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:43.795587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:43.838634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:43.995829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:43.995887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:43.995896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:43.995917] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:44.034242] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:44.038827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:44.109978] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:44.154954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:44.154980] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30368 [2024-09-11 15:51:44.169163] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041104169160, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:51:44.175935] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041104175931, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 15:51:44.196217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:44.196262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:44.196287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:44.196297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:44.239011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:44.353144] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30368, magic:0x78563412 [2024-09-11 15:51:44.353180] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:44.353197] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:44.396529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:44.396572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:44.396580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:44.396589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:44.439220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:44.596898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:44.596974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:44.596982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:44.596991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:44.605590] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8585, clean_start_pos=1600000, clean_num=200000) [2024-09-11 15:51:44.639409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:44.754825] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:44.754869] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30380 [2024-09-11 15:51:44.805945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:44.805992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:44.806000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:44.806009] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:44.839582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:44.953253] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30380, magic:0x78563412 [2024-09-11 15:51:44.953315] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:44.953323] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:45.006241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:45.006281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:45.006289] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:45.006297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:45.034999] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:45.039769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:45.110087] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:45.176847] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041105176844, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:51:45.183607] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041105183604, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 15:51:45.206594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:45.206634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:45.206643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:45.206652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:45.239957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:45.355245] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:45.355289] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30390 [2024-09-11 15:51:45.406893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:45.406954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:45.406961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:45.406971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:45.440102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:45.553665] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30390, magic:0x78563412 [2024-09-11 15:51:45.553700] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:45.553707] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:45.607266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:45.607310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:45.607318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:45.607327] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:45.644707] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4415, replace_start_pos=6600000, replace_num=100000) [2024-09-11 15:51:45.644754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:45.807644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:45.807709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:45.807716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:45.807725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:45.844923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:45.955920] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:45.955960] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46442 [2024-09-11 15:51:46.008035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:46.008091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:46.008099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:46.008113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:46.035766] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:46.045123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:46.110199] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:46.154338] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46442, magic:0x78563412 [2024-09-11 15:51:46.154368] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:46.154375] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:46.184472] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041106184468, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:51:46.191171] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041106191167, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 15:51:46.208410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:46.208457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:46.208465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:46.208474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:46.245314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:46.408718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:46.408781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:46.408789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:46.408798] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:46.445505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:46.556997] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:46.557038] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46444 [2024-09-11 15:51:46.609095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:46.609137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:46.609146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:46.609155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:46.616665] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7497, clean_start_pos=1800000, clean_num=200000) [2024-09-11 15:51:46.645754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:46.754950] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46444, magic:0x78563412 [2024-09-11 15:51:46.754989] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:46.754995] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:46.817005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:46.817050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:46.817058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:46.817085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:46.845955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:47.017389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:47.017432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:47.017441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:47.017451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:47.036518] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:47.046138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:47.110310] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:47.156740] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:47.156759] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46448 [2024-09-11 15:51:47.192077] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041107192074, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:51:47.198834] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041107198831, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 15:51:47.217691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:47.217736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:47.217743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:47.217753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:47.246319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:47.355163] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46448, magic:0x78563412 [2024-09-11 15:51:47.355199] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:47.355205] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:47.417969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:47.417997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:47.418012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:47.418020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:47.446513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:47.618243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:47.618277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:47.618283] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:47.618290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:47.646632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:47.757843] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:47.757886] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46452 [2024-09-11 15:51:47.818579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:47.818622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:47.818630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:47.818639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:47.851132] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4367, replace_start_pos=6700000, replace_num=100000) [2024-09-11 15:51:47.851174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:47.955981] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46452, magic:0x78563412 [2024-09-11 15:51:47.956033] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:47.956041] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:48.018875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:48.018950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:48.018959] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:48.018968] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:48.037214] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:48.051277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:48.110411] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:48.199640] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041108199635, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:51:48.206458] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041108206455, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:51:48.219215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:48.219261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:48.219269] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:48.219279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:48.251408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:48.358284] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:48.358327] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46460 [2024-09-11 15:51:48.419581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:48.419620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:48.419628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:48.419638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:48.451597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:48.556575] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46460, magic:0x78563412 [2024-09-11 15:51:48.556623] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:48.556630] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:48.619980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:48.620026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:48.620034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:48.620045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:48.628192] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8135, clean_start_pos=2000000, clean_num=200000) [2024-09-11 15:51:48.651821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:48.828462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:48.828505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:48.828513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:48.828523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:48.852033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:48.966387] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:48.966430] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46468 [2024-09-11 15:51:49.028834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:49.028879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:49.028888] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:49.028935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:49.038069] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:49.052176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:49.110564] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:49.157003] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46468, magic:0x78563412 [2024-09-11 15:51:49.157059] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:49.157067] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:49.207264] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041109207259, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:51:49.214001] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041109213997, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 15:51:49.229236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:49.229272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:49.229281] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:49.229290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:49.252360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:49.429587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:49.429632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:49.429640] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:49.429650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:49.452501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:49.558339] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:49.558378] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46480 [2024-09-11 15:51:49.629988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:49.630031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:49.630039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:49.630063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:49.652685] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:49.757242] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46480, magic:0x78563412 [2024-09-11 15:51:49.757283] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:49.757290] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:49.830369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:49.830415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:49.830423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:49.830433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:49.852883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:49.970332] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:49.970409] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=75] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:49.970486] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=13, max_check_version=14, global_version=15) [2024-09-11 15:51:49.972520] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2032 [2024-09-11 15:51:49.972582] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:49.972615] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:51:49.972654] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:51:49.972737] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:49.972844] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:51:49.972898] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:51:49.972928] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:51:49.972939] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:51:49.972975] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:51:49.973034] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:51:49.973056] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:51:50.030732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:50.030791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:50.030799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:50.030809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:50.038945] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:50.057505] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4390, replace_start_pos=6800000, replace_num=100000) [2024-09-11 15:51:50.057553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:50.110750] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:50.159725] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:50.159770] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46482 [2024-09-11 15:51:50.214876] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041110214872, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:51:50.221614] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041110221611, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:51:50.231118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:50.231153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:50.231162] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:50.231171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:50.257726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:50.356837] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46482, magic:0x78563412 [2024-09-11 15:51:50.356876] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:50.356883] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:50.431471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:50.431510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:50.431537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:50.431547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:50.457922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:50.631842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:50.631882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:50.631890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:50.631900] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:50.640417] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8483, clean_start_pos=2200000, clean_num=200000) [2024-09-11 15:51:50.658123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:50.758522] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:50.758565] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46492 [2024-09-11 15:51:50.840680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:50.840727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:50.840735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:50.840744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:50.840957] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:51:50.858336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:50.956028] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46492, magic:0x78563412 [2024-09-11 15:51:50.956069] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:50.956076] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:51.039657] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:51.041191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:51.041289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=97][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:51.041298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:51.041307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:51.058494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:51.110932] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:51.222538] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041111222533, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 15:51:51.229308] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041111229303, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 15:51:51.241609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:51.241654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:51.241662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:51.241671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:51.258693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:51.358323] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:51.358368] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46504 [2024-09-11 15:51:51.441999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:51.442044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:51.442052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:51.442062] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:51.458831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:51.556670] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46504, magic:0x78563412 [2024-09-11 15:51:51.556709] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:51.556716] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:51.642359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:51.642403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:51.642411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:51.642420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:51.659035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:51.842715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:51.842762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:51.842770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:51.842780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:51.859227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:51.958531] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:51.958576] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46516 [2024-09-11 15:51:52.040444] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:52.043112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:52.043142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:52.043150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:52.043160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:52.059418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:52.111114] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:52.156817] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46516, magic:0x78563412 [2024-09-11 15:51:52.156878] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:52.156886] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:52.230187] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041112230181, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007648, add_bytes: 0 [2024-09-11 15:51:52.236920] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041112236915, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:51:52.243459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:52.243497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:52.243505] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:52.243514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:52.264035] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4418, replace_start_pos=6900000, replace_num=100000) [2024-09-11 15:51:52.264079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:52.443830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:52.443875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:52.443883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:52.443893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:52.464251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:52.558976] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:52.559019] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46532 [2024-09-11 15:51:52.644219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:52.644281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:52.644290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:52.644300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:52.652525] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8212, clean_start_pos=2400000, clean_num=200000) [2024-09-11 15:51:52.664451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:52.757286] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46532, magic:0x78563412 [2024-09-11 15:51:52.757327] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:52.757334] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:52.852771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:52.852813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:52.852821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:52.852830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:52.864576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:53.041277] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:53.053202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:53.053247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:53.053255] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:53.053265] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:53.064705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:53.111289] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:53.159529] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:53.159573] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46540 [2024-09-11 15:51:53.237827] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041113237822, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2024-09-11 15:51:53.244463] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041113244459, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 15:51:53.253569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:53.253610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:53.253618] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:53.253628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:53.264898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:53.357950] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46540, magic:0x78563412 [2024-09-11 15:51:53.357989] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:53.357995] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:53.453951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:53.453996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:53.454004] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:53.454014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:53.465120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:53.654328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:53.654375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:53.654383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:53.654393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:53.665314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:53.760043] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:53.760088] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46554 [2024-09-11 15:51:53.854732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:53.854777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:53.854785] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:53.854795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:53.865507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:53.958505] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46554, magic:0x78563412 [2024-09-11 15:51:53.958547] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:53.958555] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:54.042035] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:54.055102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:54.055147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:54.055156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:54.055166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:54.065652] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:54.111408] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:54.245335] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=108] PNIO [ratelimit] time: 1726041114245330, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007508, add_bytes: 0 [2024-09-11 15:51:54.252082] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041114252078, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:51:54.255524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:54.255559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:54.255567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:54.255593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:54.265854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:54.361186] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:54.361227] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46566 [2024-09-11 15:51:54.455895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:54.455958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:54.455966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:54.455976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:54.470315] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4326, replace_start_pos=7000000, replace_num=100000) [2024-09-11 15:51:54.470365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:54.558962] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46566, magic:0x78563412 [2024-09-11 15:51:54.559002] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:54.559012] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:54.656211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:54.656253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:54.656261] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:54.656270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:54.664838] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8555, clean_start_pos=2600000, clean_num=200000) [2024-09-11 15:51:54.670527] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:54.865112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:54.865158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:54.865166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:54.865175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:54.870707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:54.960958] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:54.961001] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46578 [2024-09-11 15:51:55.042805] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:55.065471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:55.065509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:55.065517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:55.065527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:55.070936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:55.111627] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:55.159466] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46578, magic:0x78563412 [2024-09-11 15:51:55.159505] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:55.159512] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:55.253015] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041115253012, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:51:55.259786] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041115259782, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007704, add_bytes: 0 [2024-09-11 15:51:55.265888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:55.265944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:55.265950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:55.265959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:55.271130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:55.466287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:55.466331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:55.466338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:55.466347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:55.471259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:55.561994] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:55.562037] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21140 [2024-09-11 15:51:55.666596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:55.666642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:55.666649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:55.666657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:55.671443] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:55.760062] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21140, magic:0x78563412 [2024-09-11 15:51:55.760100] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:55.760106] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:55.866983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:55.867043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:55.867050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:55.867058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:55.871626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:56.043609] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=111] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:56.067265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:56.067304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:56.067310] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:56.067318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:56.071763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:56.111743] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:56.162221] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:56.162259] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21154 [2024-09-11 15:51:56.260630] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041116260626, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:51:56.267398] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041116267395, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:51:56.267550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:56.267578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:56.267585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:56.267593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:56.271888] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:56.360608] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21154, magic:0x78563412 [2024-09-11 15:51:56.360650] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:56.360658] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:56.467804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:56.467877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:56.467883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:56.467890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:56.472084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:56.668133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:56.668179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:56.668186] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:56.668194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:56.674883] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6676, clean_start_pos=2800000, clean_num=200000) [2024-09-11 15:51:56.676661] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4401, replace_start_pos=7100000, replace_num=100000) [2024-09-11 15:51:56.676695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:56.761836] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:56.761878] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21170 [2024-09-11 15:51:56.875155] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:56.875193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:56.875199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:56.875207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:56.876851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:56.959819] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21170, magic:0x78563412 [2024-09-11 15:51:56.959861] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:56.959867] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:57.044513] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=101] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:57.075477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:57.075525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:57.075533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:57.075542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:57.076975] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:57.111852] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:57.268171] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041117268166, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007540, add_bytes: 0 [2024-09-11 15:51:57.274997] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041117274992, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 15:51:57.275768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:57.275798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:57.275805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:57.275814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:57.277113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:57.361993] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:57.362037] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21184 [2024-09-11 15:51:57.476063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:57.476106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:57.476116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:57.476124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:57.477281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:57.560167] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21184, magic:0x78563412 [2024-09-11 15:51:57.560208] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:57.560215] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:57.676380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:57.676422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:57.676429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:57.676437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:57.677412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:57.876734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:57.876781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:57.876788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:57.876797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:57.877589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:51:57.962537] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:57.962581] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21192 [2024-09-11 15:51:58.045370] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:58.077100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:58.077141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:58.077148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:58.077155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:58.077803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:51:58.111964] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:58.160967] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21192, magic:0x78563412 [2024-09-11 15:51:58.161009] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:58.161017] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:58.275786] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041118275781, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:51:58.277396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:58.277421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:58.277428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:58.277437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:58.277991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:51:58.282546] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041118282543, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 15:51:58.477669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:58.477713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:58.477721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:58.477730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:58.478118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:51:58.563141] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:58.563185] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21204 [2024-09-11 15:51:58.677984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:58.678047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:58.678054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:58.678063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:58.678230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:51:58.685297] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7221, clean_start_pos=3000000, clean_num=200000) [2024-09-11 15:51:58.761409] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21204, magic:0x78563412 [2024-09-11 15:51:58.761450] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:58.761456] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:58.882712] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4357, replace_start_pos=7200000, replace_num=100000) [2024-09-11 15:51:58.882759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:51:58.885529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:58.885570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:58.885577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:58.885584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:59.046231] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:51:59.082939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:51:59.085800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:59.085829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:59.085836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:59.085843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:59.112091] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:51:59.163619] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:59.163669] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21212 [2024-09-11 15:51:59.283101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:51:59.283399] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041119283397, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:51:59.286101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:59.286133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:59.286141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:59.286150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:59.290227] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041119290224, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:51:59.361814] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21212, magic:0x78563412 [2024-09-11 15:51:59.361856] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:59.361863] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:59.483293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:51:59.486377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:59.486405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:59.486414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:59.486424] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:59.683456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:51:59.686721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:59.686748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:59.686769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:59.686779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:59.763723] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:51:59.763766] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21226 [2024-09-11 15:51:59.883663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:51:59.887032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:51:59.887063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:51:59.887071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:51:59.887080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:51:59.962477] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21226, magic:0x78563412 [2024-09-11 15:51:59.962515] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:51:59.962522] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:51:59.988173] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:59.988224] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:51:59.988308] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=14, max_check_version=15, global_version=16) [2024-09-11 15:51:59.990286] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1978 [2024-09-11 15:51:59.990340] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:59.990373] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:51:59.990409] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:51:59.990489] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:51:59.990585] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 15:51:59.990634] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:51:59.990645] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:51:59.990655] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:51:59.990689] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:51:59.990746] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:51:59.990763] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:52:00.047053] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:00.083806] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:00.087303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:00.087335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:00.087342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:00.087351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:00.112200] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:00.276894] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 15:52:00.283965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:00.287581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:00.287615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:00.287623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:00.287632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:00.291125] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726041120291123, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007726, add_bytes: 0 [2024-09-11 15:52:00.291157] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 15:52:00.295535] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 15:52:00.297774] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041120297772, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:52:00.297800] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:52:00.364146] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:00.364180] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21232 [2024-09-11 15:52:00.484204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:00.487985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:00.488027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:00.488035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:00.488046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:00.562708] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21232, magic:0x78563412 [2024-09-11 15:52:00.562742] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:00.562749] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:00.684363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:00.688249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:00.688276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:00.688283] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:00.688290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:00.694911] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6612, clean_start_pos=3200000, clean_num=200000) [2024-09-11 15:52:00.884504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:00.895184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:00.895231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:00.895239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:00.895247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:00.964716] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:00.964763] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21244 [2024-09-11 15:52:01.047835] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:01.089179] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4473, replace_start_pos=7300000, replace_num=100000) [2024-09-11 15:52:01.089232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:01.095499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:01.095531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:01.095539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:01.095549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:01.112313] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:01.162184] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21244, magic:0x78563412 [2024-09-11 15:52:01.162221] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:01.162228] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:01.289364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:01.295763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:01.295790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:01.295796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:01.295803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:01.298710] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726041121298707, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007584, add_bytes: 0 [2024-09-11 15:52:01.305399] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726041121305395, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:52:01.489552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:01.496049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:01.496088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:01.496109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:01.496117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:01.563947] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:01.563987] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21250 [2024-09-11 15:52:01.689746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:01.696363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:01.696407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:01.696414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:01.696421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:01.762634] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21250, magic:0x78563412 [2024-09-11 15:52:01.762669] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:01.762675] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:01.889871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:01.896654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:01.896693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:01.896701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:01.896710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:02.048569] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:02.090078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:02.096963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:02.096999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:02.097005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:02.097013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:02.112425] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:02.164376] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:02.164404] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21252 [2024-09-11 15:52:02.290224] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:02.297255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:02.297294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:02.297300] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:02.297307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:02.297485] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=67, refresh_score_time=58, wash_time=0) [2024-09-11 15:52:02.306325] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041122306322, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:52:02.313009] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041122313005, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:52:02.363043] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21252, magic:0x78563412 [2024-09-11 15:52:02.363085] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:02.363093] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:02.490365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:02.497724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:02.497763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:02.497771] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:02.497780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:02.690551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:02.698087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:02.698124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:02.698130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:02.698139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:02.704985] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6834, clean_start_pos=3400000, clean_num=200000) [2024-09-11 15:52:02.764957] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:02.764998] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21268 [2024-09-11 15:52:02.890813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:02.905232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:02.905275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:02.905282] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:02.905289] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:02.963542] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21268, magic:0x78563412 [2024-09-11 15:52:02.963583] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:02.963591] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:03.049323] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:03.091011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:03.105525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:03.105567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:03.105575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:03.105584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:03.112535] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:03.295607] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4391, replace_start_pos=7400000, replace_num=100000) [2024-09-11 15:52:03.295651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:03.305841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:03.305887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:03.305894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:03.305923] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:03.313881] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041123313876, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 15:52:03.320624] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041123320620, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:52:03.364381] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:03.364416] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21280 [2024-09-11 15:52:03.495803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:03.506159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:03.506203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:03.506211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:03.506220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:03.562998] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21280, magic:0x78563412 [2024-09-11 15:52:03.563033] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:03.563054] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:03.695937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:03.706436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:03.706471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:03.706477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:03.706485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:03.896132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:03.906705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:03.906746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:03.906752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:03.906760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:03.963794] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:03.963838] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21284 [2024-09-11 15:52:04.096363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:04.107015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:04.107063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:04.107070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:04.107077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:04.112626] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=24] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:04.150226] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:04.162501] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21284, magic:0x78563412 [2024-09-11 15:52:04.162526] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:04.162534] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:04.296576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:04.307376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:04.307426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:04.307434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:04.307444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:04.321548] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041124321544, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 15:52:04.328240] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041124328237, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:52:04.496771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:04.507659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:04.507692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:04.507698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:04.507705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:04.564194] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:04.564239] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21298 [2024-09-11 15:52:04.696895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:04.707948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:04.707991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:04.707996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:04.708004] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:04.714550] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6515, clean_start_pos=3600000, clean_num=200000) [2024-09-11 15:52:04.761852] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21298, magic:0x78563412 [2024-09-11 15:52:04.761891] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:04.761898] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:04.897092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:04.914805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:04.914846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:04.914852] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:04.914860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:05.097277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:05.112740] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:05.115083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:05.115116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:05.115122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:05.115130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:05.151033] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:05.164064] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:05.164085] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21308 [2024-09-11 15:52:05.297451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:05.315331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:05.315389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:05.315396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:05.315404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:05.329172] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041125329167, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:52:05.335850] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041125335847, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:52:05.362407] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21308, magic:0x78563412 [2024-09-11 15:52:05.362431] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:05.362437] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:05.501506] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3919, replace_start_pos=7500000, replace_num=100000) [2024-09-11 15:52:05.501542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:05.515645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:05.515693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:05.515701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:05.515710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:05.701696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:05.715980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:05.716023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:05.716031] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:05.716040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:05.764432] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:05.764477] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3266 [2024-09-11 15:52:05.901890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:05.916277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:05.916320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:05.916328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:05.916337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:05.961846] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3266, magic:0x78563412 [2024-09-11 15:52:05.961887] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:05.961895] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:06.102114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:06.112873] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:06.116545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:06.116573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:06.116580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:06.116587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:06.152267] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:06.302330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:06.316793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:06.316838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:06.316844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:06.316851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:06.336779] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041126336775, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:52:06.343498] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041126343494, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007647, add_bytes: 0 [2024-09-11 15:52:06.363997] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:06.364058] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3278 [2024-09-11 15:52:06.502544] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:06.517079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:06.517123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:06.517131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:06.517140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:06.562569] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3278, magic:0x78563412 [2024-09-11 15:52:06.562612] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:06.562621] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:06.702683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:06.717357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:06.717397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:06.717404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:06.717413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:06.725726] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8299, clean_start_pos=3800000, clean_num=200000) [2024-09-11 15:52:06.902818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:06.926140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:06.926182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:06.926211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:06.926220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:06.964387] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:06.964436] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3282 [2024-09-11 15:52:07.102964] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:07.113085] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:07.126446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:07.126493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:07.126500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:07.126514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:07.153134] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:07.163040] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3282, magic:0x78563412 [2024-09-11 15:52:07.163075] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:07.163083] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:07.303159] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:07.326742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:07.326791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:07.326799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:07.326808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:07.344393] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041127344389, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:52:07.351154] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041127351150, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007656, add_bytes: 0 [2024-09-11 15:52:07.503366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:07.527035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:07.527093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:07.527099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:07.527107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:07.564967] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:07.565011] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3298 [2024-09-11 15:52:07.707706] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4146, replace_start_pos=7600000, replace_num=100000) [2024-09-11 15:52:07.707755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:07.727336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:07.727383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:07.727391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:07.727400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:07.763555] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3298, magic:0x78563412 [2024-09-11 15:52:07.763587] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:07.763592] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:07.907929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:07.927701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:07.927745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:07.927753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:07.927779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:08.108150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:08.113199] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:08.128054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:08.128100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:08.128108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:08.128118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:08.154105] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:08.165687] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:08.165719] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3300 [2024-09-11 15:52:08.308313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:08.328384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:08.328426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:08.328434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:08.328442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:08.351952] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041128351948, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 15:52:08.358713] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041128358708, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:52:08.364165] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3300, magic:0x78563412 [2024-09-11 15:52:08.364195] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:08.364201] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:08.508456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:08.528695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:08.528739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:08.528746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:08.528777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:08.708790] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:08.729051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:08.729094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:08.729103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:08.729112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:08.737627] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8500, clean_start_pos=4000000, clean_num=200000) [2024-09-11 15:52:08.765086] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:08.765132] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3304 [2024-09-11 15:52:08.908995] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:08.937973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:08.938019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:08.938026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:08.938035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:08.963522] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3304, magic:0x78563412 [2024-09-11 15:52:08.963563] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:08.963570] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:09.109234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:09.113313] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:09.138341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:09.138390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:09.138400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:09.138411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:09.154959] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:09.309428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:09.338706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:09.338751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:09.338758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:09.338767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:09.359580] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041129359576, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 15:52:09.365328] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:09.365374] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3312 [2024-09-11 15:52:09.366319] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041129366318, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:52:09.509638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:09.538994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:09.539032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:09.539039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:09.539047] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:09.563876] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3312, magic:0x78563412 [2024-09-11 15:52:09.563926] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:09.563934] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:09.709823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:09.739250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:09.739290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:09.739296] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:09.739303] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:09.914434] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4367, replace_start_pos=7700000, replace_num=100000) [2024-09-11 15:52:09.914481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:09.939534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:09.939583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:09.939592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:09.939602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:09.966313] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:09.966353] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3326 [2024-09-11 15:52:10.006697] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:10.006748] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:10.006818] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=15, max_check_version=16, global_version=17) [2024-09-11 15:52:10.008538] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1720 [2024-09-11 15:52:10.008598] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:10.008631] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:52:10.008663] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:52:10.008737] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:10.008819] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:52:10.008864] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:52:10.008873] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:52:10.008882] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:52:10.008925] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:52:10.008976] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:52:10.008991] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:52:10.113423] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=28] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:10.114663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:10.139809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:10.139853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:10.139860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:10.139869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:10.155945] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:10.164320] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3326, magic:0x78563412 [2024-09-11 15:52:10.164362] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:10.164369] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:10.314788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:10.340094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:10.340133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:10.340140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:10.340149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:10.367172] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041130367170, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 15:52:10.374006] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726041130374003, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 15:52:10.514979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:10.540357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:10.540423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:10.540430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:10.540439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:10.566175] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:10.566220] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3336 [2024-09-11 15:52:10.715170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:10.740649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:10.740694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:10.740699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:10.740707] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:10.747234] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6514, clean_start_pos=4200000, clean_num=200000) [2024-09-11 15:52:10.764970] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3336, magic:0x78563412 [2024-09-11 15:52:10.765011] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:10.765018] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:10.915362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:10.947495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:10.947557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:10.947566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:10.947591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:11.113582] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=88] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:11.115497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:11.147862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:11.147930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:11.147937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:11.147945] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:11.156911] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:11.166777] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:11.166801] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3346 [2024-09-11 15:52:11.315674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:11.348253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:11.348300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:11.348308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:11.348318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:11.364164] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3346, magic:0x78563412 [2024-09-11 15:52:11.364203] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:11.364211] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:11.374875] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041131374872, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007702, add_bytes: 0 [2024-09-11 15:52:11.381562] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041131381558, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:52:11.515856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:11.548639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:11.548692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:11.548702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:11.548732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:11.716012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:11.749000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:11.749043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:11.749051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:11.749060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:11.765139] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:11.765175] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3354 [2024-09-11 15:52:11.916201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:11.949277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:11.949320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:11.949326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:11.949334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:11.963757] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3354, magic:0x78563412 [2024-09-11 15:52:11.963797] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:11.963804] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:12.113705] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:12.120730] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4301, replace_start_pos=7800000, replace_num=100000) [2024-09-11 15:52:12.120792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:12.149630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:12.149674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:12.149683] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:12.149692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:12.157658] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:12.320952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:12.349936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:12.349978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:12.349984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:12.349991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:12.365015] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:12.365054] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3362 [2024-09-11 15:52:12.382492] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=80] PNIO [ratelimit] time: 1726041132382488, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:52:12.389170] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041132389167, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:52:12.521088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:12.550240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:12.550286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:12.550293] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:12.550303] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:12.562059] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3362, magic:0x78563412 [2024-09-11 15:52:12.562112] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:12.562120] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:12.721289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:12.750535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:12.750586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:12.750592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:12.750600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:12.757372] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6758, clean_start_pos=4400000, clean_num=200000) [2024-09-11 15:52:12.921486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:12.957731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:12.957773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:12.957780] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:12.957789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:12.965675] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:12.965713] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3378 [2024-09-11 15:52:13.113838] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:13.121686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:13.158100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:13.158146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:13.158155] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:13.158183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:13.158558] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:13.162671] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3378, magic:0x78563412 [2024-09-11 15:52:13.162709] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:13.162717] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:13.321825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:13.358417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:13.358462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:13.358468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:13.358476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:13.390102] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041133390099, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:52:13.396849] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041133396845, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:52:13.522029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:13.558797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:13.558837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:13.558846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:13.558855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:13.564266] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:13.564314] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3386 [2024-09-11 15:52:13.722223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:13.759101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:13.759148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:13.759155] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:13.759180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:13.762897] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3386, magic:0x78563412 [2024-09-11 15:52:13.762944] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:13.762951] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:13.922418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:13.959413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:13.959457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:13.959463] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:13.959471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:14.114009] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:14.122642] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:14.159539] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:14.159720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:14.159753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:14.159760] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:14.159769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:14.165148] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:14.165186] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3402 [2024-09-11 15:52:14.327063] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4242, replace_start_pos=7900000, replace_num=100000) [2024-09-11 15:52:14.327107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:14.360062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:14.360288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=225][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:14.360300] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:14.360328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:14.363520] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3402, magic:0x78563412 [2024-09-11 15:52:14.363550] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:14.363557] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:14.397668] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041134397663, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 15:52:14.404471] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041134404467, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:52:14.527263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:14.560677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:14.560723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:14.560731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:14.560740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:14.727389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:14.760982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:14.761022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:14.761028] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:14.761036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:14.765495] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:14.765531] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3418 [2024-09-11 15:52:14.767932] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6884, clean_start_pos=4600000, clean_num=200000) [2024-09-11 15:52:14.927532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:14.963641] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3418, magic:0x78563412 [2024-09-11 15:52:14.963678] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:14.963686] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:14.968247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:14.968282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:14.968290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:14.968299] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:15.114135] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:15.127710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:15.160555] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:15.168539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:15.168576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:15.168584] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:15.168594] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:15.327860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:15.365751] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:15.365793] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3420 [2024-09-11 15:52:15.368821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:15.368853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:15.368859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:15.368867] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:15.405262] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041135405258, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 15:52:15.412015] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041135412011, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 15:52:15.528085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:15.564231] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3420, magic:0x78563412 [2024-09-11 15:52:15.564270] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:15.564277] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:15.569140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:15.569182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:15.569190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:15.569199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:15.728228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:15.769419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:15.769462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:15.769468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:15.769476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:15.928429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:15.965993] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:15.966047] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51966 [2024-09-11 15:52:15.969706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:15.969743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:15.969749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:15.969757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:16.114372] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:16.128552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:16.161482] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:16.164745] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51966, magic:0x78563412 [2024-09-11 15:52:16.164783] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:16.164791] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:16.170006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:16.170089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:16.170098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:16.170107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:16.328675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:16.370334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:16.370383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:16.370389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:16.370397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:16.412940] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041136412936, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:52:16.419630] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041136419628, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:52:16.532556] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3688, replace_start_pos=8000000, replace_num=100000) [2024-09-11 15:52:16.532595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:16.566789] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:16.566832] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51970 [2024-09-11 15:52:16.570622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:16.570659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:16.570666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:16.570673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:16.732813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:16.765140] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51970, magic:0x78563412 [2024-09-11 15:52:16.765176] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:16.765183] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:16.770934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:16.770964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:16.770972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:16.770980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:16.778123] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7130, clean_start_pos=4800000, clean_num=200000) [2024-09-11 15:52:16.933014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:16.978377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:16.978422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:16.978443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:16.978450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:17.114501] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:17.133201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:17.162335] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:17.167003] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:17.167033] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51974 [2024-09-11 15:52:17.178678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:17.178714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:17.178722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:17.178730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:17.333345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:17.365574] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51974, magic:0x78563412 [2024-09-11 15:52:17.365618] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:17.365676] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:17.379003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:17.379039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:17.379046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:17.379054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:17.420554] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041137420551, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:52:17.427248] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041137427244, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:52:17.533537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:17.579277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:17.579327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:17.579358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:17.579367] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:17.733745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:17.767680] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:17.767724] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51980 [2024-09-11 15:52:17.779592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:17.779636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:17.779644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:17.779652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:17.933889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:17.966199] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51980, magic:0x78563412 [2024-09-11 15:52:17.966232] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:17.966239] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:17.979921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:17.979964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:17.979972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:17.979981] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:18.114624] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:18.134042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:18.163105] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:18.180198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:18.180238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:18.180244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:18.180268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:18.334236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:18.368405] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:18.368449] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51988 [2024-09-11 15:52:18.380483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:18.380518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:18.380524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:18.380531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:18.428226] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041138428223, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:52:18.434864] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041138434861, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:52:18.534437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:18.566517] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51988, magic:0x78563412 [2024-09-11 15:52:18.566552] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:18.566559] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:18.580743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:18.580780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:18.580786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:18.580793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:18.738985] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4364, replace_start_pos=8100000, replace_num=100000) [2024-09-11 15:52:18.739031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:18.781067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:18.781121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:18.781128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:18.781136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:18.787655] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6507, clean_start_pos=5000000, clean_num=200000) [2024-09-11 15:52:18.939195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:18.968888] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:18.968950] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52002 [2024-09-11 15:52:18.987928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:18.987970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:18.987976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:18.987984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:19.114842] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:19.139381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:19.164042] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:19.167201] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52002, magic:0x78563412 [2024-09-11 15:52:19.167232] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:19.167239] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:19.188292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:19.188331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:19.188337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:19.188359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:19.339583] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:19.388573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:19.388617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:19.388623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:19.388632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:19.435809] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041139435804, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007581, add_bytes: 0 [2024-09-11 15:52:19.442548] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726041139442545, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:52:19.539778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:19.568959] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:19.569007] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52004 [2024-09-11 15:52:19.588846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:19.588889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:19.588895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:19.588922] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:19.739958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:19.767328] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52004, magic:0x78563412 [2024-09-11 15:52:19.767369] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:19.767393] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:19.789153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:19.789192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:19.789199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:19.789207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:19.940148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:19.989423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:19.989462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:19.989468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:19.989475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:20.022942] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:20.022995] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:20.023073] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=16, max_check_version=17, global_version=18) [2024-09-11 15:52:20.025133] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2059 [2024-09-11 15:52:20.025193] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:20.025228] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:52:20.025266] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:52:20.025350] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:20.025457] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:52:20.025512] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:52:20.025524] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:52:20.025535] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:52:20.025572] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:52:20.025632] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:52:20.025653] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:52:20.114981] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:20.140355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:20.164926] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:20.169114] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:20.169148] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52014 [2024-09-11 15:52:20.189920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:20.189964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:20.189970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:20.189977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:20.340494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:20.366696] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52014, magic:0x78563412 [2024-09-11 15:52:20.366736] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:20.366744] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:20.390197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:20.390238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:20.390244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:20.390252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:20.443356] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041140443351, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 15:52:20.450172] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041140450168, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:52:20.540683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:20.590454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:20.590492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:20.590498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:20.590521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:20.740896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:20.767368] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:20.767413] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52028 [2024-09-11 15:52:20.790784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:20.790821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:20.790826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:20.790834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:20.797416] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6571, clean_start_pos=5200000, clean_num=200000) [2024-09-11 15:52:20.945490] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4380, replace_start_pos=8200000, replace_num=100000) [2024-09-11 15:52:20.945537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:20.964979] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52028, magic:0x78563412 [2024-09-11 15:52:20.965022] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:20.965029] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:20.997770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:20.997813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:20.997819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:20.997828] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:20.998025] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:52:21.115207] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:21.145689] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:21.165709] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:21.198285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:21.198330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:21.198339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:21.198349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:21.345829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:21.367111] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:21.367156] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52036 [2024-09-11 15:52:21.398706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:21.398748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:21.398756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:21.398765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:21.451018] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041141451013, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007662, add_bytes: 0 [2024-09-11 15:52:21.457843] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041141457840, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:52:21.545976] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:21.565477] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52036, magic:0x78563412 [2024-09-11 15:52:21.565517] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:21.565524] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:21.599056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:21.599096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:21.599120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:21.599129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:21.746112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:21.799349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:21.799391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:21.799397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:21.799405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:21.946304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:21.967752] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:21.967795] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52040 [2024-09-11 15:52:21.999638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:21.999685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:21.999693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:21.999702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:22.115319] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:22.146497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:22.166076] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52040, magic:0x78563412 [2024-09-11 15:52:22.166140] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:22.166148] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:22.166580] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:22.199928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:22.199966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:22.199972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:22.199993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:22.346624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:22.400210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:22.400249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:22.400255] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:22.400264] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:22.458634] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041142458630, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:52:22.465399] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041142465395, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:52:22.546831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:22.568119] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:22.568163] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52048 [2024-09-11 15:52:22.600486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:22.600528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:22.600535] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:22.600545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:22.600762] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=76, refresh_score_time=63, wash_time=0) [2024-09-11 15:52:22.747026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:22.766532] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52048, magic:0x78563412 [2024-09-11 15:52:22.766598] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=59] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:22.766606] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:22.800993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:22.801036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:22.801042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:22.801049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:22.807588] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6526, clean_start_pos=5400000, clean_num=200000) [2024-09-11 15:52:22.947175] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:23.007939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:23.007985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:23.007993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:23.008003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:23.115440] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:23.151674] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4362, replace_start_pos=8300000, replace_num=100000) [2024-09-11 15:52:23.151717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:23.167398] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:23.168368] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:23.168389] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52064 [2024-09-11 15:52:23.208264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:23.208313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:23.208321] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:23.208330] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:23.351827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:23.366806] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52064, magic:0x78563412 [2024-09-11 15:52:23.366844] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:23.366852] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:23.408678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:23.408719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:23.408727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:23.408736] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:23.466251] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041143466247, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:52:23.472944] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041143472940, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 15:52:23.552046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:23.609011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:23.609059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:23.609067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:23.609075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:23.752263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:23.769010] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:23.769054] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52066 [2024-09-11 15:52:23.809302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:23.809379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:23.809388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:23.809398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:23.952456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:23.967502] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52066, magic:0x78563412 [2024-09-11 15:52:23.967543] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:23.967551] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:24.009622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:24.009665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:24.009671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:24.009679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:24.115555] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:24.152650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:24.168313] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:24.209898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:24.209964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:24.209970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:24.209978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:24.352839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:24.368986] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:24.369030] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52078 [2024-09-11 15:52:24.410220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:24.410265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:24.410291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:24.410301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:24.473866] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041144473862, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:52:24.480640] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041144480637, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 15:52:24.552978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:24.567685] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52078, magic:0x78563412 [2024-09-11 15:52:24.567728] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:24.567736] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:24.610565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:24.610611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:24.610619] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:24.610627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:24.753114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:24.810855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:24.810898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:24.810921] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:24.810928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:24.817455] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6516, clean_start_pos=5600000, clean_num=200000) [2024-09-11 15:52:24.953317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:24.970110] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:24.970153] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52084 [2024-09-11 15:52:25.017733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:25.017774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:25.017782] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:25.017791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:25.115701] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:25.153506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:25.168405] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52084, magic:0x78563412 [2024-09-11 15:52:25.168435] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:25.168442] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:25.169238] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:25.218054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:25.218095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:25.218103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:25.218112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:25.358087] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4381, replace_start_pos=8400000, replace_num=100000) [2024-09-11 15:52:25.358135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:25.418336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:25.418384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:25.418391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:25.418400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:25.481484] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726041145481480, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:52:25.488194] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041145488190, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:52:25.558294] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:25.570398] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:25.570443] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9646 [2024-09-11 15:52:25.618641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:25.618685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:25.618692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:25.618702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:25.758488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:25.768881] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9646, magic:0x78563412 [2024-09-11 15:52:25.768940] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:25.768949] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:25.818947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:25.818989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:25.818996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:25.819006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:25.958682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:26.019215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:26.019251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:26.019257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:26.019264] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:26.115847] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:26.158839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:26.170103] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=46] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:26.170631] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:26.170650] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9662 [2024-09-11 15:52:26.219509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:26.219563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:26.219572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:26.219581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:26.359027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:26.369100] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9662, magic:0x78563412 [2024-09-11 15:52:26.369139] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:26.369147] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:26.419828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:26.419874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:26.419881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:26.419890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:26.489062] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041146489058, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007578, add_bytes: 0 [2024-09-11 15:52:26.495800] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041146495795, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:52:26.559172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:26.620166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:26.620210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:26.620217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:26.620227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:26.759401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:26.772606] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:26.772645] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9668 [2024-09-11 15:52:26.820442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:26.820485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:26.820491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:26.820499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:26.827071] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6560, clean_start_pos=5800000, clean_num=200000) [2024-09-11 15:52:26.959626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:26.969793] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9668, magic:0x78563412 [2024-09-11 15:52:26.969830] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:26.969839] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:27.027302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:27.027337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:27.027358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:27.027365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:27.115984] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:27.159819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:27.171024] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:27.227601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:27.227642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:27.227650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:27.227659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:27.360026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:27.371586] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:27.371630] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9672 [2024-09-11 15:52:27.427974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:27.428014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:27.428021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:27.428029] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:27.496657] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041147496653, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 15:52:27.503407] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041147503404, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:52:27.564420] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4196, replace_start_pos=8500000, replace_num=100000) [2024-09-11 15:52:27.564457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:27.570232] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9672, magic:0x78563412 [2024-09-11 15:52:27.570259] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:27.570265] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:27.628245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:27.628284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:27.628290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:27.628298] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:27.764559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:27.828519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:27.828564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:27.828572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:27.828581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:27.964693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:27.972179] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:27.972211] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9674 [2024-09-11 15:52:28.028830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:28.028876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:28.028884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:28.028893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:28.116093] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:28.164821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:28.170454] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9674, magic:0x78563412 [2024-09-11 15:52:28.170485] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:28.170491] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:28.171753] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:28.229146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:28.229207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:28.229215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:28.229224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:28.365087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=158] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:28.429526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:28.429568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:28.429576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:28.429586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:28.504259] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041148504254, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 15:52:28.511119] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041148511117, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007713, add_bytes: 0 [2024-09-11 15:52:28.565287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:28.572588] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:28.572626] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9688 [2024-09-11 15:52:28.629823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:28.629877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:28.629886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:28.629895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:28.765473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:28.770810] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9688, magic:0x78563412 [2024-09-11 15:52:28.770848] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:28.770855] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:28.830214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:28.830258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:28.830266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:28.830275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:28.837754] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7466, clean_start_pos=6000000, clean_num=200000) [2024-09-11 15:52:28.965714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:29.038067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:29.038105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:29.038113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:29.038122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:29.116220] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:29.165923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:29.172660] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:29.173255] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:29.173273] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9704 [2024-09-11 15:52:29.238420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:29.238462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:29.238471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:29.238481] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:29.366121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:29.371473] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9704, magic:0x78563412 [2024-09-11 15:52:29.371506] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:29.371515] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:29.438784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:29.438831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:29.438838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:29.438848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:29.511945] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041149511941, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:52:29.518643] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041149518639, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007522, add_bytes: 0 [2024-09-11 15:52:29.566281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:29.639192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:29.639232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:29.639240] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:29.639249] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:29.770775] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4354, replace_start_pos=8600000, replace_num=100000) [2024-09-11 15:52:29.770823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:29.772493] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:29.772521] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9706 [2024-09-11 15:52:29.839602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:29.839649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:29.839657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:29.839666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:29.970611] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9706, magic:0x78563412 [2024-09-11 15:52:29.970659] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:29.970667] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:29.970920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:30.039887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:30.039891] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:30.039945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:30.039962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:30.039961] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=68] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:30.039969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:30.040042] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=17, max_check_version=18, global_version=19) [2024-09-11 15:52:30.042101] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2059 [2024-09-11 15:52:30.042158] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=44] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:30.042193] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:52:30.042231] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:52:30.042314] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:30.042421] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:52:30.042474] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:52:30.042486] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:52:30.042497] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:52:30.042533] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:52:30.042595] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:52:30.042618] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:52:30.116347] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:30.171099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:30.173553] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:30.240223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:30.240267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:30.240275] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:30.240284] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:30.371243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:30.372395] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:30.372431] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9718 [2024-09-11 15:52:30.440527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:30.440568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:30.440575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:30.440584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:30.519514] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041150519509, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 15:52:30.526278] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041150526275, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 15:52:30.570253] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9718, magic:0x78563412 [2024-09-11 15:52:30.570294] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:30.570301] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:30.571368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:30.640806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:30.640859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:30.640865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:30.640872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:30.771555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:30.841098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:30.841144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:30.841151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:30.841158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:30.847775] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6603, clean_start_pos=6200000, clean_num=200000) [2024-09-11 15:52:30.971699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:30.972248] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:30.972281] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9726 [2024-09-11 15:52:31.048102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:31.048149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:31.048158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:31.048167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:31.116488] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:31.170833] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9726, magic:0x78563412 [2024-09-11 15:52:31.170879] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:31.170885] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:31.171834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:31.174293] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:31.248418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:31.248479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:31.248487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:31.248496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:31.372795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=865] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:31.448733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:31.448773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:31.448779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:31.448787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:31.527199] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041151527194, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 15:52:31.533873] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041151533869, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 15:52:31.572934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:31.573473] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:31.573499] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9740 [2024-09-11 15:52:31.649042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:31.649089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:31.649097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:31.649106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:31.771376] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9740, magic:0x78563412 [2024-09-11 15:52:31.771433] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:31.771443] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:31.773064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:31.849396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:31.849440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:31.849448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:31.849457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:31.977650] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4413, replace_start_pos=8700000, replace_num=100000) [2024-09-11 15:52:31.977696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:32.049688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:32.049733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:32.049740] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:32.049748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:32.116600] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:32.173362] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:32.173389] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9746 [2024-09-11 15:52:32.175002] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=42] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:32.177866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:32.250068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:32.250112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:32.250120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:32.250130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:32.371684] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9746, magic:0x78563412 [2024-09-11 15:52:32.371737] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:32.371743] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:32.378055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:32.450355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:32.450396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:32.450402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:32.450410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:32.534795] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041152534791, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 15:52:32.541563] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041152541560, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 15:52:32.578202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:32.650749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:32.650791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:32.650798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:32.650806] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:32.771733] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:32.771777] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9756 [2024-09-11 15:52:32.778344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:32.851111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:32.851164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:32.851173] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:32.851182] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:32.858225] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7029, clean_start_pos=6400000, clean_num=200000) [2024-09-11 15:52:32.969977] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9756, magic:0x78563412 [2024-09-11 15:52:32.970012] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:32.970019] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:32.978512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:33.058477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:33.058520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:33.058526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:33.058534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:33.116727] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:33.175803] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:33.178631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:33.258777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:33.258819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:33.258826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:33.258834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:33.371783] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:33.371824] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9772 [2024-09-11 15:52:33.378748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:33.459096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:33.459156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:33.459164] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:33.459173] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:33.542410] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041153542406, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:52:33.549110] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041153549106, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 15:52:33.570366] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9772, magic:0x78563412 [2024-09-11 15:52:33.570393] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:33.570400] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:33.578960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:33.659404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:33.659447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:33.659458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:33.659465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:33.779139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:33.859759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:33.859804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:33.859812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:33.859821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:33.972790] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:33.972834] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9780 [2024-09-11 15:52:33.979321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:34.060147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:34.060189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:34.060197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:34.060205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:34.116842] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:34.170849] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9780, magic:0x78563412 [2024-09-11 15:52:34.170888] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:34.170896] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:34.176549] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:34.183074] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3643, replace_start_pos=8800000, replace_num=100000) [2024-09-11 15:52:34.183105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:34.260431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:34.260473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:34.260481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:34.260490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:34.383188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:34.460731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:34.460769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:34.460777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:34.460786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:34.550022] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041154550019, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:52:34.556795] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041154556792, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:52:34.573274] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:34.573323] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9784 [2024-09-11 15:52:34.583306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:34.661038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:34.661079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:34.661085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:34.661092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:34.771405] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9784, magic:0x78563412 [2024-09-11 15:52:34.771455] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:34.771462] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:34.783411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:34.861405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:34.861439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:34.861445] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:34.861452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:34.867955] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6491, clean_start_pos=6600000, clean_num=200000) [2024-09-11 15:52:34.983500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:35.068227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:35.068273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:35.068281] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:35.068290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:35.116986] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:35.173533] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:35.173569] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9796 [2024-09-11 15:52:35.177287] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:35.183609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:35.268507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:35.268553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:35.268559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:35.268567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:35.371725] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9796, magic:0x78563412 [2024-09-11 15:52:35.371761] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:35.371767] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:35.383698] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:35.468801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:35.468844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:35.468851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:35.468859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:35.557659] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041155557654, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 15:52:35.564401] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041155564397, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:52:35.583791] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:35.669103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:35.669146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:35.669153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:35.669162] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:35.773922] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:35.773961] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23492 [2024-09-11 15:52:35.783892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:35.869375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:35.869416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:35.869422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:35.869430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:35.972295] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23492, magic:0x78563412 [2024-09-11 15:52:35.972333] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:35.972340] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:35.983988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:36.069680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:36.069723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:36.069748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:36.069757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:36.117131] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:36.178021] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:36.184078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:36.270079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:36.270121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:36.270127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:36.270134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:36.377483] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:36.377524] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23508 [2024-09-11 15:52:36.388533] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4345, replace_start_pos=8900000, replace_num=100000) [2024-09-11 15:52:36.388571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:36.470392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:36.470443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:36.470451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:36.470461] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:36.565282] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041156565278, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:52:36.571952] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726041156571948, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 15:52:36.572568] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23508, magic:0x78563412 [2024-09-11 15:52:36.572586] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:36.572593] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:36.588650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:36.670700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:36.670749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:36.670757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:36.670765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:36.788766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:36.870991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:36.871035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:36.871041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:36.871049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:36.878591] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7528, clean_start_pos=6800000, clean_num=200000) [2024-09-11 15:52:36.973214] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:36.973258] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23510 [2024-09-11 15:52:36.988875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:37.078869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:37.078931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:37.078938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:37.078946] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:37.117254] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:37.171975] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23510, magic:0x78563412 [2024-09-11 15:52:37.172019] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:37.172027] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:37.178791] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:37.188986] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:37.279255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:37.279301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:37.279309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:37.279319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:37.389098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:37.479552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:37.479599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:37.479607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:37.479616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:37.572260] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:37.572299] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23516 [2024-09-11 15:52:37.572871] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041157572868, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 15:52:37.579638] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041157579635, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:52:37.589211] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:37.679821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:37.679854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:37.679860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:37.679868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:37.770573] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23516, magic:0x78563412 [2024-09-11 15:52:37.770606] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:37.770613] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:37.789303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:37.880189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:37.880237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:37.880246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:37.880257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:37.989395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:38.080500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:38.080541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:38.080547] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:38.080555] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:38.117387] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:38.172658] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:38.172702] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23532 [2024-09-11 15:52:38.179553] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:38.189530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:38.280783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:38.280828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:38.280836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:38.280845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:38.369752] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23532, magic:0x78563412 [2024-09-11 15:52:38.369812] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:38.369819] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:38.389715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:38.481076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:38.481119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:38.481127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:38.481137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:38.580428] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041158580425, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 15:52:38.587312] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041158587308, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 15:52:38.594189] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4353, replace_start_pos=9000000, replace_num=100000) [2024-09-11 15:52:38.594231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:38.681368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:38.681414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:38.681421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:38.681430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:38.771878] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:38.771940] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23534 [2024-09-11 15:52:38.794311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:38.881669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:38.881717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:38.881724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:38.881732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:38.888367] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6622, clean_start_pos=7000000, clean_num=200000) [2024-09-11 15:52:38.970399] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23534, magic:0x78563412 [2024-09-11 15:52:38.970441] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:38.970449] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:38.994441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:39.088609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:39.088658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:39.088665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:39.088673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:39.117583] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:39.180482] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:39.194571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:39.288919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:39.288959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:39.288967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:39.288976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:39.372460] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:39.372505] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23550 [2024-09-11 15:52:39.394689] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:39.489184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:39.489246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:39.489260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:39.489270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:39.570643] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23550, magic:0x78563412 [2024-09-11 15:52:39.570683] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:39.570691] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:39.588114] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041159588110, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 15:52:39.594811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:39.594821] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041159594819, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007511, add_bytes: 0 [2024-09-11 15:52:39.689505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:39.689554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:39.689564] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:39.689574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:39.794929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:39.889807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:39.889849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:39.889855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:39.889862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:39.973098] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:39.973138] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23556 [2024-09-11 15:52:39.995036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:40.056812] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:40.056869] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=55] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:40.056981] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=18, max_check_version=19, global_version=20) [2024-09-11 15:52:40.058985] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2003 [2024-09-11 15:52:40.059020] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:40.059055] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:52:40.059092] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:52:40.059197] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:40.059304] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 15:52:40.059361] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:52:40.059372] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:52:40.059388] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:52:40.059424] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:52:40.059484] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:52:40.059509] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:52:40.090163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:40.090203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:40.090210] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:40.090219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:40.117697] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:40.171197] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23556, magic:0x78563412 [2024-09-11 15:52:40.171252] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:40.171260] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:40.181377] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:40.195152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:40.290429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:40.290484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:40.290491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:40.290499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:40.395292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:40.490729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:40.490784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:40.490794] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:40.490804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:40.572887] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:40.572949] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23566 [2024-09-11 15:52:40.595409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:40.595661] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041160595659, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:52:40.602540] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041160602538, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007719, add_bytes: 0 [2024-09-11 15:52:40.691061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:40.691110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:40.691118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:40.691129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:40.771479] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23566, magic:0x78563412 [2024-09-11 15:52:40.771529] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:40.771537] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:40.798962] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3450, replace_start_pos=9100000, replace_num=100000) [2024-09-11 15:52:40.799008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:40.891359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:40.891399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:40.891405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:40.891412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:40.902509] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=11085, clean_start_pos=7200000, clean_num=200000) [2024-09-11 15:52:40.999155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:41.102772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:41.102809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:41.102817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:41.102826] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:41.117915] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:41.172311] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:41.172357] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23582 [2024-09-11 15:52:41.182291] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:41.199277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:41.303052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:41.303092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:41.303099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:41.303106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:41.370947] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23582, magic:0x78563412 [2024-09-11 15:52:41.370989] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:41.370997] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:41.399402] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:41.503330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:41.503371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:41.503377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:41.503385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:41.599518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:41.603274] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041161603270, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:52:41.610100] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041161610097, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 15:52:41.703636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:41.703684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:41.703691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:41.703701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:41.772077] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:41.772121] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23592 [2024-09-11 15:52:41.799633] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:41.903936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:41.903976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:41.903983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:41.903990] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:41.970537] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23592, magic:0x78563412 [2024-09-11 15:52:41.970578] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:41.970585] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:41.999764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:42.104195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:42.104241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:42.104247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:42.104254] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:42.118028] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:42.183151] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:42.199879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:42.304489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:42.304534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:42.304543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:42.304553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:42.372197] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:42.372239] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23602 [2024-09-11 15:52:42.399997] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:42.504780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:42.504815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:42.504838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:42.504846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:42.570923] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23602, magic:0x78563412 [2024-09-11 15:52:42.570959] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:42.570966] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:42.600109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:42.610894] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041162610891, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:52:42.617653] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041162617650, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:52:42.705066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:42.705112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:42.705119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:42.705128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:42.800215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:42.905415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:42.905519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=102][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:42.905527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:42.905536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:42.906478] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash time detail, (compute_wash_size_time=155, refresh_score_time=189, wash_time=0) [2024-09-11 15:52:42.915234] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8719, clean_start_pos=7400000, clean_num=200000) [2024-09-11 15:52:42.973268] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:42.973322] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23608 [2024-09-11 15:52:43.004720] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4385, replace_start_pos=9200000, replace_num=100000) [2024-09-11 15:52:43.004771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:43.115491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:43.115545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:43.115554] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:43.115564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:43.118226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:43.171599] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23608, magic:0x78563412 [2024-09-11 15:52:43.171641] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:43.171650] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:43.184000] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:43.204970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:43.315790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:43.315837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:43.315845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:43.315854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:43.405160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:43.516081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:43.516124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:43.516148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:43.516158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:43.573829] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:43.573871] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23614 [2024-09-11 15:52:43.605343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:43.618566] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041163618563, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:52:43.625332] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041163625328, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:52:43.716466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:43.716508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:43.716517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:43.716527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:43.771961] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23614, magic:0x78563412 [2024-09-11 15:52:43.772003] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:43.772010] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:43.805466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:43.916755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:43.916797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:43.916804] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:43.916813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:44.005577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:44.117052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:44.117094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:44.117101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:44.117108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:44.118398] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:44.173539] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:44.173585] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23624 [2024-09-11 15:52:44.185214] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:44.205745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:44.317332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:44.317373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:44.317380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:44.317389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:44.372212] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23624, magic:0x78563412 [2024-09-11 15:52:44.372256] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:44.372264] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:44.405933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:44.517615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:44.517660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:44.517667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:44.517675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:44.606121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:44.626124] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041164626121, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:52:44.632944] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041164632942, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:52:44.717930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:44.717976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:44.717983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:44.717991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:44.774491] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:44.774537] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23626 [2024-09-11 15:52:44.806268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:44.918197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:44.918237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:44.918244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:44.918251] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:44.924799] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6536, clean_start_pos=7600000, clean_num=200000) [2024-09-11 15:52:44.972827] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23626, magic:0x78563412 [2024-09-11 15:52:44.972864] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:44.972872] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:45.006404] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:45.118526] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:45.125069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:45.125107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:45.125115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:45.125124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:45.186462] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:45.210972] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4360, replace_start_pos=9300000, replace_num=100000) [2024-09-11 15:52:45.211019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:45.325365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:45.325416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:45.325424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:45.325433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:45.374603] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:45.374647] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23630 [2024-09-11 15:52:45.411107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:45.525732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:45.525780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:45.525802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:45.525817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:45.573191] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23630, magic:0x78563412 [2024-09-11 15:52:45.573229] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:45.573235] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:45.611235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:45.633741] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041165633737, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:52:45.640521] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041165640518, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007576, add_bytes: 0 [2024-09-11 15:52:45.726074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:45.726154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:45.726162] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:45.726171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:45.811382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:45.926398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:45.926444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:45.926452] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:45.926460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:45.975260] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:45.975301] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51416 [2024-09-11 15:52:46.011510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:46.118742] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:46.126703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:46.126743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:46.126751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:46.126762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:46.173738] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51416, magic:0x78563412 [2024-09-11 15:52:46.173774] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:46.173781] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:46.187457] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:46.211637] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:46.327021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:46.327061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:46.327072] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:46.327079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:46.411766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:46.527313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:46.527359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:46.527367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:46.527376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:46.576034] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:46.576076] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51432 [2024-09-11 15:52:46.611951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:46.641370] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041166641366, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 15:52:46.648187] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041166648182, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 15:52:46.727588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:46.727625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:46.727631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:46.727638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:46.774143] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51432, magic:0x78563412 [2024-09-11 15:52:46.774184] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:46.774191] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:46.812087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:46.927972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:46.928015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:46.928021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:46.928028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:46.934913] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6872, clean_start_pos=7800000, clean_num=200000) [2024-09-11 15:52:47.012277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:47.118882] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:47.135182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:47.135228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:47.135235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:47.135244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:47.176560] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:47.176596] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51440 [2024-09-11 15:52:47.188635] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:47.212471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:47.335472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:47.335518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:47.335524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:47.335533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:47.374593] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51440, magic:0x78563412 [2024-09-11 15:52:47.374632] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:47.374640] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:47.417000] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4408, replace_start_pos=9400000, replace_num=100000) [2024-09-11 15:52:47.417042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:47.535815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:47.535861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:47.535869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:47.535878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:47.617133] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:47.649041] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041167649036, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 15:52:47.655735] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041167655732, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 15:52:47.736115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:47.736157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:47.736164] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:47.736171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:47.776455] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:47.776515] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51448 [2024-09-11 15:52:47.817330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:47.936600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:47.936650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:47.936658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:47.936667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:47.974811] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51448, magic:0x78563412 [2024-09-11 15:52:47.974852] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:47.974860] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:48.017520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:48.119023] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:48.136895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:48.136961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:48.136968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:48.136977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:48.217704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:48.289692] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:48.337197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:48.337239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:48.337245] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:48.337253] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:48.376837] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:48.376883] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51456 [2024-09-11 15:52:48.417823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:48.537599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:48.537652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:48.537659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:48.537668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:48.575169] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51456, magic:0x78563412 [2024-09-11 15:52:48.575208] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:48.575215] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:48.618013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:48.656652] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041168656648, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:52:48.663416] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041168663413, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:52:48.737922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:48.737962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:48.737968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:48.737976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:48.818194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:48.938200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:48.938248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:48.938254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:48.938280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:48.945032] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6738, clean_start_pos=8000000, clean_num=200000) [2024-09-11 15:52:48.976755] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:48.976797] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51472 [2024-09-11 15:52:49.018330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:49.119222] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:49.145302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:49.145346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:49.145354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:49.145364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:49.175625] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51472, magic:0x78563412 [2024-09-11 15:52:49.175666] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:49.175673] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:49.218513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:49.290713] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:49.345592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:49.345636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:49.345642] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:49.345650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:49.418639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:49.546014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:49.546061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:49.546070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:49.546098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:49.579470] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:49.579514] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51478 [2024-09-11 15:52:49.622060] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3300, replace_start_pos=9500000, replace_num=100000) [2024-09-11 15:52:49.622100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:49.664201] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041169664197, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:52:49.670962] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041169670961, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:52:49.746327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:49.746366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:49.746373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:49.746380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:49.775123] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51478, magic:0x78563412 [2024-09-11 15:52:49.775159] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:49.775165] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:49.822244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:49.946596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:49.946641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:49.946648] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:49.946671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:50.022432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:50.074239] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:50.074293] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:52:50.074374] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=19, max_check_version=20, global_version=21) [2024-09-11 15:52:50.076583] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2208 [2024-09-11 15:52:50.076622] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:50.076657] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:52:50.076695] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:52:50.076793] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:52:50.076920] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:52:50.076977] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:52:50.076989] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:52:50.077004] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:52:50.077041] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:52:50.077100] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:52:50.077123] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:52:50.119410] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:50.146948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:50.146994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:50.147002] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:50.147011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:50.177331] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:50.177369] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51484 [2024-09-11 15:52:50.222566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:50.291769] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:50.347226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:50.347263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:50.347269] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:50.347277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:50.375584] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51484, magic:0x78563412 [2024-09-11 15:52:50.375625] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:50.375633] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:50.422744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:50.547512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:50.547558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:50.547566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:50.547575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:50.622928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:50.671883] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041170671878, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:52:50.678582] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726041170678578, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:52:50.747811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:50.747853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:50.747860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:50.747869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:50.777279] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:50.777306] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51486 [2024-09-11 15:52:50.823049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:50.948119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:50.948163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:50.948171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:50.948180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:50.956503] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8310, clean_start_pos=8200000, clean_num=200000) [2024-09-11 15:52:50.975839] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51486, magic:0x78563412 [2024-09-11 15:52:50.975876] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:50.975884] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:51.023172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:51.119658] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:51.156748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:51.156791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:51.156798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:51.156807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:51.157006] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:52:51.223381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:51.292731] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:51.357239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:51.357296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:51.357314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:51.357324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:51.377853] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:51.377940] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=81] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51490 [2024-09-11 15:52:51.423587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:51.557580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:51.557634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:51.557642] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:51.557651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:51.576270] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51490, magic:0x78563412 [2024-09-11 15:52:51.576311] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:51.576318] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:51.623774] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:51.679500] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=75] PNIO [ratelimit] time: 1726041171679496, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:52:51.686259] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041171686256, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:52:51.757874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:51.757932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:51.757940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:51.757949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:51.828366] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4384, replace_start_pos=9600000, replace_num=100000) [2024-09-11 15:52:51.828415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:51.958165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:51.958205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:51.958211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:51.958219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:51.978350] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:51.978395] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51504 [2024-09-11 15:52:52.028580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:52.119837] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:52.158444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:52.158489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:52.158496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:52.158505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:52.176685] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51504, magic:0x78563412 [2024-09-11 15:52:52.176727] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:52.176734] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:52.228758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:52.293965] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:52.358714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:52.358825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=110][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:52.358836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:52.358846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:52.428943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:52.559161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:52.559228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:52.559236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:52.559245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:52.578734] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:52.578774] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51514 [2024-09-11 15:52:52.629070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:52.687119] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041172687114, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:52:52.693880] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041172693878, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:52:52.759471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:52.759521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:52.759527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:52.759536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:52.777203] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51514, magic:0x78563412 [2024-09-11 15:52:52.777239] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:52.777245] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:52.829190] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:52.959770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:52.959808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:52.959815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:52.959837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:52.968414] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8562, clean_start_pos=8400000, clean_num=200000) [2024-09-11 15:52:53.029325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:53.119986] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:53.168688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:53.168736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:53.168742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:53.168750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:53.179546] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:53.179584] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51528 [2024-09-11 15:52:53.229503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:53.295346] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=102] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:53.368990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:53.369033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:53.369039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:53.369046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:53.377737] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51528, magic:0x78563412 [2024-09-11 15:52:53.377777] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:53.377786] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:53.429697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:53.569283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:53.569327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:53.569336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:53.569362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:53.629812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:53.694753] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041173694748, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 15:52:53.701492] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041173701489, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:52:53.769657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:53.769701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:53.769710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:53.769719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:53.779809] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:53.779854] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51540 [2024-09-11 15:52:53.829998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:53.969983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:53.970027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:53.970034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:53.970044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:53.978209] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51540, magic:0x78563412 [2024-09-11 15:52:53.978250] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:53.978258] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:54.034522] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4315, replace_start_pos=9700000, replace_num=100000) [2024-09-11 15:52:54.034562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:54.120113] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:54.170344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:54.170388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:54.170396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:54.170406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:54.234659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:54.296533] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:54.370649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:54.370694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:54.370702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:54.370711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:54.380470] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:54.380510] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51546 [2024-09-11 15:52:54.434836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:54.571035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:54.571081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:54.571089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:54.571099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:54.578640] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51546, magic:0x78563412 [2024-09-11 15:52:54.578673] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:54.578680] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:54.635041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:54.702347] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041174702342, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 15:52:54.709111] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041174709108, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:52:54.771351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:54.771396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:54.771404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:54.771413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:54.835160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:54.971633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:54.971669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:54.971675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:54.971682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:54.978352] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6642, clean_start_pos=8600000, clean_num=200000) [2024-09-11 15:52:54.979751] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:54.979785] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51552 [2024-09-11 15:52:55.035348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:55.120311] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:55.177986] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51552, magic:0x78563412 [2024-09-11 15:52:55.178045] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:55.178053] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:55.178618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:55.178648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:55.178656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:55.178665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:55.235471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:55.297674] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:55.378976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:55.379020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:55.379027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:55.379037] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:55.435657] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:55.579281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:55.579325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:55.579333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:55.579342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:55.579660] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:55.579694] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3604 [2024-09-11 15:52:55.635842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:55.709989] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041175709985, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007643, add_bytes: 0 [2024-09-11 15:52:55.716667] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041175716663, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:52:55.778213] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3604, magic:0x78563412 [2024-09-11 15:52:55.778269] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:55.778276] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:55.779574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:55.779608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:55.779615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:55.779623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:55.835971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:55.979857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:55.979922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:55.979933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:55.979942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:56.036152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:56.120461] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:56.180173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:56.180216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:56.180224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:56.180233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:56.180861] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:56.180926] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=59] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3614 [2024-09-11 15:52:56.240703] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4357, replace_start_pos=9800000, replace_num=100000) [2024-09-11 15:52:56.240752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:56.298921] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:56.379006] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3614, magic:0x78563412 [2024-09-11 15:52:56.380465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:56.380821] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=1806] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:56.380843] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:56.380872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=404][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:56.380916] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:56.380927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:56.440892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:56.581154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:56.581201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:56.581208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:56.581234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:56.641115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:56.717531] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041176717526, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 15:52:56.724337] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041176724333, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 15:52:56.781226] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:56.781263] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3616 [2024-09-11 15:52:56.781440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:56.781466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:56.781472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:56.781498] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:56.841241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:56.979261] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3616, magic:0x78563412 [2024-09-11 15:52:56.979299] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:56.979306] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:56.981717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:56.981753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:56.981760] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:56.981769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:56.990004] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8221, clean_start_pos=8800000, clean_num=200000) [2024-09-11 15:52:57.041418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:57.120649] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:57.190250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:57.190300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:57.190309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:57.190318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:57.241549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:57.300038] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:57.381465] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:57.381509] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3622 [2024-09-11 15:52:57.390751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:57.390780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:57.390788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:57.390811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:57.441706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:57.579827] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3622, magic:0x78563412 [2024-09-11 15:52:57.579866] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:57.579874] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:57.591064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:57.591102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:57.591112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:57.591121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:57.641852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:57.725195] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041177725191, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 15:52:57.731967] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041177731962, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 15:52:57.791436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:57.791481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:57.791489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:57.791499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:57.842058] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:52:57.982319] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:57.982361] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3624 [2024-09-11 15:52:57.991742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:57.991781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:57.991788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:57.991797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:58.042210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:52:58.120772] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:58.180223] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3624, magic:0x78563412 [2024-09-11 15:52:58.180265] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:58.180285] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:58.192095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:58.192138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:58.192147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:58.192157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:58.242323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:52:58.301091] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:58.392492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:58.392539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:58.392547] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:58.392556] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:58.446923] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4419, replace_start_pos=9900000, replace_num=100000) [2024-09-11 15:52:58.446970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:52:58.581944] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:58.581990] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3634 [2024-09-11 15:52:58.592853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:58.592894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:58.592919] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:58.592929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:58.647084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:52:58.732769] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041178732765, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 15:52:58.739604] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041178739600, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 15:52:58.780539] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3634, magic:0x78563412 [2024-09-11 15:52:58.780578] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:58.780584] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:58.793225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:58.793268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:58.793276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:58.793286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:58.847277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:52:58.993580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:58.993625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:58.993650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:58.993661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:59.001223] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7549, clean_start_pos=9000000, clean_num=200000) [2024-09-11 15:52:59.047415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:52:59.120919] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:52:59.182315] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:59.182359] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3638 [2024-09-11 15:52:59.201543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:59.201588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:59.201596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:59.201606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:59.247548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:52:59.302188] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:52:59.381088] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3638, magic:0x78563412 [2024-09-11 15:52:59.381128] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:59.381136] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:52:59.401922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:59.401979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:59.401989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:59.401999] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:59.447729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:52:59.602293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:59.602338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:59.602367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:59.602378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:59.647917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:52:59.740431] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041179740426, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 15:52:59.747187] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041179747184, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007584, add_bytes: 0 [2024-09-11 15:52:59.782964] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:52:59.783002] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3652 [2024-09-11 15:52:59.802614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:52:59.802651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:52:59.802658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:52:59.802667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:52:59.848039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:52:59.981553] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3652, magic:0x78563412 [2024-09-11 15:52:59.981592] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:52:59.981600] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:00.002891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:00.002951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:00.002960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:00.002984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:00.048184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:00.092350] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:00.092390] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:00.092458] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=20, max_check_version=21, global_version=22) [2024-09-11 15:53:00.094455] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1994 [2024-09-11 15:53:00.094497] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:00.094533] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:53:00.094572] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:53:00.094681] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:00.094850] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:53:00.094943] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:53:00.094966] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:53:00.094989] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:53:00.095035] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:53:00.095097] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:53:00.095119] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:53:00.121103] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:00.203218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:00.203264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:00.203271] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:00.203280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:00.248345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:00.303092] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:00.384248] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:00.384292] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3668 [2024-09-11 15:53:00.403511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:00.403555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:00.403563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:00.403573] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:00.448463] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:00.581062] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3668, magic:0x78563412 [2024-09-11 15:53:00.581104] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:00.581112] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:00.603828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:00.603866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:00.603873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:00.603882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:00.652894] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4321, replace_start_pos=10000000, replace_num=100000) [2024-09-11 15:53:00.652941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:00.733842] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 15:53:00.748074] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041180748070, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 15:53:00.748121] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 15:53:00.752428] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 15:53:00.754831] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041180754828, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 15:53:00.754865] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:53:00.804089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:00.804137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:00.804143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:00.804151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:00.853090] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:00.983018] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:00.983060] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3680 [2024-09-11 15:53:01.004379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:01.004424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:01.004431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:01.004441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:01.012959] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8504, clean_start_pos=9200000, clean_num=200000) [2024-09-11 15:53:01.053213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:01.121317] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:01.181557] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3680, magic:0x78563412 [2024-09-11 15:53:01.181598] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:01.181606] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:01.213219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:01.213256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:01.213263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:01.213286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:01.253333] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:01.304153] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:01.413522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:01.413564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:01.413599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:01.413607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:01.453433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:01.583480] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:01.583524] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3684 [2024-09-11 15:53:01.613830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:01.613870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:01.613877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:01.613886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:01.653614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:01.755601] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041181755596, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007526, add_bytes: 0 [2024-09-11 15:53:01.762427] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041181762424, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 15:53:01.781871] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3684, magic:0x78563412 [2024-09-11 15:53:01.781921] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:01.781930] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:01.814109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:01.814154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:01.814161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:01.814186] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:01.853744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:02.014419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:02.014464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:02.014471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:02.014482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:02.053862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:02.121500] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:02.182546] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:02.182592] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3688 [2024-09-11 15:53:02.214781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:02.214825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:02.214833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:02.214842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:02.254076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:02.305407] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:02.381220] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3688, magic:0x78563412 [2024-09-11 15:53:02.381259] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:02.381268] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:02.415056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:02.415089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:02.415095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:02.415102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:02.454265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:02.615343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:02.615401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:02.615411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:02.615420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:02.654450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:02.763278] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041182763274, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:53:02.769976] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041182769972, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:53:02.784975] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:02.785018] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3690 [2024-09-11 15:53:02.815672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:02.815720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:02.815727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:02.815737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:02.859013] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4429, replace_start_pos=10100000, replace_num=100000) [2024-09-11 15:53:02.859054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:02.982099] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3690, magic:0x78563412 [2024-09-11 15:53:02.982139] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:02.982164] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:03.016065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:03.016112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:03.016120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:03.016129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:03.023197] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7052, clean_start_pos=9400000, clean_num=200000) [2024-09-11 15:53:03.059205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:03.121695] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:03.223467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:03.223511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:03.223519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:03.223529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:03.223744] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=80, refresh_score_time=62, wash_time=0) [2024-09-11 15:53:03.259345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:03.306512] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:03.383445] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:03.383487] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3706 [2024-09-11 15:53:03.423997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:03.424038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:03.424045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:03.424055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:03.459535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:03.582156] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3706, magic:0x78563412 [2024-09-11 15:53:03.582213] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:03.582220] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:03.624280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:03.624326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:03.624335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:03.624344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:03.659660] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:03.770827] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041183770822, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:53:03.777659] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041183777654, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:53:03.824640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:03.824686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:03.824693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:03.824703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:03.859833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:03.984115] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:03.984161] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3720 [2024-09-11 15:53:04.024962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:04.025016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:04.025047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:04.025058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:04.060020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:04.121816] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:04.182751] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3720, magic:0x78563412 [2024-09-11 15:53:04.182797] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:04.182805] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:04.225271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:04.225316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:04.225322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:04.225329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:04.260208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:04.307659] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:04.425576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:04.425622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:04.425631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:04.425644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:04.460396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:04.583745] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:04.583790] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3736 [2024-09-11 15:53:04.625885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:04.625945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:04.625953] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:04.625962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:04.660538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:04.778514] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041184778509, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:53:04.781117] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3736, magic:0x78563412 [2024-09-11 15:53:04.781148] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:04.781156] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:04.785203] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041184785201, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 15:53:04.826203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:04.826265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:04.826273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:04.826282] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:04.860735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:05.026533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:05.026587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:05.026595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:05.026605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:05.035751] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9131, clean_start_pos=9600000, clean_num=200000) [2024-09-11 15:53:05.064775] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3848, replace_start_pos=10200000, replace_num=100000) [2024-09-11 15:53:05.064839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:05.121950] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:05.182397] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:05.182437] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3752 [2024-09-11 15:53:05.237219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:05.237857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=636][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:05.237865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:05.237873] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:05.264987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:05.308771] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:05.380608] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3752, magic:0x78563412 [2024-09-11 15:53:05.380652] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:05.380661] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:05.438132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:05.438180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:05.438191] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:05.438204] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:05.465114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:05.638459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:05.638508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:05.638516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:05.638525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:05.665303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:05.782691] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:05.782737] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10702 [2024-09-11 15:53:05.786054] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041185786052, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 15:53:05.792879] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041185792876, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:53:05.838736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:05.838779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:05.838785] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:05.838793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:05.865548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:05.981104] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10702, magic:0x78563412 [2024-09-11 15:53:05.981146] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:05.981154] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:06.039039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:06.039082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:06.039090] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:06.039099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:06.065684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:06.122102] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:06.239320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:06.239370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:06.239378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:06.239385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:06.265876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:06.309838] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:06.383545] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:06.383589] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10704 [2024-09-11 15:53:06.439606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:06.439659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:06.439673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:06.439682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:06.466014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:06.581521] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10704, magic:0x78563412 [2024-09-11 15:53:06.581563] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:06.581571] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:06.639915] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:06.639960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:06.639966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:06.639973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:06.666196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:06.793675] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726041186793672, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:53:06.800444] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041186800440, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 15:53:06.840175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:06.840233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:06.840240] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:06.840247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:06.866388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:06.983754] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:06.983798] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10720 [2024-09-11 15:53:07.040456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:07.040498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:07.040504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:07.040512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:07.047117] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6593, clean_start_pos=9800000, clean_num=200000) [2024-09-11 15:53:07.066580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:07.122230] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:07.181839] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10720, magic:0x78563412 [2024-09-11 15:53:07.181869] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:07.181875] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:07.247352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:07.247396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:07.247430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:07.247438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:07.271146] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4362, replace_start_pos=10300000, replace_num=100000) [2024-09-11 15:53:07.271198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:07.310842] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:07.447666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:07.447713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:07.447720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:07.447730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:07.471320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:07.582452] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:07.582493] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10726 [2024-09-11 15:53:07.647967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:07.648010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:07.648016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:07.648024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:07.671513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:07.781131] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10726, magic:0x78563412 [2024-09-11 15:53:07.781189] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:07.781199] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:07.801286] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041187801283, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:53:07.808053] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041187808051, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:53:07.848263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:07.848323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:07.848331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:07.848340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:07.871722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:08.048639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:08.048681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:08.048689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:08.048698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:08.071942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:08.122437] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:08.183160] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:08.183204] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10732 [2024-09-11 15:53:08.249020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:08.249065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:08.249073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:08.249082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:08.272139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:08.311786] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:08.381759] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10732, magic:0x78563412 [2024-09-11 15:53:08.381802] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:08.381810] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:08.449396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:08.449440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:08.449472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:08.449483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:08.472378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:08.649728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:08.649775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:08.649783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:08.649793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:08.672599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:08.783308] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:08.783348] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10748 [2024-09-11 15:53:08.808916] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041188808913, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:53:08.815754] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041188815752, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007701, add_bytes: 0 [2024-09-11 15:53:08.850164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:08.850212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:08.850220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:08.850230] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:08.872811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:08.981870] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10748, magic:0x78563412 [2024-09-11 15:53:08.981948] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=74] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:08.981957] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:09.050527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:09.050574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:09.050582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:09.050591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:09.057962] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7357, clean_start_pos=10000000, clean_num=200000) [2024-09-11 15:53:09.073013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:09.122574] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:09.258331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:09.258371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:09.258379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:09.258388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:09.273156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:09.312854] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:09.383705] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:09.383750] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10758 [2024-09-11 15:53:09.458722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:09.458767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:09.458774] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:09.458784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:09.477668] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4365, replace_start_pos=10400000, replace_num=100000) [2024-09-11 15:53:09.477712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:09.582205] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10758, magic:0x78563412 [2024-09-11 15:53:09.582247] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:09.582255] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:09.659081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:09.659122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:09.659130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:09.659139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:09.677839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:09.816526] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041189816522, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:53:09.823356] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041189823354, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:53:09.859436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:09.859476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:09.859484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:09.859494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:09.877977] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:09.984107] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:09.984152] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10774 [2024-09-11 15:53:10.059728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:10.059776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:10.059804] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:10.059814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:10.078113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:10.111319] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:10.111367] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:10.111448] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=21, max_check_version=22, global_version=23) [2024-09-11 15:53:10.113515] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2065 [2024-09-11 15:53:10.113557] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:10.113594] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:53:10.113651] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:53:10.113735] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:10.113842] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:53:10.113898] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:53:10.113926] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:53:10.113938] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:53:10.113975] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:53:10.114039] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:53:10.114060] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:53:10.122703] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:10.182661] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10774, magic:0x78563412 [2024-09-11 15:53:10.182705] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:10.182712] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:10.260109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:10.260154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:10.260178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:10.260189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:10.278261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:10.313968] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=101] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:10.460494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:10.460556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:10.460565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:10.460575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:10.478479] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:10.584274] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:10.584319] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10790 [2024-09-11 15:53:10.660897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:10.660964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:10.660972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:10.660982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:10.678676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:10.782956] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10790, magic:0x78563412 [2024-09-11 15:53:10.782993] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:10.783000] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:10.824159] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041190824155, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 15:53:10.830998] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041190830994, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 15:53:10.861233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:10.861277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:10.861303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:10.861313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:10.878925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:11.061606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:11.061651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:11.061659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:11.061669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:11.069466] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7784, clean_start_pos=10200000, clean_num=200000) [2024-09-11 15:53:11.079063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:11.122927] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:11.185097] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:11.185144] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10792 [2024-09-11 15:53:11.269737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:11.269785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:11.269792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:11.269801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:11.279309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:11.315170] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:11.383479] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10792, magic:0x78563412 [2024-09-11 15:53:11.383521] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:11.383528] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:11.470120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:11.470177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:11.470204] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:11.470216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:11.479507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:11.670518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:11.670564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:11.670572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:11.670581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:11.684099] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4378, replace_start_pos=10500000, replace_num=100000) [2024-09-11 15:53:11.684150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:11.785616] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:11.785658] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10798 [2024-09-11 15:53:11.831822] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041191831817, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007662, add_bytes: 0 [2024-09-11 15:53:11.838577] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041191838574, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007580, add_bytes: 0 [2024-09-11 15:53:11.870959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:11.871006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:11.871014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:11.871023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:11.884233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:11.983980] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10798, magic:0x78563412 [2024-09-11 15:53:11.984022] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:11.984029] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:12.071328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:12.071374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:12.071382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:12.071392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:12.084376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:12.123058] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:12.271693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:12.271740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:12.271748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:12.271757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:12.284572] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:12.316457] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:12.385698] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:12.385742] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10812 [2024-09-11 15:53:12.472067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:12.472114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:12.472125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:12.472140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:12.484694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:12.584267] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10812, magic:0x78563412 [2024-09-11 15:53:12.584322] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:12.584330] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:12.672442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:12.672487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:12.672495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:12.672505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:12.684810] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:12.839382] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041192839378, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:53:12.846146] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041192846142, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 15:53:12.872799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:12.872839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:12.872847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:12.872854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:12.884919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:12.986299] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:12.986327] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10820 [2024-09-11 15:53:13.073079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:13.073124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:13.073153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:13.073162] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:13.080865] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7661, clean_start_pos=10400000, clean_num=200000) [2024-09-11 15:53:13.085033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:13.123199] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:13.184791] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10820, magic:0x78563412 [2024-09-11 15:53:13.184831] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:13.184838] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:13.281145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:13.281184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:13.281191] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:13.281200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:13.285125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:13.317615] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:13.481430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:13.481477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:13.481484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:13.481493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:13.485216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:13.586313] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:13.586359] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10826 [2024-09-11 15:53:13.681739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:13.681782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:13.681788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:13.681814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:13.685314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:13.784953] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10826, magic:0x78563412 [2024-09-11 15:53:13.784992] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:13.784999] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:13.847046] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041193847041, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 15:53:13.853748] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041193853745, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:53:13.882067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:13.882113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:13.882121] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:13.882131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:13.889751] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=10600000, replace_num=100000) [2024-09-11 15:53:13.889789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:14.082364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:14.082409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:14.082417] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:14.082427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:14.089882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:14.123327] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:14.186714] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:14.186756] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10842 [2024-09-11 15:53:14.282672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:14.282706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:14.282713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:14.282721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:14.289979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:14.318837] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:14.385313] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10842, magic:0x78563412 [2024-09-11 15:53:14.385353] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:14.385360] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:14.482969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:14.483010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:14.483017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:14.483025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:14.490068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:14.683251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:14.683290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:14.683297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:14.683306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:14.690155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:14.787743] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:14.787778] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10850 [2024-09-11 15:53:14.854605] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041194854602, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:53:14.861373] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041194861371, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:53:14.883534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:14.883580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:14.883587] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:14.883597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:14.890266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:14.985979] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10850, magic:0x78563412 [2024-09-11 15:53:14.986012] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:14.986019] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:15.083859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:15.083897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:15.083928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:15.083940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:15.090359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:15.092534] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8577, clean_start_pos=10600000, clean_num=200000) [2024-09-11 15:53:15.123523] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:15.290473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:15.292808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:15.292837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:15.292845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:15.292854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:15.320188] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:15.387589] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:15.387628] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10860 [2024-09-11 15:53:15.490584] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:15.493079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:15.493107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:15.493114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:15.493122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:15.586757] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10860, magic:0x78563412 [2024-09-11 15:53:15.586790] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:15.586798] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:15.690685] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:15.693348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:15.693379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:15.693385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:15.693394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:15.862236] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041195862232, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:53:15.868997] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041195868992, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:53:15.890796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:15.893632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:15.893662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:15.893668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:15.893677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:15.988596] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:15.988617] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18086 [2024-09-11 15:53:16.093962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:16.094005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:16.094014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:16.094027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:16.095355] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4440, replace_start_pos=10700000, replace_num=100000) [2024-09-11 15:53:16.095378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:16.123668] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:16.185373] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18086, magic:0x78563412 [2024-09-11 15:53:16.185416] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:16.185424] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:16.294253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:16.294309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:16.294316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:16.294327] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:16.295470] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:16.321433] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:16.494554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:16.494604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:16.494613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:16.494623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:16.495568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:16.587174] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:16.587219] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18090 [2024-09-11 15:53:16.694857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:16.694923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:16.694933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:16.694943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:16.696647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=940] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:16.785569] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18090, magic:0x78563412 [2024-09-11 15:53:16.785611] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:16.785620] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:16.869852] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041196869849, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:53:16.876615] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041196876612, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:53:16.895151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:16.895208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:16.895218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:16.895228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:16.896771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:17.095549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:17.095595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:17.095602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:17.095612] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:17.096892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:17.104279] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8653, clean_start_pos=10800000, clean_num=200000) [2024-09-11 15:53:17.123877] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:17.187827] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:17.187870] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18094 [2024-09-11 15:53:17.297035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:17.304599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:17.304639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:17.304647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:17.304657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:17.322508] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:17.386247] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18094, magic:0x78563412 [2024-09-11 15:53:17.386291] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:17.386300] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:17.497228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:17.504956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:17.504997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:17.505006] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:17.505014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:17.697443] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:17.705310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:17.705355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:17.705363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:17.705374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:17.788534] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:17.788578] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18104 [2024-09-11 15:53:17.877459] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041197877454, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:53:17.884276] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041197884272, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007660, add_bytes: 0 [2024-09-11 15:53:17.897647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:17.905716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:17.905762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:17.905770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:17.905780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:17.986887] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18104, magic:0x78563412 [2024-09-11 15:53:17.986946] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:17.986954] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:18.097778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:18.106049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:18.106077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:18.106085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:18.106096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:18.124009] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:18.302220] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4318, replace_start_pos=10800000, replace_num=100000) [2024-09-11 15:53:18.302262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:18.306334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:18.306359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:18.306366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:18.306375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:18.323790] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:18.389092] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:18.389135] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18112 [2024-09-11 15:53:18.502355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:18.506595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:18.506619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:18.506625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:18.506633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:18.587179] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18112, magic:0x78563412 [2024-09-11 15:53:18.587222] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:18.587228] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:18.702527] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:18.706962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:18.706992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:18.706999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:18.707008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:18.885182] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041198885178, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007724, add_bytes: 0 [2024-09-11 15:53:18.891840] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041198891836, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 15:53:18.902746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:18.907346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:18.907386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:18.907394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:18.907403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:18.989313] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:18.989357] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18116 [2024-09-11 15:53:19.102930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:19.107652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:19.107695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:19.107702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:19.107711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:19.116357] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8632, clean_start_pos=11000000, clean_num=200000) [2024-09-11 15:53:19.124227] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:19.187505] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18116, magic:0x78563412 [2024-09-11 15:53:19.187549] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:19.187557] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:19.303092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:19.316638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:19.316678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:19.316685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:19.316694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:19.324969] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:19.503226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:19.517020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:19.517060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:19.517068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:19.517076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:19.589675] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:19.589720] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18126 [2024-09-11 15:53:19.703349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:19.717305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:19.717337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:19.717344] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:19.717353] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:19.787999] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18126, magic:0x78563412 [2024-09-11 15:53:19.788035] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:19.788043] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:19.892763] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041199892759, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007581, add_bytes: 0 [2024-09-11 15:53:19.899513] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041199899509, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 15:53:19.903556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:19.917706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:19.917749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:19.917757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:19.917766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:20.103733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:20.118070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:20.118116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:20.118124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:20.118133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:20.124348] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:20.127373] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:20.127410] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=36] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:20.127481] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=22, max_check_version=23, global_version=24) [2024-09-11 15:53:20.129177] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1695 [2024-09-11 15:53:20.129206] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:20.129239] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:53:20.129271] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:53:20.129364] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:20.129447] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 15:53:20.129490] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:53:20.129500] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:53:20.129512] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:53:20.129543] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:53:20.129590] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:53:20.129612] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:53:20.189865] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:20.189925] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18136 [2024-09-11 15:53:20.303871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:20.318387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:20.318425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:20.318432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:20.318441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:20.326061] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:20.388389] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18136, magic:0x78563412 [2024-09-11 15:53:20.388430] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:20.388438] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:20.508153] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4141, replace_start_pos=10900000, replace_num=100000) [2024-09-11 15:53:20.508193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:20.518645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:20.518680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:20.518686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:20.518693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:20.708308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:20.719004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:20.719039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:20.719046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:20.719055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:20.790431] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:20.790476] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18144 [2024-09-11 15:53:20.900383] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041200900379, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:53:20.907072] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041200907069, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 15:53:20.908537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:20.919359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:20.919404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:20.919412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:20.919421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:20.988937] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18144, magic:0x78563412 [2024-09-11 15:53:20.988972] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:20.988979] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:21.108658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:21.119681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:21.119722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:21.119730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:21.119739] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:21.124510] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:21.128287] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8535, clean_start_pos=11200000, clean_num=200000) [2024-09-11 15:53:21.308842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:21.326855] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:21.328541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:21.328576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:21.328585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:21.328594] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:21.328780] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:53:21.391258] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:21.391304] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18160 [2024-09-11 15:53:21.509027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:21.529087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:21.529136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:21.529144] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:21.529172] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:21.589619] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18160, magic:0x78563412 [2024-09-11 15:53:21.589664] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:21.589673] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:21.709229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:21.729465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:21.729505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:21.729513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:21.729523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:21.907913] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041201907909, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 15:53:21.909455] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:21.914690] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041201914686, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:53:21.929775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:21.929823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:21.929831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:21.929841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:21.991437] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:21.991483] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18172 [2024-09-11 15:53:22.109638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:22.124719] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:22.130143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:22.130179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:22.130187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:22.130198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:22.190003] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18172, magic:0x78563412 [2024-09-11 15:53:22.190041] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:22.190048] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:22.309830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:22.327779] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=101] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:22.330498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:22.330533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:22.330541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:22.330550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:22.510017] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:22.530784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:22.530827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:22.530834] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:22.530843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:22.592087] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:22.592132] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18174 [2024-09-11 15:53:22.714323] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4118, replace_start_pos=11000000, replace_num=100000) [2024-09-11 15:53:22.714382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:22.731076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:22.731118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:22.731124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:22.731132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:22.790467] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18174, magic:0x78563412 [2024-09-11 15:53:22.790506] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:22.790512] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:22.914573] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:22.915532] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041202915528, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:53:22.922306] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041202922302, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:53:22.931432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:22.931476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:22.931484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:22.931494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:23.114705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:23.124837] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:23.131718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:23.131758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:23.131765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:23.131773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:23.140445] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8658, clean_start_pos=11400000, clean_num=200000) [2024-09-11 15:53:23.192172] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:23.192216] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18178 [2024-09-11 15:53:23.314927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:23.328696] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:23.340726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:23.340765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:23.340772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:23.340781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:23.390883] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18178, magic:0x78563412 [2024-09-11 15:53:23.390945] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:23.390955] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:23.515115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:23.541089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:23.541137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:23.541146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:23.541155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:23.541369] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=84, refresh_score_time=60, wash_time=0) [2024-09-11 15:53:23.715243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:23.741600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:23.741658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:23.741665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:23.741674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:23.792508] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:23.792546] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18184 [2024-09-11 15:53:23.915375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:23.923337] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041203923334, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007806, add_bytes: 0 [2024-09-11 15:53:23.929988] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041203929983, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:53:23.941921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:23.941955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:23.941961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:23.941970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:23.991224] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18184, magic:0x78563412 [2024-09-11 15:53:23.991256] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:23.991262] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:24.115559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:24.124993] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=18] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:24.142272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:24.142317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:24.142348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:24.142358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:24.315753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:24.329723] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:24.342667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:24.342705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:24.342713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:24.342723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:24.393482] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:24.393525] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18196 [2024-09-11 15:53:24.515873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:24.542983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:24.543018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:24.543026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:24.543035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:24.591628] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18196, magic:0x78563412 [2024-09-11 15:53:24.591667] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:24.591676] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:24.716023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:24.743261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:24.743295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:24.743303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:24.743312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:24.920514] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4353, replace_start_pos=11100000, replace_num=100000) [2024-09-11 15:53:24.920561] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:24.930832] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041204930829, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007495, add_bytes: 0 [2024-09-11 15:53:24.937535] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041204937532, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:53:24.943632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:24.943667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:24.943675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:24.943685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:24.992688] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:24.992734] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18204 [2024-09-11 15:53:25.120652] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:25.125194] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:25.143957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:25.144001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:25.144008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:25.144018] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:25.150923] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6892, clean_start_pos=11600000, clean_num=200000) [2024-09-11 15:53:25.191109] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18204, magic:0x78563412 [2024-09-11 15:53:25.191143] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:25.191151] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:25.320770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:25.330700] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:25.351194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:25.351233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:25.351240] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:25.351249] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:25.520877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:25.551546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:25.551583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:25.551591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:25.551601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:25.593406] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:25.593451] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1694 [2024-09-11 15:53:25.721002] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:25.751921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:25.751959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:25.751967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:25.751976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:25.791645] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1694, magic:0x78563412 [2024-09-11 15:53:25.791681] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:25.791703] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:25.921188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:25.938438] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041205938434, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:53:25.945141] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041205945138, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:53:25.952225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:25.952261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:25.952269] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:25.952278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:26.121372] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:26.125393] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:26.152581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:26.152627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:26.152635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:26.152644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:26.193388] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:26.193431] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1706 [2024-09-11 15:53:26.321493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:26.331515] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:26.352970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:26.353010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:26.353017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:26.353026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:26.392103] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1706, magic:0x78563412 [2024-09-11 15:53:26.392147] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:26.392170] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:26.521632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:26.553270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:26.553324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:26.553332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:26.553341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:26.721750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:26.753586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:26.753630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:26.753638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:26.753647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:26.794425] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:26.794469] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1714 [2024-09-11 15:53:26.921937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:26.946005] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041206946000, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 15:53:26.952755] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041206952750, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:53:26.953983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:26.954017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:26.954048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:26.954057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:26.992698] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1714, magic:0x78563412 [2024-09-11 15:53:26.992736] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:26.992743] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:27.125590] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:27.126472] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4344, replace_start_pos=11200000, replace_num=100000) [2024-09-11 15:53:27.126503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:27.154360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:27.154405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:27.154413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:27.154423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:27.161798] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7360, clean_start_pos=11800000, clean_num=200000) [2024-09-11 15:53:27.326608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:27.332513] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:27.362126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:27.362167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:27.362175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:27.362185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:27.395140] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:27.395183] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1730 [2024-09-11 15:53:27.526749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:27.562489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:27.562555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:27.562565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:27.562575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:27.593316] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1730, magic:0x78563412 [2024-09-11 15:53:27.593359] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:27.593367] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:27.726873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:27.762890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:27.762954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:27.762962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:27.762971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:27.927011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:27.953680] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041207953676, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 15:53:27.960381] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041207960377, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:53:27.963210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:27.963242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:27.963249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:27.963258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:27.995178] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:27.995317] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=132] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1744 [2024-09-11 15:53:28.125773] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:28.127138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:28.163577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:28.163624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:28.163632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:28.163642] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:28.193755] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1744, magic:0x78563412 [2024-09-11 15:53:28.193796] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:28.193803] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:28.327240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:28.333418] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:28.363989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:28.364035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:28.364043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:28.364052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:28.527460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:28.564306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:28.564346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:28.564354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:28.564363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:28.596033] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:28.596088] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1760 [2024-09-11 15:53:28.727648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:28.764614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:28.764661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:28.764669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:28.764678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:28.794214] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1760, magic:0x78563412 [2024-09-11 15:53:28.794252] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:28.794259] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:28.927763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:28.961240] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041208961237, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:53:28.965013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:28.965043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:28.965051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:28.965060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:28.967997] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041208967995, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:53:29.125992] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:29.127894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:29.165362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:29.165408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:29.165416] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:29.165426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:29.173069] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7629, clean_start_pos=12000000, clean_num=200000) [2024-09-11 15:53:29.195793] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:29.195838] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1762 [2024-09-11 15:53:29.331459] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3357, replace_start_pos=11300000, replace_num=100000) [2024-09-11 15:53:29.331502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:29.334395] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:29.373334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:29.373380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:29.373387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:29.373396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:29.394626] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1762, magic:0x78563412 [2024-09-11 15:53:29.394660] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:29.394668] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:29.531590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:29.573623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:29.573662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:29.573670] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:29.573679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:29.731713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:29.773925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:29.773962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:29.773969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:29.773978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:29.795492] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:29.795528] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1776 [2024-09-11 15:53:29.931923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:29.968926] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041209968921, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:53:29.974222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:29.974256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:29.974264] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:29.974274] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:29.975605] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726041209975604, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:53:29.993045] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1776, magic:0x78563412 [2024-09-11 15:53:29.993087] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:29.993094] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:30.126170] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:30.132112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:30.143423] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:30.143492] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=67] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:30.143572] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=23, max_check_version=24, global_version=25) [2024-09-11 15:53:30.145616] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2043 [2024-09-11 15:53:30.145655] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:30.145690] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:53:30.145728] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:53:30.145812] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:30.145947] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:53:30.146000] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:53:30.146012] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:53:30.146023] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:53:30.146065] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:53:30.146125] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:53:30.146146] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:53:30.174515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:30.174559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:30.174567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:30.174575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:30.332303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:30.335682] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:30.374820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:30.374866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:30.374874] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:30.374883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:30.395398] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:30.395440] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1778 [2024-09-11 15:53:30.532489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:30.575087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:30.575130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:30.575157] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:30.575167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:30.593809] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1778, magic:0x78563412 [2024-09-11 15:53:30.593849] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:30.593856] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:30.732611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:30.775396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:30.775441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:30.775449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:30.775457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:30.932739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:30.975693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:30.975737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:30.975744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:30.975752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:30.976451] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041210976448, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007527, add_bytes: 0 [2024-09-11 15:53:30.983279] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726041210983276, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:53:30.995889] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:30.995963] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=69] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1794 [2024-09-11 15:53:31.126331] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:31.132862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:31.176023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:31.176068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:31.176076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:31.176085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:31.184014] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7914, clean_start_pos=12200000, clean_num=200000) [2024-09-11 15:53:31.194001] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1794, magic:0x78563412 [2024-09-11 15:53:31.194042] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:31.194049] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:31.333074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:31.336781] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:31.384258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:31.384304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:31.384312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:31.384322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:31.537853] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4650, replace_start_pos=11400000, replace_num=100000) [2024-09-11 15:53:31.537892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:31.584543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:31.584580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:31.584586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:31.584595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:31.596225] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:31.596261] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1806 [2024-09-11 15:53:31.738062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:31.784840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:31.784881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:31.784888] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:31.784897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:31.794679] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1806, magic:0x78563412 [2024-09-11 15:53:31.794718] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:31.794725] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:31.938205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:31.984078] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041211984074, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:53:31.985148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:31.985180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:31.985186] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:31.985194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:31.990833] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041211990831, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:53:32.126453] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:32.138329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:32.185416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:32.185461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:32.185468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:32.185477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:32.196640] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:32.196676] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1822 [2024-09-11 15:53:32.337862] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:32.338461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:32.385703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:32.385746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:32.385755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:32.385764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:32.394971] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1822, magic:0x78563412 [2024-09-11 15:53:32.394999] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:32.395006] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:32.538574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:32.586013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:32.586058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:32.586065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:32.586075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:32.738761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:32.786304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:32.786368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:32.786376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:32.786384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:32.797477] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:32.797511] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1826 [2024-09-11 15:53:32.938860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:32.986606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:32.986644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:32.986652] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:32.986661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:32.991696] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041212991694, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:53:32.995698] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1826, magic:0x78563412 [2024-09-11 15:53:32.995731] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:32.995738] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:32.998519] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041212998517, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:53:33.126601] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:33.138988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:33.186919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:33.186962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:33.186986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:33.186995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:33.194723] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7715, clean_start_pos=12400000, clean_num=200000) [2024-09-11 15:53:33.338927] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:33.339095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:33.394987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:33.395033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:33.395041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:33.395050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:33.397894] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:33.397943] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1834 [2024-09-11 15:53:33.539208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:33.595274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:33.595319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:33.595326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:33.595334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:33.596137] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1834, magic:0x78563412 [2024-09-11 15:53:33.596173] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:33.596180] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:33.742688] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3357, replace_start_pos=11500000, replace_num=100000) [2024-09-11 15:53:33.742736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:33.795559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:33.795610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:33.795617] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:33.795625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:33.942835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:33.995871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:33.995927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:33.995936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:33.995945] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:33.997968] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:33.998002] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1838 [2024-09-11 15:53:33.999306] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726041213999304, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:53:34.006068] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041214006066, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:53:34.126722] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:34.143045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:34.196168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:34.196212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:34.196220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:34.196229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:34.196428] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1838, magic:0x78563412 [2024-09-11 15:53:34.196479] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:34.196488] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:34.340120] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:34.343182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:34.396454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:34.396517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:34.396524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:34.396533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:34.543288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:34.596788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:34.596830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:34.596837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:34.596846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:34.598563] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:34.598590] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1850 [2024-09-11 15:53:34.743432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:34.796989] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1850, magic:0x78563412 [2024-09-11 15:53:34.797030] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:34.797037] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:34.797059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:34.797097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:34.797104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:34.797111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:34.943567] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:34.997352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:34.997398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:34.997407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:34.997416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:35.006918] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041215006916, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:53:35.013747] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041215013744, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:53:35.126851] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:35.143768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:35.197701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:35.197750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:35.197758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:35.197768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:35.199273] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:35.199309] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1860 [2024-09-11 15:53:35.205447] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7667, clean_start_pos=0, clean_num=200000) [2024-09-11 15:53:35.341162] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:35.343953] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:35.397494] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1860, magic:0x78563412 [2024-09-11 15:53:35.397534] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:35.397541] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:35.405693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:35.405734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:35.405764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:35.405773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:35.544117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:35.605998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:35.606035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:35.606041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:35.606049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:35.744256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:35.799373] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:35.799412] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44048 [2024-09-11 15:53:35.806346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:35.806384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:35.806391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:35.806399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:35.948376] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3981, replace_start_pos=11600000, replace_num=100000) [2024-09-11 15:53:35.948423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:35.997814] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44048, magic:0x78563412 [2024-09-11 15:53:35.997859] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:35.997883] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:36.006621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:36.006665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:36.006674] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:36.006684] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:36.014539] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726041216014536, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:53:36.021309] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041216021306, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 15:53:36.127008] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=87] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:36.148518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:36.207014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:36.207058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:36.207066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:36.207075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:36.342390] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:36.348692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:36.400405] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:36.400451] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44058 [2024-09-11 15:53:36.407281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:36.407311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:36.407317] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:36.407324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:36.548818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:36.598294] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44058, magic:0x78563412 [2024-09-11 15:53:36.598353] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:36.598362] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:36.607611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:36.607644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:36.607652] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:36.607660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:36.748943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:36.807895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:36.807962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:36.807976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:36.807986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:36.949079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:37.000438] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:37.000483] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44060 [2024-09-11 15:53:37.008205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:37.008241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:37.008247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:37.008256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:37.022160] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041217022157, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:53:37.028918] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041217028915, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:53:37.127188] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=109] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:37.149259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:37.198744] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44060, magic:0x78563412 [2024-09-11 15:53:37.198789] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:37.198796] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:37.208490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:37.208518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:37.208524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:37.208533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:37.217033] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8487, clean_start_pos=200000, clean_num=200000) [2024-09-11 15:53:37.343809] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:37.349439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:37.417296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:37.417341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:37.417349] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:37.417358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:37.549579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:37.600443] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:37.600484] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44074 [2024-09-11 15:53:37.617666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:37.617709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:37.617717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:37.617744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:37.749699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:37.798997] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44074, magic:0x78563412 [2024-09-11 15:53:37.799042] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:37.799049] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:37.818016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:37.818060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:37.818067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:37.818077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:37.949837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:38.018299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:38.018341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:38.018347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:38.018355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:38.029784] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041218029780, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:53:38.036595] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041218036591, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 15:53:38.127300] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:38.154371] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4332, replace_start_pos=11700000, replace_num=100000) [2024-09-11 15:53:38.154435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:38.201458] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:38.201502] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44080 [2024-09-11 15:53:38.218580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:38.218626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:38.218633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:38.218642] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:38.345051] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:38.354522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:38.399672] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44080, magic:0x78563412 [2024-09-11 15:53:38.399715] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:38.399723] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:38.418838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:38.418874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:38.418881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:38.418889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:38.554712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:38.619116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:38.619157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:38.619163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:38.619171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:38.754853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:38.802140] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:38.802184] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44096 [2024-09-11 15:53:38.819370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:38.819411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:38.819422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:38.819429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:38.955093] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=83] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:39.000016] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44096, magic:0x78563412 [2024-09-11 15:53:39.000056] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:39.000062] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:39.019770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:39.019817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:39.019825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:39.019835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:39.037399] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041219037395, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:53:39.044209] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041219044205, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:53:39.127432] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:39.155237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:39.220049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:39.220108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:39.220115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:39.220122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:39.227189] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7056, clean_start_pos=400000, clean_num=200000) [2024-09-11 15:53:39.345971] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:39.355365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:39.402110] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:39.402155] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44104 [2024-09-11 15:53:39.427566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:39.427611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:39.427619] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:39.427629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:39.555499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:39.600405] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44104, magic:0x78563412 [2024-09-11 15:53:39.600450] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:39.600458] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:39.627861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:39.627917] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:39.627926] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:39.627936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:39.755669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:39.828177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:39.828224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:39.828254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:39.828262] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:39.955810] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:40.002615] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:40.002662] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44116 [2024-09-11 15:53:40.028508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:40.028559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:40.028567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:40.028576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:40.044999] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041220044995, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 15:53:40.051885] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041220051882, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 15:53:40.127553] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:40.155936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:40.158295] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:40.158342] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:40.158463] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=24, max_check_version=25, global_version=26) [2024-09-11 15:53:40.160787] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2323 [2024-09-11 15:53:40.160848] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:40.160884] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:53:40.160947] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:53:40.161034] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:40.161143] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:53:40.161199] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:53:40.161211] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:53:40.161222] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:53:40.161259] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:53:40.161322] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:53:40.161340] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:53:40.201108] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44116, magic:0x78563412 [2024-09-11 15:53:40.201148] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:40.201154] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:40.228829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:40.228880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:40.228886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:40.228894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:40.347011] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:40.359966] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3834, replace_start_pos=11800000, replace_num=100000) [2024-09-11 15:53:40.360011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:40.429159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:40.429205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:40.429212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:40.429220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:40.560102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:40.603109] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:40.603148] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44124 [2024-09-11 15:53:40.629447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:40.629491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:40.629515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:40.629522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:40.760306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:40.801205] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44124, magic:0x78563412 [2024-09-11 15:53:40.801241] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:40.801249] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:40.829760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:40.829806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:40.829814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:40.829824] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:40.960443] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:41.030087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:41.030133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:41.030141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:41.030151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:41.052615] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041221052612, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:53:41.059391] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726041221059388, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007506, add_bytes: 0 [2024-09-11 15:53:41.127702] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:41.160565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:41.203203] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:41.203247] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44140 [2024-09-11 15:53:41.230382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:41.230429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:41.230437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:41.230446] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:41.238339] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7877, clean_start_pos=600000, clean_num=200000) [2024-09-11 15:53:41.348033] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=122] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:41.360783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:41.401693] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44140, magic:0x78563412 [2024-09-11 15:53:41.401734] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:41.401742] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:41.438592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:41.438636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:41.438644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:41.438653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:41.560940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:41.638996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:41.639042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:41.639050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:41.639060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:41.761137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:41.804061] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:41.804104] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44148 [2024-09-11 15:53:41.839282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:41.839339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:41.839355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:41.839365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:41.961277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:42.002263] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44148, magic:0x78563412 [2024-09-11 15:53:42.002299] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:42.002306] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:42.039593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:42.039630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:42.039639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:42.039648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:42.060232] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041222060228, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:53:42.066995] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041222066991, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:53:42.127827] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:42.161391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:42.239868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:42.239943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:42.239952] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:42.239961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:42.349037] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:42.361495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:42.404547] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:42.404587] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44158 [2024-09-11 15:53:42.440180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:42.440218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:42.440224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:42.440232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:42.565957] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4333, replace_start_pos=11900000, replace_num=100000) [2024-09-11 15:53:42.565994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:42.602894] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44158, magic:0x78563412 [2024-09-11 15:53:42.602944] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:42.602952] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:42.640540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:42.640583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:42.640591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:42.640601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:42.766080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:42.840834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:42.840880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:42.840938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:42.840949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:42.966209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:43.004008] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:43.004053] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44162 [2024-09-11 15:53:43.041195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:43.041242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:43.041249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:43.041258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:43.067856] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041223067852, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:53:43.074713] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041223074709, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007718, add_bytes: 0 [2024-09-11 15:53:43.127954] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:43.166323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:43.202246] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44162, magic:0x78563412 [2024-09-11 15:53:43.202283] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:43.202290] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:43.241486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:43.241531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:43.241555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:43.241565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:43.249922] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8344, clean_start_pos=800000, clean_num=200000) [2024-09-11 15:53:43.350144] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:43.366435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:43.450168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:43.450212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:43.450220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:43.450228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:43.566575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:43.604050] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:43.604090] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44172 [2024-09-11 15:53:43.650445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:43.650483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:43.650490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:43.650499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:43.766681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:43.802456] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44172, magic:0x78563412 [2024-09-11 15:53:43.802494] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:43.802502] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:43.850718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:43.850760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:43.850767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:43.850793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:43.851026] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=92, refresh_score_time=64, wash_time=0) [2024-09-11 15:53:43.966787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:44.051247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:44.051282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:44.051288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:44.051298] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:44.075480] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041224075476, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:53:44.082295] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041224082291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007582, add_bytes: 0 [2024-09-11 15:53:44.128067] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:44.166897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:44.204153] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:44.204185] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44186 [2024-09-11 15:53:44.251530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:44.251580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:44.251588] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:44.251597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:44.351325] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:44.367064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:44.402817] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44186, magic:0x78563412 [2024-09-11 15:53:44.402864] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:44.402871] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:44.451938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:44.452005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:44.452012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:44.452021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:44.567184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:44.652259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:44.652303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:44.652311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:44.652319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:44.771377] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3960, replace_start_pos=12000000, replace_num=100000) [2024-09-11 15:53:44.771421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:44.804958] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:44.805001] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44200 [2024-09-11 15:53:44.852562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:44.852607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:44.852615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:44.852624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:44.971505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:45.003496] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44200, magic:0x78563412 [2024-09-11 15:53:45.003555] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:45.003563] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:45.052849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:45.052893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:45.052915] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:45.052926] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:45.083077] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041225083075, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 15:53:45.089860] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041225089856, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 15:53:45.128189] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:45.171621] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:45.253148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:45.253189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:45.253197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:45.253207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:45.261383] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8162, clean_start_pos=1000000, clean_num=200000) [2024-09-11 15:53:45.352562] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:45.371717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:45.404446] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:45.404484] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44210 [2024-09-11 15:53:45.461625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:45.461663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:45.461670] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:45.461679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:45.571835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:45.602665] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44210, magic:0x78563412 [2024-09-11 15:53:45.602700] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:45.602707] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:45.661925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:45.661963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:45.661971] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:45.661981] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:45.771943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:45.862223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:45.862261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:45.862269] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:45.862277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:45.972060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:46.005272] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:46.005312] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60586 [2024-09-11 15:53:46.062500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:46.062543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:46.062571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:46.062580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:46.090694] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726041226090691, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:53:46.097524] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041226097521, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 15:53:46.128317] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:46.172182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:46.203426] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60586, magic:0x78563412 [2024-09-11 15:53:46.203461] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:46.203469] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:46.262806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:46.262861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:46.262868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:46.262877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:46.353829] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:46.372289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:46.463178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:46.463226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:46.463235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:46.463244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:46.572421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:46.605526] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:46.605570] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60602 [2024-09-11 15:53:46.663510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:46.663554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:46.663576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:46.663587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:46.772540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:46.803771] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60602, magic:0x78563412 [2024-09-11 15:53:46.803809] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:46.803818] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:46.863833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:46.863887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:46.863932] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:46.863943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:46.976995] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4349, replace_start_pos=12100000, replace_num=100000) [2024-09-11 15:53:46.977041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:47.064188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:47.064232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:47.064240] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:47.064249] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:47.098309] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726041227098304, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:53:47.105147] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041227105144, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:53:47.128439] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:47.177215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:47.206046] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:47.206090] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60612 [2024-09-11 15:53:47.264498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:47.264544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:47.264552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:47.264561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:47.273071] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8496, clean_start_pos=1200000, clean_num=200000) [2024-09-11 15:53:47.354757] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=108] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:47.377336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:47.404318] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60612, magic:0x78563412 [2024-09-11 15:53:47.404349] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:47.404357] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:47.473398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:47.473440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:47.473448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:47.473458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:47.577564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:47.673769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:47.673813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:47.673821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:47.673831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:47.777691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:47.806122] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:47.806167] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60626 [2024-09-11 15:53:47.874158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:47.874208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:47.874217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:47.874226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:47.977920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:48.004789] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60626, magic:0x78563412 [2024-09-11 15:53:48.004826] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:48.004833] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:48.074474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:48.074518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:48.074526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:48.074535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:48.105938] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726041228105934, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:53:48.112772] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041228112769, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:53:48.128609] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:48.178101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:48.274858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:48.274929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:48.274938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:48.274948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:48.356005] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:48.378296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:48.406638] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:48.406682] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60636 [2024-09-11 15:53:48.475178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:48.475220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:48.475226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:48.475234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:48.578428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:48.605065] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60636, magic:0x78563412 [2024-09-11 15:53:48.605105] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:48.605111] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:48.675470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:48.675516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:48.675524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:48.675533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:48.778548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:48.875782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:48.875849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:48.875858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:48.875867] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:48.978675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:49.007086] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:49.007131] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60640 [2024-09-11 15:53:49.076067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:49.076105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:49.076113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:49.076122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:49.113541] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041229113536, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:53:49.120327] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041229120324, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:53:49.128822] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:49.183204] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4348, replace_start_pos=12200000, replace_num=100000) [2024-09-11 15:53:49.183252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:49.205698] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60640, magic:0x78563412 [2024-09-11 15:53:49.205736] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:49.205742] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:49.276365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:49.276410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:49.276418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:49.276427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:49.284019] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7579, clean_start_pos=1400000, clean_num=200000) [2024-09-11 15:53:49.357034] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:49.383437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:49.484356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:49.484397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:49.484406] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:49.484415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:49.583627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:49.607841] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:49.607883] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60642 [2024-09-11 15:53:49.684722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:49.684767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:49.684775] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:49.684785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:49.783757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:49.806032] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60642, magic:0x78563412 [2024-09-11 15:53:49.806070] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:49.806077] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:49.885091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:49.885159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:49.885169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:49.885181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:49.983931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:50.085516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:50.085560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:50.085568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:50.085578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:50.121160] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041230121155, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:53:50.128003] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041230127999, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:53:50.128938] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:50.174295] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:50.174349] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:53:50.174432] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=25, max_check_version=26, global_version=27) [2024-09-11 15:53:50.176481] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2048 [2024-09-11 15:53:50.176539] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:50.176573] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:53:50.176611] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:53:50.176694] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:53:50.176801] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:53:50.176854] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:53:50.176866] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:53:50.176876] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:53:50.176924] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:53:50.176990] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:53:50.177012] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:53:50.184115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:50.208509] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:50.208551] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60650 [2024-09-11 15:53:50.285879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:50.285950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:50.285960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:50.285970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:50.358266] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:50.384303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:50.406655] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60650, magic:0x78563412 [2024-09-11 15:53:50.406692] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:50.406700] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:50.486274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:50.486320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:50.486328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:50.486338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:50.584496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:50.686652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:50.686698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:50.686707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:50.686716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:50.784627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:50.808534] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:50.808573] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60656 [2024-09-11 15:53:50.887075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:50.887118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:50.887126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:50.887136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:50.984850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:51.006844] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60656, magic:0x78563412 [2024-09-11 15:53:51.006882] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:51.006889] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:51.087457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:51.087503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:51.087511] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:51.087521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:51.128775] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041231128771, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:53:51.129126] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:51.135629] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041231135625, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:53:51.185067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:51.287856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:51.287924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:51.287934] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:51.287944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:51.295866] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7908, clean_start_pos=1600000, clean_num=200000) [2024-09-11 15:53:51.359488] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:51.389632] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4349, replace_start_pos=12300000, replace_num=100000) [2024-09-11 15:53:51.389681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:51.408972] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:51.409013] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60660 [2024-09-11 15:53:51.496187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:51.496230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:51.496238] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:51.496247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:51.496442] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:53:51.589831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:51.607351] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60660, magic:0x78563412 [2024-09-11 15:53:51.607385] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:51.607392] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:51.696700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:51.696744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:51.696751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:51.696777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:51.790038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:51.897077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:51.897129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:51.897143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:51.897155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:51.990167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:52.009353] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:52.009395] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60666 [2024-09-11 15:53:52.097489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:52.097536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:52.097544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:52.097553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:52.129238] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:52.136461] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041232136457, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:53:52.143222] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041232143218, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 15:53:52.190351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:52.208649] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60666, magic:0x78563412 [2024-09-11 15:53:52.208703] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:52.208711] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:52.297797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:52.297837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:52.297845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:52.297854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:52.360521] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:52.390478] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:52.498111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:52.498156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:52.498163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:52.498172] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:52.590662] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:52.610500] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:52.610542] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60672 [2024-09-11 15:53:52.698472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:52.698512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:52.698520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:52.698530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:52.790799] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:52.809043] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60672, magic:0x78563412 [2024-09-11 15:53:52.809083] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:52.809091] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:52.898844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:52.898936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=90][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:52.898947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:52.898957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:52.990998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:53.099298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:53.099345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:53.099353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:53.099363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:53.129425] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:53.144078] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041233144074, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:53:53.150774] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041233150770, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:53:53.191182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:53.210659] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:53.210698] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60676 [2024-09-11 15:53:53.299718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:53.299764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:53.299771] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:53.299780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:53.307830] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8019, clean_start_pos=1800000, clean_num=200000) [2024-09-11 15:53:53.361259] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:53.391420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:53.408328] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60676, magic:0x78563412 [2024-09-11 15:53:53.408382] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:53.408405] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:53.508161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:53.508204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:53.508213] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:53.508223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:53.595294] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3693, replace_start_pos=12400000, replace_num=100000) [2024-09-11 15:53:53.595341] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:53.708581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:53.708627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:53.708635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:53.708644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:53.795427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:53.810357] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:53.810394] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60692 [2024-09-11 15:53:53.908977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:53.909024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:53.909031] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:53.909041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:53.995628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:54.008750] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60692, magic:0x78563412 [2024-09-11 15:53:54.008791] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:54.008798] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:54.109381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:54.109427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:54.109435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:54.109445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:54.129646] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:54.151630] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041234151626, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:53:54.158413] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041234158410, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 15:53:54.195828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:54.309701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:54.309745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:54.309753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:54.309762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:54.361997] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:54.395966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:54.410996] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:54.411035] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60696 [2024-09-11 15:53:54.510072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:54.510112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:54.510120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:54.510143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:54.596156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:54.609393] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60696, magic:0x78563412 [2024-09-11 15:53:54.609430] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:54.609436] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:54.710451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:54.710491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:54.710499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:54.710508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:54.796339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:54.910823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:54.910864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:54.910872] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:54.910883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:54.996460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:55.010194] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:55.010238] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60712 [2024-09-11 15:53:55.111135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:55.111197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:55.111205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:55.111215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:55.129842] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:55.159314] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041235159310, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:53:55.166093] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041235166088, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:53:55.196647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:55.208599] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60712, magic:0x78563412 [2024-09-11 15:53:55.208643] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:55.208651] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:55.311534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:55.311582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:55.311590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:55.311599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:55.320214] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8601, clean_start_pos=2000000, clean_num=200000) [2024-09-11 15:53:55.396778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:55.462811] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:55.520551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:55.520593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:55.520601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:55.520611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:55.596990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:55.610579] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:55.610648] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=63] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19022 [2024-09-11 15:53:55.720945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:55.720984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:55.720992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:55.721000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:55.800791] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3603, replace_start_pos=12500000, replace_num=100000) [2024-09-11 15:53:55.800841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:55.808935] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19022, magic:0x78563412 [2024-09-11 15:53:55.808968] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:55.808975] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:55.921325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:55.921369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:55.921378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:55.921387] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:56.001004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:56.121650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:56.121692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:56.121699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:56.121723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:56.130078] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=100] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:56.166855] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041236166851, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 15:53:56.173635] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041236173632, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 15:53:56.201139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:56.210303] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:56.210348] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19028 [2024-09-11 15:53:56.321995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:56.322033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:56.322040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:56.322049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:56.401326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:56.408620] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19028, magic:0x78563412 [2024-09-11 15:53:56.408661] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:56.408669] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:56.463705] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:56.522299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:56.522346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:56.522354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:56.522363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:56.601518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:56.722613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:56.722659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:56.722684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:56.722693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:56.801730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:56.810856] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:56.810899] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19044 [2024-09-11 15:53:56.922975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:56.923027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:56.923039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:56.923055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:57.001869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:57.009063] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19044, magic:0x78563412 [2024-09-11 15:53:57.009108] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:57.009117] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:57.123283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:57.123318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:57.123326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:57.123335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:57.130270] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:57.174472] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041237174467, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:53:57.181306] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041237181303, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 15:53:57.202083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:57.323578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:57.323623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:57.323630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:57.323639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:57.331004] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7351, clean_start_pos=2200000, clean_num=200000) [2024-09-11 15:53:57.402227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:57.411697] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:57.411741] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19058 [2024-09-11 15:53:57.464428] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:57.531267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:57.531310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:57.531318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:57.531327] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:57.602344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:57.609624] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19058, magic:0x78563412 [2024-09-11 15:53:57.609667] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:57.609676] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:57.731630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:57.731676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:57.731684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:57.731693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:57.802535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:53:57.932074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:57.932123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:57.932131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:57.932141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:58.006962] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4297, replace_start_pos=0, replace_num=100000) [2024-09-11 15:53:58.007013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:53:58.012244] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:58.012276] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19066 [2024-09-11 15:53:58.130459] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:58.132447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:58.132477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:58.132485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:58.132495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:58.182212] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041238182207, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007740, add_bytes: 0 [2024-09-11 15:53:58.188881] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041238188877, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 15:53:58.207103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:53:58.210077] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19066, magic:0x78563412 [2024-09-11 15:53:58.210125] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:58.210133] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:58.332804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:58.332851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:58.332859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:58.332868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:58.407301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:53:58.465291] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:58.533197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:58.533245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:58.533254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:58.533264] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:58.607503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:53:58.611659] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:58.611690] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19068 [2024-09-11 15:53:58.733521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:58.733567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:58.733575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:58.733584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:58.807628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:53:58.810332] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19068, magic:0x78563412 [2024-09-11 15:53:58.810364] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:58.810373] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:58.933936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:58.933979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:58.933987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:58.933996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:59.007868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:53:59.130655] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:53:59.134306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:59.134339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:59.134348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:59.134358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:59.189703] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041239189699, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007492, add_bytes: 0 [2024-09-11 15:53:59.196542] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1726041239196540, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 15:53:59.208080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:53:59.212284] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:59.212321] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19078 [2024-09-11 15:53:59.334584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:59.334624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:59.334630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:59.334651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:59.341188] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6524, clean_start_pos=2400000, clean_num=200000) [2024-09-11 15:53:59.408270] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:53:59.410796] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19078, magic:0x78563412 [2024-09-11 15:53:59.410827] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:53:59.410835] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:53:59.466315] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:53:59.541519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:59.541564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:59.541572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:59.541582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:59.608456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:53:59.741876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:59.741941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:59.741950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:59.741961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:53:59.808587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:53:59.813198] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:53:59.813239] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19084 [2024-09-11 15:53:59.942197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:53:59.942241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:53:59.942248] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:53:59.942255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:00.008776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:00.011429] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19084, magic:0x78563412 [2024-09-11 15:54:00.011459] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:00.011466] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:00.130798] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:00.142643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:00.142689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:00.142697] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:00.142707] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:00.183260] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 15:54:00.192090] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:00.192143] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:00.192222] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=26, max_check_version=27, global_version=28) [2024-09-11 15:54:00.194261] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2038 [2024-09-11 15:54:00.194331] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=56] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:00.194369] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:54:00.194407] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:54:00.194492] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:00.194599] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:54:00.194654] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:54:00.194666] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:54:00.194677] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:54:00.194714] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:54:00.194775] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:54:00.194796] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:54:00.197340] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041240197337, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 15:54:00.197371] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 15:54:00.201762] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 15:54:00.204096] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041240204093, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:54:00.204132] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:54:00.212756] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3783, replace_start_pos=100000, replace_num=100000) [2024-09-11 15:54:00.212801] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:00.343036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:00.343078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:00.343086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:00.343096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:00.412945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:00.413206] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:00.413227] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19094 [2024-09-11 15:54:00.467371] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:00.543404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:00.543445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:00.543453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:00.543462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:00.611666] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19094, magic:0x78563412 [2024-09-11 15:54:00.611715] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:00.611728] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:00.613068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:00.743764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:00.743809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:00.743817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:00.743826] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:00.813194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:00.944080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:00.944127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:00.944135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:00.944145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:01.013411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:01.013450] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:01.013482] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19096 [2024-09-11 15:54:01.131026] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=85] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:01.144451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:01.144497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:01.144505] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:01.144515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:01.204944] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041241204940, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:54:01.211717] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041241211714, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:54:01.212214] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19096, magic:0x78563412 [2024-09-11 15:54:01.212246] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:01.212254] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:01.213545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:01.344826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:01.344874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:01.344883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:01.344893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:01.352567] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7621, clean_start_pos=2600000, clean_num=200000) [2024-09-11 15:54:01.413704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:01.468741] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:01.552846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:01.552888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:01.552895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:01.552926] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:01.613824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:01.614166] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:01.614189] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19104 [2024-09-11 15:54:01.753177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:01.753218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:01.753226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:01.753235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:01.812829] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19104, magic:0x78563412 [2024-09-11 15:54:01.812867] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:01.812875] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:01.813951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:01.953556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:01.953613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:01.953631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:01.953641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:02.014173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:02.131139] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:02.153934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:02.153980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:02.153988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:02.153997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:02.212620] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726041242212615, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:54:02.214298] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:02.214463] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:02.214486] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19106 [2024-09-11 15:54:02.219316] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041242219315, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 15:54:02.354311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:02.354357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:02.354365] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:02.354375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:02.413091] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19106, magic:0x78563412 [2024-09-11 15:54:02.413133] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:02.413140] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:02.418802] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4405, replace_start_pos=200000, replace_num=100000) [2024-09-11 15:54:02.418845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:02.469676] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:02.554683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:02.554731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:02.554738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:02.554748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:02.618993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:02.755070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:02.755115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:02.755124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:02.755133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:02.815802] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:02.815850] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19122 [2024-09-11 15:54:02.819112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:02.955459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:02.955506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:02.955514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:02.955524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:03.013678] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19122, magic:0x78563412 [2024-09-11 15:54:03.013719] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:03.013727] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:03.019230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:03.131272] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:03.155768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:03.155810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:03.155818] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:03.155828] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:03.219343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:03.220173] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041243220171, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 15:54:03.226935] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726041243226930, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:54:03.356156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:03.356201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:03.356228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:03.356239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:03.364937] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8682, clean_start_pos=2800000, clean_num=200000) [2024-09-11 15:54:03.415561] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:03.415607] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19132 [2024-09-11 15:54:03.419459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:03.470825] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:03.565193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:03.565238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:03.565246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:03.565255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:03.614079] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19132, magic:0x78563412 [2024-09-11 15:54:03.614112] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:03.614119] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:03.619559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:03.765477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:03.765508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:03.765514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:03.765523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:03.819644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:03.965827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:03.965871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:03.965879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:03.965924] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:04.016406] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:04.016453] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19148 [2024-09-11 15:54:04.019748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:04.131385] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:04.166159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:04.166204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:04.166212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:04.166221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:04.166439] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=79, refresh_score_time=65, wash_time=0) [2024-09-11 15:54:04.213622] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19148, magic:0x78563412 [2024-09-11 15:54:04.213666] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:04.213673] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:04.219850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:04.227792] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726041244227787, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:54:04.234541] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041244234539, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:54:04.366684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:04.366729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:04.366737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:04.366762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:04.420036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:04.472048] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=100] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:04.567010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:04.567066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:04.567075] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:04.567089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:04.615829] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:04.615882] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19160 [2024-09-11 15:54:04.624505] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4347, replace_start_pos=300000, replace_num=100000) [2024-09-11 15:54:04.624545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:04.767316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:04.767355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:04.767363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:04.767372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:04.814034] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19160, magic:0x78563412 [2024-09-11 15:54:04.814070] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:04.814077] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:04.824629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:04.967603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:04.967649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:04.967657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:04.967666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:05.024809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:05.131513] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:05.167945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:05.167985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:05.167993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:05.168002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:05.216315] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:05.216359] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19174 [2024-09-11 15:54:05.224988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:05.235463] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041245235460, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 15:54:05.242170] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041245242167, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 15:54:05.368230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:05.368275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:05.368282] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:05.368291] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:05.376549] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8245, clean_start_pos=3000000, clean_num=200000) [2024-09-11 15:54:05.414441] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19174, magic:0x78563412 [2024-09-11 15:54:05.414502] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:05.414510] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:05.425165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:05.473160] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:05.576815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:05.576863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:05.576887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:05.576897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:05.625356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:05.777135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:05.777181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:05.777189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:05.777198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:05.816361] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:05.816393] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31834 [2024-09-11 15:54:05.825471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:05.977423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:05.977454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:05.977461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:05.977470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:06.014776] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31834, magic:0x78563412 [2024-09-11 15:54:06.014798] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:06.014804] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:06.025560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:06.131651] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:06.177694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:06.177722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:06.177728] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:06.177737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:06.225674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:06.243089] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041246243085, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:54:06.249778] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041246249774, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 15:54:06.378060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:06.378103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:06.378111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:06.378120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:06.416890] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:06.416946] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31846 [2024-09-11 15:54:06.425790] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:06.474186] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:06.578343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:06.578382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:06.578388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:06.578397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:06.615191] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31846, magic:0x78563412 [2024-09-11 15:54:06.615220] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:06.615227] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:06.625887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:06.778603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:06.778647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:06.778653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:06.778662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:06.829830] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3835, replace_start_pos=400000, replace_num=100000) [2024-09-11 15:54:06.829874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:06.978930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:06.978982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:06.978997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:06.979007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:07.017283] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:07.017328] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31858 [2024-09-11 15:54:07.030018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:07.131765] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:07.179237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:07.179285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:07.179293] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:07.179323] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:07.215683] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31858, magic:0x78563412 [2024-09-11 15:54:07.215719] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:07.215726] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:07.230135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:07.250713] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041247250708, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:54:07.257389] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041247257385, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:54:07.379634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:07.379680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:07.379688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:07.379698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:07.386638] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6926, clean_start_pos=3200000, clean_num=200000) [2024-09-11 15:54:07.430316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:07.475101] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:07.586885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:07.586947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:07.586955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:07.586964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:07.617442] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:07.617488] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31872 [2024-09-11 15:54:07.630493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:07.787263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:07.787308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:07.787335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:07.787346] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:07.816082] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31872, magic:0x78563412 [2024-09-11 15:54:07.816126] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:07.816134] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:07.830709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:07.987582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:07.987628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:07.987636] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:07.987645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:08.030845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:08.131970] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:08.187879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:08.187940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:08.187948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:08.187957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:08.217075] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:08.217112] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31880 [2024-09-11 15:54:08.230994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:08.258323] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041248258317, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:54:08.265015] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041248265012, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:54:08.388196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:08.388243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:08.388251] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:08.388260] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:08.415502] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31880, magic:0x78563412 [2024-09-11 15:54:08.415545] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:08.415553] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:08.431112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:08.476109] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:08.588558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:08.588604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:08.588612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:08.588621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:08.631325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:08.788945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:08.788991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:08.788999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:08.789008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:08.817581] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:08.817625] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31888 [2024-09-11 15:54:08.831449] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:08.989315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:08.989359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:08.989368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:08.989378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:09.014791] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31888, magic:0x78563412 [2024-09-11 15:54:09.014834] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:09.014842] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:09.035891] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4308, replace_start_pos=500000, replace_num=100000) [2024-09-11 15:54:09.035947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:09.132127] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:09.189682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:09.189730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:09.189738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:09.189748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:09.236101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:09.265865] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041249265862, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 15:54:09.272640] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041249272637, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:54:09.390091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:09.390140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:09.390148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:09.390158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:09.397416] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7244, clean_start_pos=3400000, clean_num=200000) [2024-09-11 15:54:09.416787] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:09.416832] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31896 [2024-09-11 15:54:09.436295] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:09.477015] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:09.597739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:09.597787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:09.597795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:09.597805] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:09.615455] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31896, magic:0x78563412 [2024-09-11 15:54:09.615500] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:09.615508] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:09.636432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:09.798016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:09.798054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:09.798060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:09.798068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:09.836554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:09.998300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:09.998366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:09.998374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:09.998383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:10.017515] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:10.017540] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31912 [2024-09-11 15:54:10.036669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:10.132311] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:10.198615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:10.198658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:10.198665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:10.198675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:10.209854] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:10.209918] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=62] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:10.209998] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=27, max_check_version=28, global_version=29) [2024-09-11 15:54:10.211993] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1993 [2024-09-11 15:54:10.212051] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:10.212083] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:54:10.212116] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:54:10.212191] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:10.212274] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:54:10.212322] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:54:10.212331] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:54:10.212339] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:54:10.212370] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:54:10.212418] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:54:10.212440] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:54:10.215733] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31912, magic:0x78563412 [2024-09-11 15:54:10.215764] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:10.215772] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:10.236776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:10.273495] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726041250273492, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:54:10.280249] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041250280245, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:54:10.399027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:10.399070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:10.399078] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:10.399087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:10.436893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:10.478026] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:10.599319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:10.599364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:10.599371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:10.599380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:10.617451] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:10.617494] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31922 [2024-09-11 15:54:10.637104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:10.799610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:10.799651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:10.799659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:10.799686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:10.816100] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31922, magic:0x78563412 [2024-09-11 15:54:10.816131] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:10.816138] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:10.837221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:11.000023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:11.000073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:11.000080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:11.000089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:11.037396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:11.132465] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:11.200331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:11.200376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:11.200384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:11.200393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:11.218267] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:11.218305] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31938 [2024-09-11 15:54:11.242007] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4432, replace_start_pos=600000, replace_num=100000) [2024-09-11 15:54:11.242072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:11.281103] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041251281099, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 15:54:11.287861] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041251287858, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:54:11.400720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:11.400768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:11.400776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:11.400786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:11.409254] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8455, clean_start_pos=3600000, clean_num=200000) [2024-09-11 15:54:11.416595] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31938, magic:0x78563412 [2024-09-11 15:54:11.416629] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:11.416635] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:11.442165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:11.479141] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:11.609518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:11.609563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:11.609571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:11.609581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:11.642293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:11.809886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:11.809952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:11.809960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:11.809970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:11.817976] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:11.818041] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31946 [2024-09-11 15:54:11.842431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:12.010230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:12.010281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:12.010295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:12.010304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:12.015990] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31946, magic:0x78563412 [2024-09-11 15:54:12.016027] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:12.016035] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:12.042551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:12.132578] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:12.210567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:12.210616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:12.210624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:12.210633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:12.242725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:12.288783] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041252288779, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 15:54:12.295610] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726041252295607, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007749, add_bytes: 0 [2024-09-11 15:54:12.410870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:12.410929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:12.410938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:12.410947] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:12.418270] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:12.418314] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31956 [2024-09-11 15:54:12.442861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:12.480352] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:12.611176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:12.611217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:12.611224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:12.611233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:12.615340] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31956, magic:0x78563412 [2024-09-11 15:54:12.615364] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:12.615370] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:12.643010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:12.811537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:12.811581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:12.811589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:12.811599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:12.843203] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:13.011894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:13.011955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:13.011979] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:13.011988] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:13.016942] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:13.016988] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31972 [2024-09-11 15:54:13.043327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:13.132706] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:13.212287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:13.212331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:13.212339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:13.212348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:13.214557] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31972, magic:0x78563412 [2024-09-11 15:54:13.214586] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:13.214594] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:13.243581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:13.296336] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041253296332, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:54:13.303094] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041253303091, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007484, add_bytes: 0 [2024-09-11 15:54:13.412646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:13.412693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:13.412702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:13.412730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:13.419705] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6962, clean_start_pos=3800000, clean_num=200000) [2024-09-11 15:54:13.447057] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3354, replace_start_pos=700000, replace_num=100000) [2024-09-11 15:54:13.447105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:13.481334] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:13.616954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:13.616995] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31974 [2024-09-11 15:54:13.619989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:13.620031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:13.620038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:13.620047] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:13.647185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:13.815164] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31974, magic:0x78563412 [2024-09-11 15:54:13.815202] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:13.815209] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:13.820254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:13.820288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:13.820294] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:13.820302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:13.847368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:14.020532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:14.020579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:14.020609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:14.020619] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:14.047554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:14.132825] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:14.216720] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:14.216763] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31978 [2024-09-11 15:54:14.220844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:14.220875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:14.220882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:14.220891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:14.247668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:14.303950] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041254303948, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:54:14.310710] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041254310707, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:54:14.414435] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31978, magic:0x78563412 [2024-09-11 15:54:14.414477] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:14.414484] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:14.421144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:14.421180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:14.421187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:14.421212] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:14.447761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:14.482375] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:14.621447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:14.621494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:14.621524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:14.621534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:14.647862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:14.817087] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:14.817128] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31980 [2024-09-11 15:54:14.821759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:14.821793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:14.821800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:14.821809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:14.848049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:15.015117] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31980, magic:0x78563412 [2024-09-11 15:54:15.015160] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:15.015168] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:15.022048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:15.022078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:15.022084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:15.022093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:15.048173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:15.132958] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:15.222314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:15.222358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:15.222366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:15.222375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:15.248375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:15.311582] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041255311578, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:54:15.318327] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041255318323, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:54:15.416225] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:15.416268] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31988 [2024-09-11 15:54:15.422599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:15.422637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:15.422644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:15.422653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:15.431160] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8494, clean_start_pos=4000000, clean_num=200000) [2024-09-11 15:54:15.448562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:15.483580] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:15.614303] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31988, magic:0x78563412 [2024-09-11 15:54:15.614340] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:15.614349] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:15.631407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:15.631452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:15.631460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:15.631491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:15.653045] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4357, replace_start_pos=800000, replace_num=100000) [2024-09-11 15:54:15.653098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:15.831842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:15.831891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:15.831899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:15.831931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:15.853249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:16.015333] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:16.015380] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61698 [2024-09-11 15:54:16.032170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:16.032213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:16.032220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:16.032229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:16.053435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:16.133098] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:16.213763] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61698, magic:0x78563412 [2024-09-11 15:54:16.213801] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:16.213824] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:16.232442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:16.232473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:16.232480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:16.232488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:16.253552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:16.319175] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041256319171, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 15:54:16.325939] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041256325935, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:54:16.432696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:16.432737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:16.432744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:16.432751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:16.453656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:16.484821] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:16.616215] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:16.616254] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61706 [2024-09-11 15:54:16.633013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:16.633048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:16.633056] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:16.633065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:16.653776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:16.814202] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61706, magic:0x78563412 [2024-09-11 15:54:16.814243] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:16.814267] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:16.833376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:16.833413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:16.833420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:16.833428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:16.853913] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:17.033645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:17.033697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:17.033704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:17.033712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:17.054031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:17.133203] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:17.214827] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:17.214854] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61716 [2024-09-11 15:54:17.234030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:17.234070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:17.234078] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:17.234087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:17.254148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:17.326800] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041257326796, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:54:17.333625] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041257333622, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:54:17.413387] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61716, magic:0x78563412 [2024-09-11 15:54:17.413422] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:17.413429] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:17.434354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:17.434393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:17.434401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:17.434411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:17.442261] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7837, clean_start_pos=4200000, clean_num=200000) [2024-09-11 15:54:17.454267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:17.486197] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:17.642568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:17.642608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:17.642616] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:17.642625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:17.654383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:17.815294] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:17.815331] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61724 [2024-09-11 15:54:17.842840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:17.842883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:17.842890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:17.842897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:17.858864] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4385, replace_start_pos=900000, replace_num=100000) [2024-09-11 15:54:17.858920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:18.013986] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61724, magic:0x78563412 [2024-09-11 15:54:18.014030] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:18.014038] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:18.043180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:18.043225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:18.043233] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:18.043242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:18.059020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:18.133388] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:18.243481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:18.243527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:18.243534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:18.243542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:18.259220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:18.334484] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041258334479, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 15:54:18.341190] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041258341186, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 15:54:18.416291] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:18.416337] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61740 [2024-09-11 15:54:18.443789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:18.443834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:18.443842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:18.443851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:18.459408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:18.487398] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:18.614420] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61740, magic:0x78563412 [2024-09-11 15:54:18.614463] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:18.614472] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:18.644093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:18.644144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:18.644151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:18.644160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:18.659532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:18.844375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:18.844421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:18.844428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:18.844435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:18.859665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:19.016304] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:19.016365] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61742 [2024-09-11 15:54:19.044687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:19.044740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:19.044749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:19.044759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:19.059792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:19.133609] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:19.214797] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61742, magic:0x78563412 [2024-09-11 15:54:19.214837] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:19.214844] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:19.245019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:19.245058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:19.245065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:19.245072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:19.259981] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:19.342044] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726041259342040, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:54:19.348853] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041259348849, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 15:54:19.445297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:19.445344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:19.445784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=438][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:19.445800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:19.452751] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6937, clean_start_pos=4400000, clean_num=200000) [2024-09-11 15:54:19.460167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:19.488545] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:19.616582] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:19.616627] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61754 [2024-09-11 15:54:19.653053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:19.653092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:19.653100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:19.653109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:19.660291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:19.814979] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61754, magic:0x78563412 [2024-09-11 15:54:19.815017] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:19.815025] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:19.853354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:19.853406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:19.853413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:19.853421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:19.860421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:20.053635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:20.053676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:20.053682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:20.053712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:20.064231] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3694, replace_start_pos=1000000, replace_num=100000) [2024-09-11 15:54:20.064278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:20.133785] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:20.216981] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:20.217025] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61764 [2024-09-11 15:54:20.225991] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:20.226030] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:20.226111] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=28, max_check_version=29, global_version=30) [2024-09-11 15:54:20.228104] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1992 [2024-09-11 15:54:20.228139] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:20.228176] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:54:20.228236] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:54:20.228320] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:20.228427] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 15:54:20.228477] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:54:20.228492] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:54:20.228504] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:54:20.228540] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:54:20.228599] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:54:20.228620] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:54:20.253968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:20.254005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:20.254012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:20.254032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:20.264378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:20.349708] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041260349704, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 15:54:20.356399] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1726041260356395, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 15:54:20.415565] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61764, magic:0x78563412 [2024-09-11 15:54:20.415604] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:20.415612] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:20.454259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:20.454301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:20.454307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:20.454314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:20.464497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:20.489496] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:20.654574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:20.654618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:20.654626] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:20.654636] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:20.664611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:20.818277] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:20.818315] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61768 [2024-09-11 15:54:20.854955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:20.854994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:20.855001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:20.855027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:20.864740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:21.015984] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61768, magic:0x78563412 [2024-09-11 15:54:21.016028] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:21.016035] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:21.055242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:21.055283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:21.055289] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:21.055296] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:21.064926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:21.133933] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:21.255541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:21.255589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:21.255597] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:21.255606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:21.265104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:21.357347] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041261357343, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 15:54:21.364030] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041261364026, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:54:21.418038] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:21.418075] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61776 [2024-09-11 15:54:21.455819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:21.455862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:21.455868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:21.455876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:21.463084] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7196, clean_start_pos=4600000, clean_num=200000) [2024-09-11 15:54:21.465238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:21.490600] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:21.616391] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61776, magic:0x78563412 [2024-09-11 15:54:21.616426] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:21.616434] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:21.663334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:21.663381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:21.663388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:21.663395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:21.663546] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:54:21.665359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:21.863883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:21.863949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:21.863957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:21.863965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:21.865477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:22.018396] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:22.018439] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61782 [2024-09-11 15:54:22.064209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:22.064263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:22.064275] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:22.064283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:22.065608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:22.134040] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:22.216768] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61782, magic:0x78563412 [2024-09-11 15:54:22.216800] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:22.216807] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:22.264525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:22.264570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:22.264577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:22.264587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:22.270128] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4404, replace_start_pos=1100000, replace_num=100000) [2024-09-11 15:54:22.270170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:22.364876] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041262364871, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007528, add_bytes: 0 [2024-09-11 15:54:22.371646] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726041262371644, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:54:22.464819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:22.464881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:22.464887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:22.464895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:22.470261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:22.491926] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:22.619123] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:22.619167] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61788 [2024-09-11 15:54:22.665113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:22.665154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:22.665161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:22.665169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:22.670385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:22.817132] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61788, magic:0x78563412 [2024-09-11 15:54:22.817170] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:22.817177] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:22.865465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:22.865509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:22.865517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:22.865527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:22.870498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:23.065752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:23.065806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:23.065812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:23.065820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:23.070623] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:23.134177] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:23.218082] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:23.218118] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61800 [2024-09-11 15:54:23.266083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:23.266123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:23.266130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:23.266138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:23.270758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:23.372557] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=72] PNIO [ratelimit] time: 1726041263372553, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:54:23.379266] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041263379262, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:54:23.416613] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61800, magic:0x78563412 [2024-09-11 15:54:23.416652] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:23.416659] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:23.466387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:23.466428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:23.466453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:23.466462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:23.470875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:23.475134] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8658, clean_start_pos=4800000, clean_num=200000) [2024-09-11 15:54:23.493158] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:23.671028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:23.675362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:23.675394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:23.675401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:23.675409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:23.817546] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:23.817592] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61812 [2024-09-11 15:54:23.871160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:23.875631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:23.875668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:23.875675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:23.875682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:24.016045] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61812, magic:0x78563412 [2024-09-11 15:54:24.016088] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:24.016096] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:24.071274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:24.075872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:24.075964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=90][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:24.075975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:24.075984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:24.134296] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:24.271397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:24.276212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:24.276250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:24.276257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:24.276266] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:24.380169] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041264380165, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:54:24.386939] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041264386936, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 15:54:24.418955] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:24.418999] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61826 [2024-09-11 15:54:24.475890] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4371, replace_start_pos=1200000, replace_num=100000) [2024-09-11 15:54:24.475944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:24.476494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:24.476528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:24.476536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:24.476550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:24.476786] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash time detail, (compute_wash_size_time=91, refresh_score_time=64, wash_time=0) [2024-09-11 15:54:24.494241] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:24.616565] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61826, magic:0x78563412 [2024-09-11 15:54:24.616605] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:24.616612] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:24.676024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:24.677047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:24.677081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:24.677088] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:24.677098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:24.876139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:24.877320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:24.877346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:24.877353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:24.877362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:25.018663] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:25.018711] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:61834 [2024-09-11 15:54:25.076383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:25.077607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:25.077635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:25.077643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:25.077651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:25.134493] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:25.217150] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:61834, magic:0x78563412 [2024-09-11 15:54:25.217193] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:25.217201] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:25.276537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:25.278016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:25.278042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:25.278050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:25.278059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:25.387792] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041265387787, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:54:25.394485] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041265394481, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 15:54:25.476666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:25.478287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:25.478323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:25.478330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:25.478339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:25.486958] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8604, clean_start_pos=5000000, clean_num=200000) [2024-09-11 15:54:25.495297] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:25.624722] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:25.624796] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54920 [2024-09-11 15:54:25.676795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:25.687241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:25.687287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:25.687295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:25.687323] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:25.816492] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54920, magic:0x78563412 [2024-09-11 15:54:25.816521] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:25.816527] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:25.876921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:25.887622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:25.887659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:25.887666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:25.887676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:26.077042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:26.088010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:26.088048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:26.088055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:26.088064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:26.134718] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:26.219204] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:26.219238] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54926 [2024-09-11 15:54:26.277177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:26.288419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:26.288465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:26.288473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:26.288482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:26.395332] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041266395328, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 15:54:26.402113] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041266402110, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 15:54:26.416773] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54926, magic:0x78563412 [2024-09-11 15:54:26.416815] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:26.416823] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:26.477312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:26.488798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:26.488839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:26.488847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:26.488856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:26.496328] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:26.680813] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3371, replace_start_pos=1300000, replace_num=100000) [2024-09-11 15:54:26.680861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:26.689100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:26.689142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:26.689150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:26.689159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:26.818947] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:26.818991] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54928 [2024-09-11 15:54:26.880952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:26.889440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:26.889486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:26.889497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:26.889511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:27.017236] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54928, magic:0x78563412 [2024-09-11 15:54:27.017281] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:27.017289] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:27.081068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:27.089811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:27.089851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:27.089859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:27.089869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:27.134927] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:27.281191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:27.290170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:27.290208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:27.290217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:27.290242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:27.403018] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041267403014, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:54:27.409717] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041267409714, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:54:27.418102] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:27.418132] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54934 [2024-09-11 15:54:27.481327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:27.490541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:27.490585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:27.490593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:27.490603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:27.497215] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:27.498565] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7949, clean_start_pos=5200000, clean_num=200000) [2024-09-11 15:54:27.616839] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54934, magic:0x78563412 [2024-09-11 15:54:27.616877] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:27.616884] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:27.681459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:27.698869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:27.698936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:27.698950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:27.698961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:27.881603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:27.899259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:27.899304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:27.899329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:27.899339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:28.018916] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:28.018961] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54936 [2024-09-11 15:54:28.081718] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:28.099644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:28.099681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:28.099689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:28.099699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:28.135107] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:28.217337] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54936, magic:0x78563412 [2024-09-11 15:54:28.217379] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:28.217387] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:28.281847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:28.300026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:28.300071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:28.300079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:28.300088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:28.410590] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041268410586, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 15:54:28.417337] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041268417334, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:54:28.481985] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:28.498070] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:28.500356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:28.500398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:28.500421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:28.500432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:28.619360] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:28.619404] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54944 [2024-09-11 15:54:28.682114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:28.700742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:28.700783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:28.700791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:28.700801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:28.817603] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54944, magic:0x78563412 [2024-09-11 15:54:28.817645] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:28.817653] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:28.885968] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3721, replace_start_pos=1400000, replace_num=100000) [2024-09-11 15:54:28.886011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:28.901060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:28.901104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:28.901111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:28.901121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:29.086167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:29.101459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:29.101507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:29.101515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:29.101524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:29.135306] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:29.220359] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:29.220405] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54954 [2024-09-11 15:54:29.286352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:29.301831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:29.301875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:29.301883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:29.301893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:29.417956] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54954, magic:0x78563412 [2024-09-11 15:54:29.417999] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:29.418006] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:29.418246] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041269418243, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 15:54:29.424951] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041269424947, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:54:29.486480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:29.499083] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:29.502219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:29.502258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:29.502266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:29.502294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:29.509821] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7514, clean_start_pos=5400000, clean_num=200000) [2024-09-11 15:54:29.686658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:29.710097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:29.710134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:29.710142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:29.710151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:29.819128] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:29.819167] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54970 [2024-09-11 15:54:29.886843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:29.910460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:29.910507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:29.910516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:29.910527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:30.017397] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54970, magic:0x78563412 [2024-09-11 15:54:30.017439] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:30.017446] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:30.086967] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:30.110760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:30.110804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:30.110810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:30.110818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:30.135500] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:30.242782] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:30.242833] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:30.242935] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=29, max_check_version=30, global_version=31) [2024-09-11 15:54:30.244959] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2023 [2024-09-11 15:54:30.244998] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:30.245033] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:54:30.245093] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:54:30.245177] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:30.245284] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:54:30.245359] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:54:30.245374] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:54:30.245385] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:54:30.245426] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:54:30.245487] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:54:30.245508] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:54:30.287108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:30.311118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:30.311158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:30.311169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:30.311195] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:30.419967] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:30.420012] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54984 [2024-09-11 15:54:30.425820] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041270425816, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007573, add_bytes: 0 [2024-09-11 15:54:30.432569] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726041270432566, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:54:30.487232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:30.500310] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:30.511518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:30.511561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:30.511568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:30.511576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:30.617977] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54984, magic:0x78563412 [2024-09-11 15:54:30.618014] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:30.618022] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:30.687351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:30.711879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:30.711941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:30.711950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:30.711960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:30.887483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:30.912260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:30.912304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:30.912313] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:30.912344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:31.020141] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:31.020182] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54988 [2024-09-11 15:54:31.091644] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4034, replace_start_pos=1500000, replace_num=100000) [2024-09-11 15:54:31.091690] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:31.112644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:31.112687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:31.112696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:31.112705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:31.135722] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:31.218541] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54988, magic:0x78563412 [2024-09-11 15:54:31.218583] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:31.218592] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:31.291788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:31.312973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:31.313015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:31.313022] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:31.313031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:31.433494] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041271433490, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 15:54:31.440189] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041271440185, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:54:31.491926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:31.501548] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:31.513310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:31.513375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:31.513385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:31.513399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:31.522429] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9012, clean_start_pos=5600000, clean_num=200000) [2024-09-11 15:54:31.620468] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:31.620501] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54994 [2024-09-11 15:54:31.692056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:31.722776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:31.722833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:31.722841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:31.722852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:31.818746] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54994, magic:0x78563412 [2024-09-11 15:54:31.818790] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:31.818796] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:31.892242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:31.923096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:31.923142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:31.923150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:31.923177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:32.092386] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:32.123414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:32.123463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:32.123471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:32.123480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:32.135899] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:32.221182] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:32.221216] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54996 [2024-09-11 15:54:32.292519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:32.323723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:32.323765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:32.323773] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:32.323782] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:32.419401] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54996, magic:0x78563412 [2024-09-11 15:54:32.419444] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:32.419451] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:32.441118] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726041272441114, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:54:32.447807] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041272447804, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:54:32.492708] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:32.502695] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:32.524079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:32.524122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:32.524133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:32.524166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:32.692888] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:32.724472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:32.724517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:32.724525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:32.724535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:32.820950] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:32.821009] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55004 [2024-09-11 15:54:32.893095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:32.924864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:32.924928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:32.924937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:32.924947] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:33.019806] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55004, magic:0x78563412 [2024-09-11 15:54:33.019849] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:33.019857] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:33.093279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:33.125197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:33.125242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:33.125249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:33.125258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:33.136080] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:33.297808] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4375, replace_start_pos=1600000, replace_num=100000) [2024-09-11 15:54:33.297856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:33.325505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:33.325551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:33.325559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:33.325568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:33.421375] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:33.421419] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55018 [2024-09-11 15:54:33.448719] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041273448714, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 15:54:33.455406] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041273455403, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 15:54:33.497965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:33.504037] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:33.525801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:33.525846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:33.525853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:33.525862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:33.533219] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7341, clean_start_pos=5800000, clean_num=200000) [2024-09-11 15:54:33.619439] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55018, magic:0x78563412 [2024-09-11 15:54:33.619502] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:33.619511] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:33.698150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:33.733581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:33.733625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:33.733633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:33.733643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:33.898325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:33.933860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:33.933891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:33.933896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:33.933930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:34.021232] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:34.021278] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55028 [2024-09-11 15:54:34.098449] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:34.134315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:34.134364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:34.134373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:34.134382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:34.136275] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:34.219513] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55028, magic:0x78563412 [2024-09-11 15:54:34.219557] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:34.219564] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:34.298628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:34.334714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:34.334754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:34.334762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:34.334772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:34.456260] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041274456257, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 15:54:34.463041] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041274463038, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 15:54:34.498759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:34.505136] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:34.535038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:34.535073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:34.535080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:34.535089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:34.620353] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:34.620398] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55042 [2024-09-11 15:54:34.698939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:34.735386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:34.735429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:34.735437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:34.735464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:34.818855] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55042, magic:0x78563412 [2024-09-11 15:54:34.818886] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:34.818894] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:34.899068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:34.935771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:34.935814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:34.935822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:34.935832] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:35.099206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:35.136092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:35.136161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:35.136169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:35.136178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:35.136396] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:35.221350] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:35.221396] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55046 [2024-09-11 15:54:35.299440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:35.336406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:35.336445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:35.336451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:35.336459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:35.419583] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55046, magic:0x78563412 [2024-09-11 15:54:35.419632] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:35.419640] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:35.463962] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041275463957, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 15:54:35.470728] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041275470724, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:54:35.503998] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=1700000, replace_num=100000) [2024-09-11 15:54:35.504042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:35.506580] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:35.536688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:35.536730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:35.536738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:35.536747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:35.545360] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8600, clean_start_pos=6000000, clean_num=200000) [2024-09-11 15:54:35.704189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:35.745645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:35.745690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:35.745697] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:35.745706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:35.820843] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:35.820889] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51154 [2024-09-11 15:54:35.904405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:35.946008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:35.946053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:35.946060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:35.946069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:36.019680] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51154, magic:0x78563412 [2024-09-11 15:54:36.019720] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:36.019728] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:36.104544] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:36.136518] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:36.146285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:36.146325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:36.146331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:36.146338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:36.304675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:36.346574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:36.346618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:36.346647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:36.346656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:36.421374] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:36.421408] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51168 [2024-09-11 15:54:36.471510] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041276471506, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:54:36.478340] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041276478336, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:54:36.504804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:36.507891] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:36.546885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:36.546952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:36.546960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:36.546969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:36.619143] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51168, magic:0x78563412 [2024-09-11 15:54:36.619176] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:36.619184] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:36.704994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:36.747191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:36.747231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:36.747237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:36.747245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:36.905183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:36.947484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:36.947529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:36.947558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:36.947568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:37.021663] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:37.021704] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51180 [2024-09-11 15:54:37.105304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:37.136706] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:37.147777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:37.147818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:37.147824] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:37.147831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:37.219787] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51180, magic:0x78563412 [2024-09-11 15:54:37.219817] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:37.219824] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:37.305485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:37.348042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:37.348085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:37.348092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:37.348101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:37.479175] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041277479171, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 15:54:37.485942] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041277485938, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:54:37.505700] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:37.509079] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:37.548348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:37.548401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:37.548428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:37.548438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:37.555084] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6631, clean_start_pos=6200000, clean_num=200000) [2024-09-11 15:54:37.621552] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:37.621590] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51186 [2024-09-11 15:54:37.709746] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3855, replace_start_pos=1800000, replace_num=100000) [2024-09-11 15:54:37.709789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:37.755344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:37.755390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:37.755396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:37.755404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:37.820179] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51186, magic:0x78563412 [2024-09-11 15:54:37.820223] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:37.820231] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:37.909881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:37.955634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:37.955679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:37.955702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:37.955712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:38.110025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:38.136840] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:38.156052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:38.156099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:38.156106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:38.156115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:38.222433] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:38.222466] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51192 [2024-09-11 15:54:38.310170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:38.356351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:38.356397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:38.356405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:38.356414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:38.420710] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51192, magic:0x78563412 [2024-09-11 15:54:38.420755] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:38.420763] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:38.486796] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041278486792, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:54:38.493555] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041278493552, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:54:38.510359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:38.510414] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:38.556654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:38.556711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:38.556744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:38.556755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:38.710490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:38.757011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:38.757057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:38.757064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:38.757072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:38.823097] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:38.823142] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51200 [2024-09-11 15:54:38.910681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:38.957304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:38.957348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:38.957354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:38.957362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:39.021144] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51200, magic:0x78563412 [2024-09-11 15:54:39.021186] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:39.021195] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:39.110818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:39.136981] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:39.157985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:39.158043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:39.158049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:39.158057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:39.311020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:39.358300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:39.358350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:39.358359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:39.358368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:39.423742] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:39.423789] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51202 [2024-09-11 15:54:39.494438] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726041279494434, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007642, add_bytes: 0 [2024-09-11 15:54:39.501114] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041279501111, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 15:54:39.511146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:39.511472] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:39.558668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:39.558725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:39.558733] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:39.558743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:39.567238] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8481, clean_start_pos=6400000, clean_num=200000) [2024-09-11 15:54:39.621691] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51202, magic:0x78563412 [2024-09-11 15:54:39.621734] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:39.621766] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:39.711321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:39.767493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:39.767540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:39.767549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:39.767559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:39.915384] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3925, replace_start_pos=1900000, replace_num=100000) [2024-09-11 15:54:39.915427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:39.967772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:39.967816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:39.967822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:39.967829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:40.023723] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:40.023767] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51214 [2024-09-11 15:54:40.115580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:40.137167] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:40.168068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:40.168113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:40.168144] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:40.168153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:40.222183] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51214, magic:0x78563412 [2024-09-11 15:54:40.222224] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:40.222232] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:40.260314] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:40.260365] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:40.260443] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=30, max_check_version=31, global_version=32) [2024-09-11 15:54:40.262453] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2008 [2024-09-11 15:54:40.262499] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:40.262531] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:54:40.262586] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:54:40.262662] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:40.262744] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:54:40.262787] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:54:40.262799] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:54:40.262808] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:54:40.262840] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:54:40.262887] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:54:40.262914] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:54:40.315703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:40.368382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:40.368422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:40.368430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:40.368453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:40.501962] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041280501958, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007524, add_bytes: 0 [2024-09-11 15:54:40.508799] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041280508795, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:54:40.512575] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:40.515827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:40.568665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:40.568707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:40.568713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:40.568721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:40.623256] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:40.623297] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51218 [2024-09-11 15:54:40.715969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:40.768991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:40.769037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:40.769044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:40.769053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:40.821659] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51218, magic:0x78563412 [2024-09-11 15:54:40.821690] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:40.821697] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:40.916162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:40.969280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:40.969325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:40.969332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:40.969355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:41.116288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:41.137378] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:41.169577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:41.169622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:41.169628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:41.169635] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:41.223443] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:41.223475] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51232 [2024-09-11 15:54:41.316423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:41.369854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:41.369898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:41.369926] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:41.369935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:41.421983] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51232, magic:0x78563412 [2024-09-11 15:54:41.422015] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:41.422022] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:41.509582] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041281509578, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:54:41.513621] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:41.516405] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041281516402, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 15:54:41.516551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:41.570164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:41.570214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:41.570221] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:41.570250] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:41.577216] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6951, clean_start_pos=6600000, clean_num=200000) [2024-09-11 15:54:41.716701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:41.777478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:41.777519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:41.777527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:41.777536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:41.824447] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:41.824494] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51240 [2024-09-11 15:54:41.916835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:41.977761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:41.977807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:41.977815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:41.977846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:42.022687] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51240, magic:0x78563412 [2024-09-11 15:54:42.022732] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:42.022740] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:42.121334] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4363, replace_start_pos=2000000, replace_num=100000) [2024-09-11 15:54:42.121383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:42.137508] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:42.178110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:42.178181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:42.178189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:42.178197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:42.321481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:42.378425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:42.378468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:42.378476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:42.378485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:42.424657] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:42.424699] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51256 [2024-09-11 15:54:42.514850] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:42.517258] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041282517255, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 15:54:42.521679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:42.524033] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041282524030, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 15:54:42.578712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:42.578752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:42.578759] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:42.578766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:42.621881] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51256, magic:0x78563412 [2024-09-11 15:54:42.621953] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=66] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:42.621962] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:42.721811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:42.779064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:42.779108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:42.779114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:42.779122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:42.922010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:42.979340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:42.979375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:42.979381] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:42.979388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:43.024257] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:43.024300] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51260 [2024-09-11 15:54:43.122145] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:43.137695] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:43.179637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:43.179681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:43.179687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:43.179714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:43.222501] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51260, magic:0x78563412 [2024-09-11 15:54:43.222532] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:43.222539] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:43.322371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:43.379975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:43.380021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:43.380029] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:43.380038] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:43.515767] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:43.522567] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:43.524874] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041283524872, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:54:43.531636] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041283531632, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:54:43.580252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:43.580290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:43.580296] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:43.580303] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:43.586961] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6644, clean_start_pos=6800000, clean_num=200000) [2024-09-11 15:54:43.624407] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:43.624453] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51264 [2024-09-11 15:54:43.722754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:43.787229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:43.787279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:43.787306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:43.787315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:43.822757] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51264, magic:0x78563412 [2024-09-11 15:54:43.822803] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:43.822810] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:43.922929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:43.987548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:43.987597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:43.987604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:43.987614] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:44.123056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:44.137860] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:44.187847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:44.187894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:44.187925] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:44.187935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:44.225376] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:44.225424] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51280 [2024-09-11 15:54:44.326508] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3340, replace_start_pos=2100000, replace_num=100000) [2024-09-11 15:54:44.326546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:44.388145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:44.388205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:44.388215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:44.388227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:44.423499] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51280, magic:0x78563412 [2024-09-11 15:54:44.423543] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:44.423551] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:44.526698] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:44.532489] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041284532485, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:54:44.539254] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041284539249, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:54:44.588457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:44.588502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:44.588509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:44.588518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:44.616923] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:44.726883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:44.788735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:44.788767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:44.788773] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:44.788780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:44.788974] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=61, refresh_score_time=57, wash_time=0) [2024-09-11 15:54:44.825241] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:44.825279] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51282 [2024-09-11 15:54:44.927112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:44.989206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:44.989255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:44.989263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:44.989271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:45.023978] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51282, magic:0x78563412 [2024-09-11 15:54:45.024022] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:45.024030] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:45.127366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:45.138022] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:45.189489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:45.189533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:45.189539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:45.189546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:45.327545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:45.389791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:45.389859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:45.389867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:45.389876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:45.425660] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:45.425710] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:51292 [2024-09-11 15:54:45.527671] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:45.540107] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041285540102, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:54:45.546865] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041285546861, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:54:45.590116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:45.590163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:45.590171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:45.590180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:45.598770] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8576, clean_start_pos=7000000, clean_num=200000) [2024-09-11 15:54:45.617698] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:45.623584] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:51292, magic:0x78563412 [2024-09-11 15:54:45.623619] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:45.623626] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:45.727801] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:45.799062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:45.799108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:45.799116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:45.799125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:45.927917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:45.999348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:45.999383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:45.999390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:45.999398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:46.025367] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:46.025411] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47694 [2024-09-11 15:54:46.128075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:46.138166] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:46.199633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:46.199681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:46.199688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:46.199697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:46.223890] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47694, magic:0x78563412 [2024-09-11 15:54:46.223926] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:46.223933] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:46.328259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:46.399935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:46.399975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:46.399982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:46.400002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:46.532146] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3754, replace_start_pos=2200000, replace_num=100000) [2024-09-11 15:54:46.532189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:46.547744] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041286547741, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 15:54:46.554482] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041286554478, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:54:46.600284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:46.600335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:46.600348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:46.600365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:46.618736] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:46.625628] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:46.625655] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47708 [2024-09-11 15:54:46.732274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:46.800604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:46.800643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:46.800652] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:46.800661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:46.824308] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47708, magic:0x78563412 [2024-09-11 15:54:46.824350] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:46.824358] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:46.932457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:47.000874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:47.000937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:47.000964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:47.000983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:47.132592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:47.138354] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:47.201220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:47.201273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:47.201281] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:47.201289] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:47.226188] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:47.226217] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47714 [2024-09-11 15:54:47.332814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:47.401499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:47.401545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:47.401552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:47.401559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:47.424776] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47714, magic:0x78563412 [2024-09-11 15:54:47.424819] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:47.424827] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:47.532960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:47.555288] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041287555282, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 15:54:47.562113] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041287562109, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:54:47.601761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:47.601806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:47.601812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:47.601819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:47.608601] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6768, clean_start_pos=7200000, clean_num=200000) [2024-09-11 15:54:47.619853] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:47.733096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:47.808870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:47.808940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:47.808947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:47.808956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:47.825382] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:47.825424] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47722 [2024-09-11 15:54:47.933223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:48.009163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:48.009204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:48.009214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:48.009222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:48.024140] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47722, magic:0x78563412 [2024-09-11 15:54:48.024203] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:48.024213] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:48.133407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:48.138521] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:48.209443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:48.209494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:48.209501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:48.209509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:48.333545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:48.409762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:48.409806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:48.409815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:48.409825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:48.426375] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:48.426419] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47728 [2024-09-11 15:54:48.533682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:48.562961] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041288562957, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:54:48.569716] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041288569713, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:54:48.610067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:48.610131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:48.610139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:48.610149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:48.620934] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:48.624749] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47728, magic:0x78563412 [2024-09-11 15:54:48.624812] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:48.624820] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:48.738264] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4393, replace_start_pos=2300000, replace_num=100000) [2024-09-11 15:54:48.738307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:48.810396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:48.810434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:48.810440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:48.810455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:48.938396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:49.010768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:49.010812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:49.010820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:49.010829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:49.025805] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:49.025849] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47736 [2024-09-11 15:54:49.138581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:49.138649] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:49.211129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:49.211195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:49.211205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:49.211215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:49.224027] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47736, magic:0x78563412 [2024-09-11 15:54:49.224070] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:49.224078] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:49.338778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:49.411524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:49.411570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:49.411578] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:49.411588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:49.538925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:49.570508] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041289570503, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 15:54:49.577350] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041289577346, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 15:54:49.611882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:49.611945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:49.611954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:49.611963] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:49.619516] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7520, clean_start_pos=7400000, clean_num=200000) [2024-09-11 15:54:49.621893] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:49.626234] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:49.626261] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47740 [2024-09-11 15:54:49.739118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:49.819834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:49.819876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:49.819884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:49.819894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:49.824792] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47740, magic:0x78563412 [2024-09-11 15:54:49.824830] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:49.824838] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:49.939273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:50.020217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:50.020262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:50.020270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:50.020280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:50.138825] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:50.139474] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:50.220602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:50.220646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:50.220656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:50.220665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:50.226864] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:50.226919] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47748 [2024-09-11 15:54:50.277646] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:50.277700] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:54:50.277784] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=31, max_check_version=32, global_version=33) [2024-09-11 15:54:50.279779] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1995 [2024-09-11 15:54:50.279809] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:50.279845] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:54:50.279883] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:54:50.280004] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:54:50.280113] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:54:50.280165] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:54:50.280177] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:54:50.280191] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:54:50.280228] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:54:50.280289] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:54:50.280314] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:54:50.339598] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:50.421007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:50.421051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:50.421058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:50.421067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:50.425451] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47748, magic:0x78563412 [2024-09-11 15:54:50.425483] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:50.425505] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:50.539791] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:50.578182] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041290578178, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:54:50.584886] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041290584882, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007536, add_bytes: 0 [2024-09-11 15:54:50.621313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:50.621353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:50.621361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:50.621370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:50.622795] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:50.739974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:50.821621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:50.821661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:50.821669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:50.821678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:50.827606] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:50.827639] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47752 [2024-09-11 15:54:50.944560] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4396, replace_start_pos=2400000, replace_num=100000) [2024-09-11 15:54:50.944611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:51.022040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:51.022086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:51.022094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:51.022103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:51.025932] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47752, magic:0x78563412 [2024-09-11 15:54:51.025987] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:51.025995] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:51.139067] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=99] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:51.144710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:51.222410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:51.222454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:51.222461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:51.222471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:51.344844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:51.422780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:51.422824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:51.422832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:51.422842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:51.427590] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:51.427624] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47760 [2024-09-11 15:54:51.544985] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:51.585803] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041291585797, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:54:51.592629] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041291592625, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007743, add_bytes: 0 [2024-09-11 15:54:51.623138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:51.623194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:51.623203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:51.623213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:51.623825] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:51.626187] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47760, magic:0x78563412 [2024-09-11 15:54:51.626229] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:51.626238] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:51.631639] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8412, clean_start_pos=7600000, clean_num=200000) [2024-09-11 15:54:51.745109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:51.831976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:51.832023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:51.832031] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:51.832040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:51.832232] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:54:51.945248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:52.027444] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:52.027488] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47762 [2024-09-11 15:54:52.032470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:52.032510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:52.032516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:52.032525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:52.139248] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:52.145436] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:52.225800] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47762, magic:0x78563412 [2024-09-11 15:54:52.225838] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:52.225847] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:52.232831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:52.232873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:52.232881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:52.232890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:52.345648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:52.433133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:52.433177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:52.433184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:52.433192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:52.545841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:52.593417] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041292593413, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:54:52.600178] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041292600175, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 15:54:52.624781] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=42] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:52.627641] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:52.627678] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47778 [2024-09-11 15:54:52.633420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:52.633452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:52.633458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:52.633465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:52.745984] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:52.826085] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47778, magic:0x78563412 [2024-09-11 15:54:52.826126] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:52.826132] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:52.833672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:52.833711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:52.833717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:52.833724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:52.946151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:53.033957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:53.034000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:53.034006] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:53.034014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:53.139458] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:53.149712] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3331, replace_start_pos=2500000, replace_num=100000) [2024-09-11 15:54:53.149756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:53.228159] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:53.228198] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47784 [2024-09-11 15:54:53.234251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:53.234298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:53.234306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:53.234313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:53.349950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:53.426581] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47784, magic:0x78563412 [2024-09-11 15:54:53.426622] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:53.426630] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:53.434525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:53.434559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:53.434565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:53.434572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:53.550141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:53.601030] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041293601025, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:54:53.607792] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041293607788, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:54:53.625676] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:53.634791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:53.634832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:53.634840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:53.634849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:53.643223] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8359, clean_start_pos=7800000, clean_num=200000) [2024-09-11 15:54:53.750366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:53.828993] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:53.829037] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47796 [2024-09-11 15:54:53.843458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:53.843497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:53.843504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:53.843511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:53.950513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:54.027201] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47796, magic:0x78563412 [2024-09-11 15:54:54.027243] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:54.027251] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:54.043748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:54.043797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:54.043804] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:54.043813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:54.139638] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:54.150647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:54.244067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:54.244108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:54.244116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:54.244125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:54.350829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:54.429021] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:54.429076] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47808 [2024-09-11 15:54:54.444364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:54.444409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:54.444417] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:54.444426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:54.550970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:54.608584] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041294608579, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 15:54:54.615413] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041294615410, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:54:54.626561] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:54.627699] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47808, magic:0x78563412 [2024-09-11 15:54:54.627733] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:54.627741] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:54.644653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:54.644697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:54.644704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:54.644714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:54.751218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:54.844966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:54.845005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:54.845012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:54.845021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:54.951420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:55.030057] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:55.030102] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47820 [2024-09-11 15:54:55.045318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:55.045363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:55.045372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:55.045381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:55.139771] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:55.151614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:55.228175] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47820, magic:0x78563412 [2024-09-11 15:54:55.228220] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:55.228227] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:55.245677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:55.245719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:55.245727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:55.245737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:55.356196] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4391, replace_start_pos=2600000, replace_num=100000) [2024-09-11 15:54:55.356244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:55.446052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:55.446098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:55.446106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:55.446115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:55.556416] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:55.616275] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041295616271, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 15:54:55.623053] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041295623051, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2024-09-11 15:54:55.627454] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:55.629915] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:55.629943] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43728 [2024-09-11 15:54:55.646412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:55.646456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:55.646464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:55.646474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:55.654956] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8468, clean_start_pos=8000000, clean_num=200000) [2024-09-11 15:54:55.756543] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:55.828503] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43728, magic:0x78563412 [2024-09-11 15:54:55.828545] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:55.828553] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:55.855210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:55.855252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:55.855260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:55.855269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:55.956730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:56.055596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:56.055639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:56.055647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:56.055657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:56.139928] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:56.156870] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:56.230599] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:56.230639] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43736 [2024-09-11 15:54:56.255886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:56.255959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:56.255967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:56.255976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:56.357026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:56.428228] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43736, magic:0x78563412 [2024-09-11 15:54:56.428267] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:56.428275] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:56.456212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:56.456260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:56.456287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:56.456297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:56.557149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:56.623818] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041296623813, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 15:54:56.628465] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:56.630596] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041296630594, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 15:54:56.656591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:56.656637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:56.656645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:56.656655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:56.757271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:56.828899] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:56.828959] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43742 [2024-09-11 15:54:56.856883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:56.856953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:56.856961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:56.856971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:56.957462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:57.027234] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43742, magic:0x78563412 [2024-09-11 15:54:57.027277] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:57.027285] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:57.057212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:57.057253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:57.057277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:57.057286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:57.140117] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:57.157654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:57.257593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:57.257639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:57.257647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:57.257657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:57.357847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:57.429031] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:57.429076] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43758 [2024-09-11 15:54:57.457992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:57.458051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:57.458066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:57.458076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:57.562048] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4001, replace_start_pos=2700000, replace_num=100000) [2024-09-11 15:54:57.562094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:57.627414] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43758, magic:0x78563412 [2024-09-11 15:54:57.627457] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:57.627465] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:57.629600] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:57.631439] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041297631436, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:54:57.638209] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041297638206, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:54:57.658378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:57.658423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:57.658431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:57.658440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:57.666172] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7719, clean_start_pos=8200000, clean_num=200000) [2024-09-11 15:54:57.762215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:54:57.866506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:57.866551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:57.866559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:57.866568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:57.962426] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:54:58.029953] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:58.029999] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43768 [2024-09-11 15:54:58.066868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:58.066940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:58.066954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:58.066967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:58.140292] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:58.162622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:54:58.227990] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43768, magic:0x78563412 [2024-09-11 15:54:58.228028] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:58.228037] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:58.267286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:58.267332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:58.267339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:58.267349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:58.362814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:54:58.467657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:58.467704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:58.467713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:58.467722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:58.563000] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:54:58.629717] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:58.629766] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43774 [2024-09-11 15:54:58.630613] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:58.639052] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041298639048, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:54:58.645880] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041298645876, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 15:54:58.668043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:58.668091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:58.668099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:58.668109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:58.763135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:54:58.828342] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43774, magic:0x78563412 [2024-09-11 15:54:58.828385] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:58.828393] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:58.868438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:58.868484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:58.868492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:58.868501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:58.963335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:54:59.068801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:59.068843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:59.068851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:59.068861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:59.140493] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:54:59.163533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:54:59.230186] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:59.230230] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43784 [2024-09-11 15:54:59.269166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:59.269225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:59.269233] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:59.269243] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:59.363725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:54:59.428846] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43784, magic:0x78563412 [2024-09-11 15:54:59.428887] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:54:59.428894] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:54:59.469552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:59.469600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:59.469608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:59.469618] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:59.563921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:54:59.631486] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:54:59.646663] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041299646659, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:54:59.653423] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041299653421, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 15:54:59.669944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:59.669988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:59.669996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:59.670005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:59.677886] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7868, clean_start_pos=8400000, clean_num=200000) [2024-09-11 15:54:59.768325] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4195, replace_start_pos=2800000, replace_num=100000) [2024-09-11 15:54:59.768371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:54:59.830720] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:54:59.830778] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43796 [2024-09-11 15:54:59.878265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:54:59.878303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:54:59.878312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:54:59.878322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:54:59.968510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:00.029223] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43796, magic:0x78563412 [2024-09-11 15:55:00.029267] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:00.029275] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:00.078620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:00.078666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:00.078673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:00.078681] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:00.140612] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:00.168734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:00.279002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:00.279047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:00.279054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:00.279084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:00.295916] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:00.295963] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:00.296040] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=32, max_check_version=33, global_version=34) [2024-09-11 15:55:00.298111] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2070 [2024-09-11 15:55:00.298147] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:00.298179] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:55:00.298212] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:55:00.298302] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:00.298385] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:55:00.298436] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:55:00.298445] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:55:00.298456] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:55:00.298488] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:55:00.298540] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:55:00.298557] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:55:00.368925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:00.431707] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:00.431758] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43810 [2024-09-11 15:55:00.479384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:00.479436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:00.479445] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:00.479456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:00.569129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:00.629855] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43810, magic:0x78563412 [2024-09-11 15:55:00.629896] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:00.629932] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:00.632551] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:00.640220] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 15:55:00.654282] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041300654279, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:55:00.654326] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 15:55:00.658720] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 15:55:00.661041] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726041300661039, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:55:00.661076] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:55:00.679749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:00.679790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:00.679798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:00.679807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:00.769339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:00.880112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:00.880158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:00.880166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:00.880176] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:00.969536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:01.031639] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:01.031685] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43824 [2024-09-11 15:55:01.080414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:01.080463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:01.080490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:01.080500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:01.140818] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:01.169730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:01.230608] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43824, magic:0x78563412 [2024-09-11 15:55:01.230646] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:01.230653] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:01.280820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:01.280867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:01.280875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:01.280885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:01.369947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:01.481118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:01.481161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:01.481169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:01.481177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:01.570100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:01.632273] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:01.632315] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43840 [2024-09-11 15:55:01.633580] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:01.661896] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726041301661893, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:55:01.668737] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041301668734, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 15:55:01.681472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:01.681532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:01.681541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:01.681551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:01.689726] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8162, clean_start_pos=8600000, clean_num=200000) [2024-09-11 15:55:01.770255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:01.831053] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43840, magic:0x78563412 [2024-09-11 15:55:01.831097] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:01.831105] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:01.890071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:01.890115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:01.890123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:01.890133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:01.974834] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4387, replace_start_pos=2900000, replace_num=100000) [2024-09-11 15:55:01.974883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:02.090361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:02.090407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:02.090413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:02.090421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:02.141002] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:02.174989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:02.233409] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:02.233450] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43852 [2024-09-11 15:55:02.290677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:02.290721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:02.290729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:02.290737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:02.375220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:02.431668] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43852, magic:0x78563412 [2024-09-11 15:55:02.431714] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:02.431722] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:02.491051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:02.491107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:02.491122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:02.491133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:02.575341] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:02.634487] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:02.669629] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726041302669624, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007731, add_bytes: 0 [2024-09-11 15:55:02.676281] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041302676277, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 15:55:02.691482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:02.691529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:02.691537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:02.691566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:02.775472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:02.833706] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:02.833754] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43854 [2024-09-11 15:55:02.891871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:02.891937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:02.891946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:02.891956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:02.975602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:03.032132] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43854, magic:0x78563412 [2024-09-11 15:55:03.032177] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:03.032186] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:03.092277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:03.092322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:03.092330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:03.092341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:03.141140] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:03.175729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:03.292641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:03.292686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:03.292695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:03.292704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:03.375869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:03.434423] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:03.434460] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43870 [2024-09-11 15:55:03.493053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:03.493101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:03.493109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:03.493118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:03.576011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:03.632706] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43870, magic:0x78563412 [2024-09-11 15:55:03.632749] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:03.632758] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:03.635510] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:03.677203] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041303677199, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 15:55:03.683917] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041303683896, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:55:03.693425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:03.693462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:03.693471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:03.693480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:03.701540] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8045, clean_start_pos=8800000, clean_num=200000) [2024-09-11 15:55:03.776137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:03.901936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:03.901983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:03.901991] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:03.902001] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:03.976326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:04.034962] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:04.035008] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43872 [2024-09-11 15:55:04.102236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:04.102283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:04.102291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:04.102300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:04.141256] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:04.180677] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4166, replace_start_pos=3000000, replace_num=100000) [2024-09-11 15:55:04.180728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:04.233058] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43872, magic:0x78563412 [2024-09-11 15:55:04.233101] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:04.233108] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:04.302598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:04.302637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:04.302646] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:04.302655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:04.380884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:04.502983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:04.503029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:04.503036] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:04.503046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:04.581040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:04.635145] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:04.635192] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43874 [2024-09-11 15:55:04.636719] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:04.684841] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041304684836, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 15:55:04.691517] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726041304691513, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:55:04.703268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:04.703294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:04.703301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:04.703309] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:04.781229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:04.833327] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43874, magic:0x78563412 [2024-09-11 15:55:04.833367] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:04.833376] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:04.903656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:04.903699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:04.903707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:04.903717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:04.981413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:05.103964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:05.103998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:05.104005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:05.104014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:05.104216] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=67, refresh_score_time=61, wash_time=0) [2024-09-11 15:55:05.141381] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:05.181551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:05.235483] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:05.235527] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43882 [2024-09-11 15:55:05.304517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:05.304562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:05.304569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:05.304578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:05.381727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:05.432888] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43882, magic:0x78563412 [2024-09-11 15:55:05.432954] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:05.432963] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:05.504810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:05.504842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:05.504850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:05.504858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:05.581951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:05.637877] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:05.692373] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041305692370, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 15:55:05.699121] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041305699119, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:55:05.705154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:05.705192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:05.705201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:05.705210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:05.713731] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8507, clean_start_pos=9000000, clean_num=200000) [2024-09-11 15:55:05.782144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:05.835150] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:05.835192] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52982 [2024-09-11 15:55:05.914079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:05.914123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:05.914131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:05.914141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:05.982330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:06.033118] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52982, magic:0x78563412 [2024-09-11 15:55:06.033160] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:06.033169] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:06.114476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:06.114522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:06.114530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:06.114540] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:06.141578] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:06.182518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:06.314759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:06.314802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:06.314808] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:06.314815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:06.386945] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4302, replace_start_pos=3100000, replace_num=100000) [2024-09-11 15:55:06.386993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:06.435434] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:06.435477] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52984 [2024-09-11 15:55:06.515061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:06.515105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:06.515112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:06.515121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:06.587077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:06.633702] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52984, magic:0x78563412 [2024-09-11 15:55:06.633741] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:06.633749] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:06.639057] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:06.700047] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041306700044, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 15:55:06.706753] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041306706750, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:55:06.715437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:06.715481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:06.715489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:06.715499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:06.787194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:06.915729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:06.915769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:06.915776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:06.915785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:06.987309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:07.035861] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:07.035898] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52996 [2024-09-11 15:55:07.116104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:07.116147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:07.116155] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:07.116165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:07.141709] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:07.187427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:07.234098] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52996, magic:0x78563412 [2024-09-11 15:55:07.234138] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:07.234146] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:07.316464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:07.316511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:07.316518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:07.316528] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:07.387539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:07.516778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:07.516821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:07.516830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:07.516839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:07.587647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:07.635896] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:07.635956] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53008 [2024-09-11 15:55:07.639784] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:07.707591] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041307707587, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 15:55:07.714358] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041307714355, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:55:07.717161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:07.717198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:07.717206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:07.717215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:07.725769] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8540, clean_start_pos=9200000, clean_num=200000) [2024-09-11 15:55:07.787760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:07.834531] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53008, magic:0x78563412 [2024-09-11 15:55:07.834569] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:07.834576] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:07.926149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:07.926194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:07.926203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:07.926212] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:07.987873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:08.126547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:08.126589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:08.126596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:08.126623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:08.141944] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:08.187994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:08.236730] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:08.236770] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53010 [2024-09-11 15:55:08.326852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:08.326893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:08.326927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:08.326943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:08.388176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:08.435113] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53010, magic:0x78563412 [2024-09-11 15:55:08.435147] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:08.435154] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:08.527249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:08.527295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:08.527303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:08.527314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:08.592678] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4379, replace_start_pos=3200000, replace_num=100000) [2024-09-11 15:55:08.592745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:08.640615] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:08.715278] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041308715273, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:55:08.721978] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041308721975, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:55:08.727617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:08.727667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:08.727676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:08.727685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:08.792939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:08.836649] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:08.836695] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53020 [2024-09-11 15:55:08.928010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:08.928054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:08.928061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:08.928072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:08.993130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:09.035530] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53020, magic:0x78563412 [2024-09-11 15:55:09.035574] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:09.035582] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:09.128392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:09.128439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:09.128447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:09.128457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:09.142141] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:09.193323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:09.328710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:09.328751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:09.328758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:09.328767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:09.393513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:09.437688] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:09.437732] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53032 [2024-09-11 15:55:09.529020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:09.529057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:09.529065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:09.529075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:09.593640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:09.636017] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53032, magic:0x78563412 [2024-09-11 15:55:09.636053] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:09.636062] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:09.641622] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=46] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:09.722843] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041309722840, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 15:55:09.729370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:09.729405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:09.729413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:09.729422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:09.729652] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041309729649, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 15:55:09.738026] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8571, clean_start_pos=9400000, clean_num=200000) [2024-09-11 15:55:09.793771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:09.938353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:09.938396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:09.938404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:09.938414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:09.993975] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:10.037897] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:10.037960] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53046 [2024-09-11 15:55:10.138736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:10.138780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:10.138788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:10.138797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:10.142323] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:10.194168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:10.236458] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53046, magic:0x78563412 [2024-09-11 15:55:10.236502] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:10.236510] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:10.313785] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:10.313840] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:10.313926] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=33, max_check_version=34, global_version=35) [2024-09-11 15:55:10.315668] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1741 [2024-09-11 15:55:10.315712] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:10.315745] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:55:10.315780] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:55:10.315876] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:10.315975] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:55:10.316028] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:55:10.316038] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:55:10.316049] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:55:10.316089] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:55:10.316138] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:55:10.316157] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:55:10.339131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:10.339173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:10.339181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:10.339190] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:10.394355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:10.539502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:10.539543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:10.539551] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:10.539561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:10.594558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:10.638040] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:10.638079] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53060 [2024-09-11 15:55:10.642517] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:10.730452] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041310730447, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 15:55:10.737208] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041310737203, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 15:55:10.739829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:10.739862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:10.739869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:10.739878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:10.799029] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4343, replace_start_pos=3300000, replace_num=100000) [2024-09-11 15:55:10.799079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:10.836871] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53060, magic:0x78563412 [2024-09-11 15:55:10.836939] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:10.836949] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:10.940183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:10.940228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:10.940237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:10.940247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:10.999232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:11.140555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:11.140597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:11.140605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:11.140632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:11.142528] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:11.199421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:11.239521] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:11.239566] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53074 [2024-09-11 15:55:11.340972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:11.341015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:11.341023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:11.341032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:11.399619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:11.437463] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53074, magic:0x78563412 [2024-09-11 15:55:11.437505] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:11.437513] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:11.541295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:11.541343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:11.541350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:11.541359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:11.599801] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:11.643554] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:11.738141] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1726041311738136, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 15:55:11.741590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:11.741623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:11.741630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:11.741654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:11.744886] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041311744884, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:55:11.750229] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8561, clean_start_pos=9600000, clean_num=200000) [2024-09-11 15:55:11.800008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:11.839101] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:11.839147] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53078 [2024-09-11 15:55:11.950556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:11.950603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:11.950611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:11.950620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:12.000204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:12.036686] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53078, magic:0x78563412 [2024-09-11 15:55:12.036727] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:12.036736] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:12.142694] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=25] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:12.150946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:12.150991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:12.150998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:12.151008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:12.200392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:12.351324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:12.351370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:12.351378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:12.351388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:12.400523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:12.438968] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:12.439007] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53092 [2024-09-11 15:55:12.551629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:12.551673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:12.551681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:12.551690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:12.600643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:12.637322] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53092, magic:0x78563412 [2024-09-11 15:55:12.637365] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:12.637373] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:12.644722] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:12.745676] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041312745671, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007535, add_bytes: 0 [2024-09-11 15:55:12.752013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:12.752050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:12.752058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:12.752067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:12.752435] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726041312752432, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:55:12.800843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:12.952388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:12.952434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:12.952441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:12.952451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:13.005459] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4360, replace_start_pos=3400000, replace_num=100000) [2024-09-11 15:55:13.005505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:13.037520] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:13.037564] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53108 [2024-09-11 15:55:13.142964] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:13.152695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:13.152735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:13.152742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:13.152750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:13.205654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:13.235796] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53108, magic:0x78563412 [2024-09-11 15:55:13.235835] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:13.235863] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:13.352999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:13.353040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:13.353047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:13.353056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:13.405771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:13.553288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:13.553331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:13.553339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:13.553348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:13.605859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:13.637593] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:13.637637] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53112 [2024-09-11 15:55:13.645872] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:13.753356] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041313753351, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 15:55:13.753652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:13.753683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:13.753690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:13.753700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:13.760055] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041313760051, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:55:13.760587] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6874, clean_start_pos=9800000, clean_num=200000) [2024-09-11 15:55:13.806024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:13.836089] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53112, magic:0x78563412 [2024-09-11 15:55:13.836146] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:13.836154] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:13.960831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:13.960877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:13.960885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:13.960894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:14.006156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:14.143072] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:14.161132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:14.161159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:14.161165] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:14.161173] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:14.206286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:14.238487] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:14.238530] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53114 [2024-09-11 15:55:14.361407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:14.361452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:14.361460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:14.361469] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:14.406423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:14.436769] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53114, magic:0x78563412 [2024-09-11 15:55:14.436812] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:14.436819] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:14.561712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:14.561754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:14.561762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:14.561770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:14.606561] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:14.646943] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:14.760967] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041314760962, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:55:14.762090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:14.762124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:14.762133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:14.762141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:14.767751] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041314767748, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 15:55:14.806676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:14.839228] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:14.839271] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53128 [2024-09-11 15:55:14.962370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:14.962414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:14.962422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:14.962431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:15.006807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:15.037220] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53128, magic:0x78563412 [2024-09-11 15:55:15.037263] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:15.037271] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:15.143198] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:15.162775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:15.162818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:15.162827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:15.162836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:15.211314] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4385, replace_start_pos=3500000, replace_num=100000) [2024-09-11 15:55:15.211361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:15.363084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:15.363127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:15.363135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:15.363144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:15.411448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:15.439715] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:15.439746] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:53130 [2024-09-11 15:55:15.563380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:15.563426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:15.563434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:15.563443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:15.611576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:15.637609] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:53130, magic:0x78563412 [2024-09-11 15:55:15.637653] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:15.637661] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:15.647975] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:15.763685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:15.763731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:15.763738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:15.763747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:15.768589] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041315768586, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:55:15.771157] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7396, clean_start_pos=10000000, clean_num=200000) [2024-09-11 15:55:15.775374] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041315775370, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:55:15.811703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:15.971394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:15.971439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:15.971446] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:15.971455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:16.011838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:16.039259] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:16.039306] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:39974 [2024-09-11 15:55:16.143339] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:16.171685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:16.171721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:16.171728] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:16.171737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:16.211977] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:16.237930] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:39974, magic:0x78563412 [2024-09-11 15:55:16.237970] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:16.237978] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:16.371980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:16.372022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:16.372029] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:16.372039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:16.412100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:16.572339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:16.572377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:16.572384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:16.572404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:16.612212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:16.639810] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:16.639851] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:39986 [2024-09-11 15:55:16.649044] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:16.772647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:16.772691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:16.772699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:16.772708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:16.776146] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041316776142, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 15:55:16.782966] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041316782963, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 15:55:16.812336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:16.838364] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:39986, magic:0x78563412 [2024-09-11 15:55:16.838406] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:16.838414] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:16.972973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:16.973017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:16.973025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:16.973034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:17.012514] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:17.143460] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:17.173282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:17.173327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:17.173351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:17.173361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:17.212705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:17.239764] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:17.239825] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:39998 [2024-09-11 15:55:17.373589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:17.373629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:17.373636] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:17.373645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:17.417351] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4507, replace_start_pos=3600000, replace_num=100000) [2024-09-11 15:55:17.417383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:17.437987] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:39998, magic:0x78563412 [2024-09-11 15:55:17.438037] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:17.438048] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:17.573820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:17.573866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:17.573872] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:17.573879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:17.617535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:17.650167] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:17.774232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:17.774277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:17.774284] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:17.774306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:17.781073] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6756, clean_start_pos=10200000, clean_num=200000) [2024-09-11 15:55:17.783749] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041317783746, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:55:17.790511] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041317790510, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 15:55:17.817713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:17.839751] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:17.839795] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40002 [2024-09-11 15:55:17.981317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:17.981359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:17.981365] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:17.981372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:18.017885] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:18.038370] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40002, magic:0x78563412 [2024-09-11 15:55:18.038412] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:18.038419] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:18.143566] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:18.181633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:18.181669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:18.181676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:18.181704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:18.218093] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:18.381958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:18.382001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:18.382008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:18.382018] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:18.418279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:18.440180] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:18.440221] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40006 [2024-09-11 15:55:18.582307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:18.582353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:18.582360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:18.582369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:18.618402] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:18.638596] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40006, magic:0x78563412 [2024-09-11 15:55:18.638638] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:18.638645] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:18.651583] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:18.782592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:18.782636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:18.782642] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:18.782649] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:18.791367] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041318791363, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:55:18.798229] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726041318798226, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007716, add_bytes: 0 [2024-09-11 15:55:18.818530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:18.982898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:18.982959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:18.982966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:18.982975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:19.018709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:19.041189] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:19.041230] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40008 [2024-09-11 15:55:19.143688] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:19.183305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:19.183350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:19.183359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:19.183369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:19.218944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:19.239455] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40008, magic:0x78563412 [2024-09-11 15:55:19.239493] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:19.239501] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:19.383574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:19.383616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:19.383622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:19.383630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:19.419080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:19.583868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:19.583927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:19.583936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:19.583945] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:19.623570] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4360, replace_start_pos=3700000, replace_num=100000) [2024-09-11 15:55:19.623614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:19.641119] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:19.641165] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40022 [2024-09-11 15:55:19.652958] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:19.784179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:19.784216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:19.784223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:19.784233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:19.792244] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7997, clean_start_pos=10400000, clean_num=200000) [2024-09-11 15:55:19.799075] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041319799071, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007708, add_bytes: 0 [2024-09-11 15:55:19.805747] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041319805744, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007518, add_bytes: 0 [2024-09-11 15:55:19.823703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:19.839615] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40022, magic:0x78563412 [2024-09-11 15:55:19.839645] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:19.839653] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:19.992573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:19.992614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:19.992622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:19.992632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:20.023918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:20.143799] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:20.192886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:20.192952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:20.192960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:20.192969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:20.224061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:20.241611] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:20.241658] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40028 [2024-09-11 15:55:20.329257] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:20.329316] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=59] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:20.329410] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] update_check_range(min_check_version=34, max_check_version=35, global_version=36) [2024-09-11 15:55:20.331497] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2085 [2024-09-11 15:55:20.331544] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:20.331581] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:55:20.331620] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:55:20.331705] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:20.331829] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 15:55:20.331879] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:55:20.331891] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:55:20.331922] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:55:20.331966] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:55:20.332032] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:55:20.332054] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:55:20.393299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:20.393343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:20.393351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:20.393361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:20.424189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:20.440154] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40028, magic:0x78563412 [2024-09-11 15:55:20.440191] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:20.440200] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:20.593610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:20.593663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:20.593671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:20.593680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:20.624316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:20.654016] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:20.794011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:20.794056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:20.794063] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:20.794088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:20.806621] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041320806616, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 15:55:20.813437] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041320813432, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 15:55:20.824436] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:20.842937] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:20.842981] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40030 [2024-09-11 15:55:20.994326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:20.994368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:20.994376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:20.994385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:21.024552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:21.040934] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40030, magic:0x78563412 [2024-09-11 15:55:21.040971] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:21.040978] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:21.143955] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:21.194616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:21.194663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:21.194669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:21.194677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:21.224735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:21.395038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:21.395089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:21.395097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:21.395106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:21.424922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:21.442571] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:21.442610] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40036 [2024-09-11 15:55:21.595347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:21.595390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:21.595397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:21.595406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:21.625068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:21.641305] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40036, magic:0x78563412 [2024-09-11 15:55:21.641347] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:21.641355] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:21.655086] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:21.795708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:21.795754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:21.795762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:21.795771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:21.802643] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6858, clean_start_pos=10600000, clean_num=200000) [2024-09-11 15:55:21.814295] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041321814291, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:55:21.821162] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041321821158, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007726, add_bytes: 0 [2024-09-11 15:55:21.828658] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3403, replace_start_pos=3800000, replace_num=100000) [2024-09-11 15:55:21.828702] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:22.002949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:22.002993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:22.003001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:22.003010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:22.003197] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:55:22.028786] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:22.043076] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:22.043118] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40038 [2024-09-11 15:55:22.144103] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:22.203423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:22.203474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:22.203486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:22.203496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:22.229014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:22.241741] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40038, magic:0x78563412 [2024-09-11 15:55:22.241779] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:22.241785] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:22.403738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:22.403783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:22.403791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:22.403800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:22.429215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:22.604096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:22.604139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:22.604147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:22.604156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:22.629337] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:22.644579] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:22.644624] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40048 [2024-09-11 15:55:22.656001] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:22.804391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:22.804448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:22.804460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:22.804492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:22.821849] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041322821844, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:55:22.828596] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041322828594, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007436, add_bytes: 0 [2024-09-11 15:55:22.829448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:22.842311] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40048, magic:0x78563412 [2024-09-11 15:55:22.842340] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:22.842347] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:23.004728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:23.004772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:23.004779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:23.004789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:23.029555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:23.144289] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:23.205085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:23.205130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:23.205138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:23.205147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:23.229686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:23.244546] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:23.244589] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40054 [2024-09-11 15:55:23.405453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:23.405498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:23.405506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:23.405533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:23.429804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:23.442608] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40054, magic:0x78563412 [2024-09-11 15:55:23.442641] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:23.442648] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:23.605839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:23.605885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:23.605894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:23.605936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:23.629929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:23.656852] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:23.806240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:23.806284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:23.806292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:23.806302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:23.813693] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7379, clean_start_pos=10800000, clean_num=200000) [2024-09-11 15:55:23.829467] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041323829463, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:55:23.830128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:23.836210] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041323836207, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:55:23.844722] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:23.844765] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40066 [2024-09-11 15:55:24.014042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:24.014109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:24.014118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:24.014127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:24.034640] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4335, replace_start_pos=3900000, replace_num=100000) [2024-09-11 15:55:24.034690] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:24.043255] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40066, magic:0x78563412 [2024-09-11 15:55:24.043295] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:24.043302] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:24.144466] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:24.214446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:24.214513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:24.214524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:24.214535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:24.234780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:24.414838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:24.414885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:24.414893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:24.414927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:24.434919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:24.445363] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:24.445403] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40078 [2024-09-11 15:55:24.615251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:24.615298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:24.615306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:24.615316] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:24.635101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:24.643864] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40078, magic:0x78563412 [2024-09-11 15:55:24.643927] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:24.643936] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:24.757734] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=93] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:24.815550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:24.815595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:24.815602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:24.815611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:24.835229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:24.837136] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041324837132, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 15:55:24.843822] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=80] PNIO [ratelimit] time: 1726041324843819, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:55:25.015959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:25.016005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:25.016013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:25.016022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:25.035404] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:25.045522] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:25.045564] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40088 [2024-09-11 15:55:25.144606] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:25.216304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:25.216348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:25.216356] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:25.216365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:25.235587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:25.243961] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40088, magic:0x78563412 [2024-09-11 15:55:25.243995] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:25.244002] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:25.416654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:25.416700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:25.416707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:25.416716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:25.416958] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=79, refresh_score_time=67, wash_time=0) [2024-09-11 15:55:25.435771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:25.619051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:25.619102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:25.619108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:25.619115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:25.635956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:25.646344] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:25.646389] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19006 [2024-09-11 15:55:25.758920] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:25.819380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:25.819510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=129][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:25.819518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:25.819527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:25.826993] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7452, clean_start_pos=11000000, clean_num=200000) [2024-09-11 15:55:25.836146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:25.844383] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19006, magic:0x78563412 [2024-09-11 15:55:25.844419] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:25.844428] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:25.844694] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041325844692, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 15:55:25.851441] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041325851439, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:55:26.027330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:26.027376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:26.027384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:26.027393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:26.036328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:26.144764] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:26.227699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:26.227747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:26.227755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:26.227764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:26.239828] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3343, replace_start_pos=4000000, replace_num=100000) [2024-09-11 15:55:26.239869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:26.245991] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:26.246024] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19008 [2024-09-11 15:55:26.428086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:26.428131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:26.428140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:26.428150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:26.439971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:26.442858] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19008, magic:0x78563412 [2024-09-11 15:55:26.442886] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:26.442894] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:26.628450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:26.628507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:26.628516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:26.628527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:26.640184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:26.760170] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:26.828782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:26.828828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:26.828836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:26.828845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:26.840377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:26.845493] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:26.845532] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19012 [2024-09-11 15:55:26.852301] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726041326852299, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 15:55:26.859134] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041326859131, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 15:55:27.029104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:27.029151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:27.029159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:27.029168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:27.040565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:27.042259] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19012, magic:0x78563412 [2024-09-11 15:55:27.042287] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:27.042295] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:27.144891] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:27.229401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:27.229448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:27.229456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:27.229465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:27.240698] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:27.429695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:27.429739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:27.429748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:27.429758] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:27.440818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:27.443298] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:27.443321] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19020 [2024-09-11 15:55:27.630017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:27.630059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:27.630066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:27.630074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:27.640933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:27.641772] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19020, magic:0x78563412 [2024-09-11 15:55:27.641818] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:27.641827] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:27.761526] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:27.830324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:27.830374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:27.830401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:27.830410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:27.838458] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8034, clean_start_pos=11200000, clean_num=200000) [2024-09-11 15:55:27.841063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:27.860011] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726041327860007, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007708, add_bytes: 0 [2024-09-11 15:55:27.866685] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041327866681, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 15:55:28.038716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:28.038779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:28.038787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:28.038796] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:28.041174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:28.044247] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:28.044279] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19030 [2024-09-11 15:55:28.145113] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=82] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:28.239123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:28.239165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:28.239173] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:28.239183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:28.241299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:28.242378] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19030, magic:0x78563412 [2024-09-11 15:55:28.242406] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:28.242414] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:28.439450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:28.439489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:28.439497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:28.439506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:28.445787] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4324, replace_start_pos=4100000, replace_num=100000) [2024-09-11 15:55:28.445833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:28.639816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:28.639860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:28.639868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:28.639878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:28.643317] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:28.643351] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19044 [2024-09-11 15:55:28.645919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:28.762795] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:28.840176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:28.840221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:28.840230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:28.840240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:28.841663] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19044, magic:0x78563412 [2024-09-11 15:55:28.841706] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:28.841714] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:28.846040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:28.867542] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041328867538, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007531, add_bytes: 0 [2024-09-11 15:55:28.874309] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041328874305, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:55:29.040555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:29.040599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:29.040607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:29.040617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:29.046225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:29.145328] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:29.240864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:29.240938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:29.240953] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:29.240963] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:29.243367] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:29.243396] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19060 [2024-09-11 15:55:29.246409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:29.441195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:29.441256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:29.441263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:29.441272] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:29.441880] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19060, magic:0x78563412 [2024-09-11 15:55:29.441896] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:29.441929] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:29.446587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:29.641500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:29.641542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:29.641548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:29.641558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:29.646697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:29.763998] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:29.841868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:29.841930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:29.841939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:29.841948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:29.843824] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:29.843860] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19062 [2024-09-11 15:55:29.846823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:29.850233] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8272, clean_start_pos=11400000, clean_num=200000) [2024-09-11 15:55:29.875144] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041329875140, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:55:29.881899] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041329881898, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 15:55:30.042240] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19062, magic:0x78563412 [2024-09-11 15:55:30.042281] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:30.042288] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:30.046945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:30.050478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:30.050513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:30.050521] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:30.050530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:30.145441] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:30.247062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:30.250759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:30.250791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:30.250797] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:30.250805] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:30.346237] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:30.346285] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:30.346366] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=35, max_check_version=36, global_version=37) [2024-09-11 15:55:30.348374] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2007 [2024-09-11 15:55:30.348408] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:30.348440] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:55:30.348473] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:55:30.348547] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:30.348645] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:55:30.348688] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:55:30.348697] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:55:30.348706] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:55:30.348737] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:55:30.348788] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:55:30.348805] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:55:30.444069] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:30.444112] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19064 [2024-09-11 15:55:30.447256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:30.451037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:30.451062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:30.451068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:30.451075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:30.642784] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19064, magic:0x78563412 [2024-09-11 15:55:30.642828] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:30.642836] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:30.651375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:30.651420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:30.651428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:30.651460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:30.651816] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4348, replace_start_pos=4200000, replace_num=100000) [2024-09-11 15:55:30.651847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:30.765120] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:30.851697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:30.851755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:30.851763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:30.851772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:30.852006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:30.882826] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041330882822, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:55:30.889594] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041330889590, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 15:55:31.045221] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:31.045267] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19070 [2024-09-11 15:55:31.052031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:31.052063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:31.052069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:31.052076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:31.052132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:31.145616] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=85] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:31.243420] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19070, magic:0x78563412 [2024-09-11 15:55:31.243463] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:31.243472] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:31.252295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:31.252305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:31.252351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:31.252367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:31.252375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:31.452507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:31.452627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:31.452657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:31.452665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:31.452673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:31.646590] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:31.646636] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19074 [2024-09-11 15:55:31.652704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:31.652919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:31.652942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:31.652949] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:31.652957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:31.766114] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:31.843844] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19074, magic:0x78563412 [2024-09-11 15:55:31.843886] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:31.843893] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:31.852834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:31.853177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:31.853204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:31.853226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:31.853235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:31.860954] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7705, clean_start_pos=11600000, clean_num=200000) [2024-09-11 15:55:31.890388] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041331890384, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 15:55:31.897138] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041331897137, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 15:55:32.052938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:32.061196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:32.061229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:32.061237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:32.061246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:32.145725] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:32.245872] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:32.245922] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19076 [2024-09-11 15:55:32.253078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:32.261469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:32.261504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:32.261512] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:32.261522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:32.444246] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19076, magic:0x78563412 [2024-09-11 15:55:32.444279] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:32.444285] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:32.453205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:32.461759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:32.461794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:32.461800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:32.461809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:32.653337] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:32.662043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:32.662077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:32.662084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:32.662092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:32.767352] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:32.846973] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:32.847027] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19088 [2024-09-11 15:55:32.857946] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4434, replace_start_pos=4300000, replace_num=100000) [2024-09-11 15:55:32.857990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:32.862458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:32.862489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:32.862497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:32.862506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:32.898085] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041332898080, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 15:55:32.904759] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726041332904756, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:55:33.044964] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19088, magic:0x78563412 [2024-09-11 15:55:33.045006] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:33.045014] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:33.058154] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:33.062747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:33.062784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:33.062792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:33.062801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:33.145842] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:33.258349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:33.263067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:33.263109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:33.263116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:33.263125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:33.445295] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:33.445337] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19096 [2024-09-11 15:55:33.458481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:33.463428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:33.463471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:33.463479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:33.463487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:33.644156] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19096, magic:0x78563412 [2024-09-11 15:55:33.644198] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:33.644204] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:33.658606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:33.663819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:33.663857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:33.663865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:33.663874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:33.768927] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:33.858741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:33.864107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:33.864144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:33.864151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:33.864160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:33.872699] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8526, clean_start_pos=11800000, clean_num=200000) [2024-09-11 15:55:33.905626] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=69] PNIO [ratelimit] time: 1726041333905622, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 15:55:33.912372] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041333912368, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:55:34.044339] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:34.044386] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19104 [2024-09-11 15:55:34.058872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:34.072973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:34.073016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:34.073024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:34.073034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:34.145956] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:34.242664] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19104, magic:0x78563412 [2024-09-11 15:55:34.242706] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:34.242713] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:34.259051] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:34.273338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:34.273374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:34.273382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:34.273391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:34.459261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:34.473690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:34.473735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:34.473743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:34.473752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:34.644012] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:34.644069] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19110 [2024-09-11 15:55:34.659450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:34.674017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:34.674061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:34.674068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:34.674077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:34.770231] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:34.842838] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19110, magic:0x78563412 [2024-09-11 15:55:34.842889] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:34.842896] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:34.859626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:34.874305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:34.874346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:34.874353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:34.874362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:34.913295] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041334913292, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 15:55:34.919986] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041334919982, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:55:35.064208] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4403, replace_start_pos=4400000, replace_num=100000) [2024-09-11 15:55:35.064256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:35.074671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:35.074715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:35.074723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:35.074752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:35.146093] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:35.245468] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:35.245510] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19112 [2024-09-11 15:55:35.264356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:35.275002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:35.275044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:35.275051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:35.275060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:35.443578] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19112, magic:0x78563412 [2024-09-11 15:55:35.443622] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:35.443630] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:35.464485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:35.475373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:35.475412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:35.475420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:35.475429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:35.664612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:35.675662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:35.675696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:35.675703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:35.675713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:35.771325] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:35.844938] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:35.844981] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60784 [2024-09-11 15:55:35.864756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:35.875958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:35.875998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:35.876006] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:35.876015] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:35.884512] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8484, clean_start_pos=12000000, clean_num=200000) [2024-09-11 15:55:35.920920] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041335920916, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:55:35.927675] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041335927672, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 15:55:36.043795] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60784, magic:0x78563412 [2024-09-11 15:55:36.043839] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:36.043847] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:36.064885] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:36.084862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:36.084922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:36.084930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:36.084939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:36.146296] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:36.265040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:36.285276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:36.285314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:36.285322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:36.285333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:36.446395] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:36.446440] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60798 [2024-09-11 15:55:36.465168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:36.485568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:36.485608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:36.485616] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:36.485625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:36.644622] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60798, magic:0x78563412 [2024-09-11 15:55:36.644662] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:36.644670] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:36.665296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:36.685871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:36.685949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:36.685958] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:36.685967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:36.772201] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:36.865433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:36.886289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:36.886334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:36.886342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:36.886352] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:36.928568] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041336928565, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007649, add_bytes: 0 [2024-09-11 15:55:36.935233] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041336935230, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:55:37.045953] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:37.046008] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60808 [2024-09-11 15:55:37.065576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:37.086669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:37.086713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:37.086721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:37.086731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:37.146485] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:37.244048] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60808, magic:0x78563412 [2024-09-11 15:55:37.244086] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:37.244093] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:37.270040] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=4500000, replace_num=100000) [2024-09-11 15:55:37.270105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:37.287054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:37.287089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:37.287097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:37.287106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:37.470186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:37.487416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:37.487455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:37.487463] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:37.487472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:37.646421] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:37.646467] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60812 [2024-09-11 15:55:37.670299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:37.687781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:37.687824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:37.687832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:37.687841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:37.772988] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:37.844720] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60812, magic:0x78563412 [2024-09-11 15:55:37.844755] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:37.844763] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:37.870472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:37.888064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:37.888108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:37.888128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:37.888137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:37.895041] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6891, clean_start_pos=12200000, clean_num=200000) [2024-09-11 15:55:37.936145] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041337936141, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007576, add_bytes: 0 [2024-09-11 15:55:37.942853] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041337942849, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:55:38.070606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:38.095380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:38.095425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:38.095433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:38.095443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:38.146662] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:38.246160] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:38.246206] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60818 [2024-09-11 15:55:38.270745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:38.295680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:38.295723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:38.295730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:38.295740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:38.444811] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60818, magic:0x78563412 [2024-09-11 15:55:38.444847] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:38.444854] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:38.470872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:38.496070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:38.496116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:38.496124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:38.496134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:38.671000] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:38.696381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:38.696418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:38.696426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:38.696435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:38.773885] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:38.847188] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:38.847232] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60826 [2024-09-11 15:55:38.871116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:38.896668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:38.896712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:38.896720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:38.896729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:38.943687] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041338943683, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 15:55:38.950470] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041338950467, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:55:39.045513] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60826, magic:0x78563412 [2024-09-11 15:55:39.045557] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:39.045565] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:39.071294] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:39.097010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:39.097050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:39.097057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:39.097067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:39.146923] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:39.271417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:39.297317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:39.297357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:39.297366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:39.297375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:39.447434] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:39.447479] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60842 [2024-09-11 15:55:39.475891] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4362, replace_start_pos=4600000, replace_num=100000) [2024-09-11 15:55:39.475940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:39.497682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:39.497717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:39.497725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:39.497735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:39.645882] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60842, magic:0x78563412 [2024-09-11 15:55:39.645948] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:39.645957] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:39.676038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:39.697996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:39.698034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:39.698042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:39.698051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:39.774962] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:39.876141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:39.898344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:39.898385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:39.898393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:39.898402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:39.906066] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7650, clean_start_pos=12400000, clean_num=200000) [2024-09-11 15:55:39.951377] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041339951372, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 15:55:39.958071] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726041339958067, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 15:55:40.047990] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:40.048037] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60856 [2024-09-11 15:55:40.076259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:40.106384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:40.106429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:40.106436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:40.106447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:40.147044] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:40.246235] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60856, magic:0x78563412 [2024-09-11 15:55:40.246280] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:40.246289] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:40.276378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:40.306746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:40.306784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:40.306792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:40.306802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:40.363504] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:40.363552] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:40.363621] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=36, max_check_version=37, global_version=38) [2024-09-11 15:55:40.365370] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1748 [2024-09-11 15:55:40.365406] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:40.365439] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:55:40.365471] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:55:40.365545] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:40.365641] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:55:40.365685] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:55:40.365694] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:55:40.365703] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:55:40.365735] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:55:40.365787] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:55:40.365804] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:55:40.476494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:40.507203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:40.507243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:40.507250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:40.507260] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:40.648419] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:40.648463] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60868 [2024-09-11 15:55:40.676616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:40.707550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:40.707592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:40.707600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:40.707609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:40.775719] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:40.846975] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60868, magic:0x78563412 [2024-09-11 15:55:40.847014] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:40.847021] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:40.876725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:40.907829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:40.907885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:40.907892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:40.907925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:40.958918] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041340958916, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 15:55:40.965751] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041340965747, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 15:55:41.076846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:41.108145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:41.108189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:41.108197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:41.108206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:41.147190] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:41.248966] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:41.249008] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60878 [2024-09-11 15:55:41.276998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=77] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:41.308431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:41.308489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:41.308497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:41.308506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:41.447272] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60878, magic:0x78563412 [2024-09-11 15:55:41.447315] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:41.447324] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:41.477118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:41.508746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:41.508791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:41.508798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:41.508807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:41.680550] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3305, replace_start_pos=4700000, replace_num=100000) [2024-09-11 15:55:41.680593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:41.709039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:41.709079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:41.709087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:41.709096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:41.776922] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:41.849156] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:41.849201] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60882 [2024-09-11 15:55:41.880674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:41.909316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:41.909353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:41.909360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:41.909369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:41.917913] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8520, clean_start_pos=0, clean_num=200000) [2024-09-11 15:55:41.966625] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041341966621, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007705, add_bytes: 0 [2024-09-11 15:55:41.973312] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041341973309, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 15:55:42.047747] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60882, magic:0x78563412 [2024-09-11 15:55:42.047788] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:42.047796] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:42.080791] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:42.118251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:42.118293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:42.118301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:42.118311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:42.147300] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:42.280917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:42.318601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:42.318638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:42.318645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:42.318655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:42.448821] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:42.448858] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60886 [2024-09-11 15:55:42.481041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:42.518974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:42.519010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:42.519018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:42.519027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:42.647377] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60886, magic:0x78563412 [2024-09-11 15:55:42.647413] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:42.647419] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:42.681154] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:42.719320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:42.719358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:42.719366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:42.719376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:42.777709] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:42.881255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:42.919667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:42.919717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:42.919731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:42.919741] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:42.974223] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041342974218, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 15:55:42.980979] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041342980975, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 15:55:43.049831] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:43.049875] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60896 [2024-09-11 15:55:43.081360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:43.120051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:43.120096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:43.120104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:43.120114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:43.147485] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:43.246877] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60896, magic:0x78563412 [2024-09-11 15:55:43.246935] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:43.246943] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:43.281484] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:43.320423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:43.320468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:43.320476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:43.320485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:43.481604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:43.520728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:43.520772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:43.520779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:43.520789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:43.649033] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:43.649080] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60908 [2024-09-11 15:55:43.681728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:43.721053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:43.721099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:43.721107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:43.721116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:43.778575] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:43.847286] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60908, magic:0x78563412 [2024-09-11 15:55:43.847328] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:43.847335] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:43.885783] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3934, replace_start_pos=4800000, replace_num=100000) [2024-09-11 15:55:43.885818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:43.921471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:43.921510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:43.921518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:43.921527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:43.929127] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7587, clean_start_pos=200000, clean_num=200000) [2024-09-11 15:55:43.981770] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041343981766, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:55:43.988595] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041343988591, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:55:44.085896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:44.129458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:44.129501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:44.129526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:44.129536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:44.147608] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:44.249669] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:44.249704] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60924 [2024-09-11 15:55:44.286011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:44.329762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:44.329802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:44.329809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:44.329818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:44.447826] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60924, magic:0x78563412 [2024-09-11 15:55:44.447867] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:44.447875] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:44.486171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:44.530043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:44.530078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:44.530086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:44.530096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:44.686310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:44.730333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:44.730368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:44.730376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:44.730386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:44.779562] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:44.849867] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:44.849939] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=65] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:60936 [2024-09-11 15:55:44.886425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:44.930634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:44.930678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:44.930686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:44.930696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:44.989456] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041344989453, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:55:44.996156] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041344996151, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 15:55:45.048113] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:60936, magic:0x78563412 [2024-09-11 15:55:45.048144] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:45.048151] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:45.086531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:45.131010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:45.131041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:45.131049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:45.131058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:45.147804] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:45.286627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:45.331364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:45.331406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:45.331414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:45.331424] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:45.449959] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:45.449996] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13484 [2024-09-11 15:55:45.486733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:45.531720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:45.531761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:45.531769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:45.531779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:45.648577] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13484, magic:0x78563412 [2024-09-11 15:55:45.648621] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:45.648628] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:45.686832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:45.732102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:45.732163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:45.732172] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:45.732182] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:45.732398] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=95, refresh_score_time=63, wash_time=0) [2024-09-11 15:55:45.780346] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:45.886933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:45.932629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:45.932667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:45.932675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:45.932685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:45.940068] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7370, clean_start_pos=400000, clean_num=200000) [2024-09-11 15:55:45.997073] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041345997069, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:55:46.003781] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041346003778, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:55:46.050709] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:46.050748] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13500 [2024-09-11 15:55:46.090934] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3899, replace_start_pos=4900000, replace_num=100000) [2024-09-11 15:55:46.090969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:46.140410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:46.140449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:46.140457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:46.140466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:46.147963] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:46.249310] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13500, magic:0x78563412 [2024-09-11 15:55:46.249364] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:46.249371] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:46.291056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:46.340707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:46.340746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:46.340754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:46.340763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:46.491238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:46.541297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:46.541335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:46.541341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:46.541350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:46.650185] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:46.650228] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13504 [2024-09-11 15:55:46.691360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:46.741976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:46.742012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:46.742020] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:46.742029] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:46.781342] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:46.848547] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13504, magic:0x78563412 [2024-09-11 15:55:46.848586] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:46.848594] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:46.891541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:46.942335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:46.942380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:46.942386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:46.942394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:47.004686] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041347004682, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:55:47.011394] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041347011391, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:55:47.091663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:47.142620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:47.142665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:47.142672] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:47.142680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:47.148092] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:47.250708] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:47.250751] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13514 [2024-09-11 15:55:47.291843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:47.342997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:47.343038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:47.343044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:47.343066] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:47.448999] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13514, magic:0x78563412 [2024-09-11 15:55:47.449032] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:47.449039] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:47.491984] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:47.543369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:47.543414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:47.543422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:47.543433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:47.692188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:47.743663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:47.743707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:47.743715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:47.743724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:47.782299] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:47.849378] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:47.849423] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13528 [2024-09-11 15:55:47.892321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:47.943997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:47.944058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:47.944073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:47.944083] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:47.951278] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7180, clean_start_pos=600000, clean_num=200000) [2024-09-11 15:55:48.012302] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041348012298, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:55:48.018998] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041348018993, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:55:48.047599] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13528, magic:0x78563412 [2024-09-11 15:55:48.047641] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:48.047648] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:48.092494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:48.148200] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:48.151543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:48.151570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:48.151577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:48.151586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:48.296717] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4026, replace_start_pos=5000000, replace_num=100000) [2024-09-11 15:55:48.296763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:48.351819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:48.351864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:48.351871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:48.351879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:48.449239] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:48.449280] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13534 [2024-09-11 15:55:48.496924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:48.552151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:48.552197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:48.552205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:48.552214] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:48.648000] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13534, magic:0x78563412 [2024-09-11 15:55:48.648042] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:48.648050] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:48.697062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:48.752422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:48.752465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:48.752473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:48.752482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:48.783221] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:48.897253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:48.952775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:48.952816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:48.952824] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:48.952834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:49.019849] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041349019845, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 15:55:49.026693] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041349026690, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 15:55:49.054487] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:49.054549] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13550 [2024-09-11 15:55:49.097505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:49.148327] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:49.153127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:49.153188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:49.153196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:49.153205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:49.248474] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13550, magic:0x78563412 [2024-09-11 15:55:49.248515] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:49.248524] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:49.297711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:49.353442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:49.353488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:49.353496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:49.353505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:49.497851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:49.553743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:49.553786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:49.553815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:49.553825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:49.650786] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:49.650830] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13558 [2024-09-11 15:55:49.698037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:49.754069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:49.754113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:49.754120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:49.754129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:49.784681] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:49.848638] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13558, magic:0x78563412 [2024-09-11 15:55:49.848681] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:49.848689] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:49.898228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:49.954369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:49.954411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:49.954418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:49.954428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:49.962500] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8059, clean_start_pos=800000, clean_num=200000) [2024-09-11 15:55:50.027535] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041350027531, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:55:50.034227] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041350034223, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007533, add_bytes: 0 [2024-09-11 15:55:50.098422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:50.148504] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:50.162854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:50.162898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:50.162928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:50.162939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:50.251032] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:50.251077] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13574 [2024-09-11 15:55:50.298641] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:50.363234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:50.363279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:50.363287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:50.363297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:50.379996] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:50.380042] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:55:50.380122] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=37, max_check_version=38, global_version=39) [2024-09-11 15:55:50.382155] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2032 [2024-09-11 15:55:50.382209] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:50.382243] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:55:50.382281] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:55:50.382364] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:55:50.382471] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:55:50.382531] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:55:50.382542] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:55:50.382557] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:55:50.382594] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:55:50.382654] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:55:50.382677] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:55:50.449160] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13574, magic:0x78563412 [2024-09-11 15:55:50.449203] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:50.449212] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:50.503230] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4373, replace_start_pos=5100000, replace_num=100000) [2024-09-11 15:55:50.503280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:50.563595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:50.563639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:50.563647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:50.563657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:50.703376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:50.763993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:50.764036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:50.764044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:50.764052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:50.786004] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:50.849977] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:50.850020] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13576 [2024-09-11 15:55:50.903512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:50.964455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:50.964501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:50.964510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:50.964519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:51.035151] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041351035147, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:55:51.041849] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041351041846, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:55:51.048484] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13576, magic:0x78563412 [2024-09-11 15:55:51.048519] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:51.048527] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:51.103649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:51.148744] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=100] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:51.164831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:51.164877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:51.164885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:51.164895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:51.303838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:51.365169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:51.365217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:51.365225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:51.365235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:51.451059] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:51.451103] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13588 [2024-09-11 15:55:51.503974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:51.565542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:51.565581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:51.565589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:51.565598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:51.649140] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13588, magic:0x78563412 [2024-09-11 15:55:51.649181] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:51.649188] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:51.704100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:51.765899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:51.765955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:51.765963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:51.765972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:51.787440] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:51.904234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:51.966217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:51.966261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:51.966268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:51.966278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:51.974856] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8564, clean_start_pos=1000000, clean_num=200000) [2024-09-11 15:55:52.042805] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041352042801, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007654, add_bytes: 0 [2024-09-11 15:55:52.049525] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041352049521, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:55:52.051113] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:52.051141] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13592 [2024-09-11 15:55:52.104423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:52.148932] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:52.175134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:52.175180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:52.175189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:52.175199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:52.175390] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:55:52.249494] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13592, magic:0x78563412 [2024-09-11 15:55:52.249537] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:52.249545] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:52.304615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:52.375701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:52.375744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:52.375753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:52.375762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:52.504740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:52.576039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:52.576082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:52.576090] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:52.576099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:52.651690] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:52.651733] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13602 [2024-09-11 15:55:52.709260] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4362, replace_start_pos=5200000, replace_num=100000) [2024-09-11 15:55:52.709310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:52.776412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:52.776459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:52.776467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:52.776477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:52.788633] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:52.849941] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13602, magic:0x78563412 [2024-09-11 15:55:52.849982] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:52.849991] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:52.909482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:52.976782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:52.976839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:52.976854] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:52.976866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:53.050397] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041353050392, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007591, add_bytes: 0 [2024-09-11 15:55:53.057079] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1726041353057076, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:55:53.109668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:53.149060] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:53.177105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:53.177148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:53.177156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:53.177165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:53.251983] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:53.252030] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13610 [2024-09-11 15:55:53.309856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:53.377397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:53.377445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:53.377454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:53.377463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:53.449198] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13610, magic:0x78563412 [2024-09-11 15:55:53.449244] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:53.449250] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:53.510058] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:53.577700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:53.577744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:53.577768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:53.577777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:53.710243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:53.778071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:53.778110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:53.778118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:53.778127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:53.789985] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:53.850985] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:53.851032] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13616 [2024-09-11 15:55:53.910375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:53.978456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:53.978499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:53.978507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:53.978517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:53.986048] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7517, clean_start_pos=1200000, clean_num=200000) [2024-09-11 15:55:54.049762] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13616, magic:0x78563412 [2024-09-11 15:55:54.049802] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:54.049810] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:54.058008] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041354058004, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:55:54.064689] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726041354064686, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:55:54.110510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:54.149181] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:54.186302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:54.186347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:54.186355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:54.186364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:54.310696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:54.386619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:54.386665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:54.386673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:54.386682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:54.452110] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:54.452154] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13624 [2024-09-11 15:55:54.510833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:54.586973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:54.587013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:54.587021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:54.587030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:54.650288] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13624, magic:0x78563412 [2024-09-11 15:55:54.650328] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:54.650349] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:54.711013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:54.787305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:54.787343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:54.787351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:54.787358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:54.791360] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:54.915615] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4417, replace_start_pos=5300000, replace_num=100000) [2024-09-11 15:55:54.915662] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:54.987591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:54.987635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:54.987642] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:54.987651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:55.052102] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:55.052146] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:13628 [2024-09-11 15:55:55.065545] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041355065542, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007538, add_bytes: 0 [2024-09-11 15:55:55.072373] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041355072370, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:55:55.115748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:55.149401] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:55.187932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:55.187985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:55.187993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:55.188003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:55.250470] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:13628, magic:0x78563412 [2024-09-11 15:55:55.250506] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:55.250515] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:55.315858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:55.388306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:55.388345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:55.388353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:55.388362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:55.515969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:55.588674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:55.588724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:55.588731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:55.588740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:55.652391] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:55.652436] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30070 [2024-09-11 15:55:55.716076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:55.789020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:55.789066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:55.789098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:55.789107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:55.792402] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:55.850865] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30070, magic:0x78563412 [2024-09-11 15:55:55.850920] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:55.850942] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:55.916189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:55.989321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:55.989364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:55.989370] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:55.989377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:55.996037] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6647, clean_start_pos=1400000, clean_num=200000) [2024-09-11 15:55:56.073231] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041356073227, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 15:55:56.079992] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041356079988, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:55:56.116305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:56.149543] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:56.196375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:56.196425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:56.196435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:56.196445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:56.252414] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:56.252459] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30072 [2024-09-11 15:55:56.316432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:56.396746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:56.396789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:56.396796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:56.396804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:56.451277] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30072, magic:0x78563412 [2024-09-11 15:55:56.451319] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:56.451327] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:56.516561] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:56.597102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:56.597144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:56.597150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:56.597158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:56.716678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:56.793621] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:56.797385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:56.797423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:56.797430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:56.797439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:56.853330] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:56.853374] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30084 [2024-09-11 15:55:56.916789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:56.997843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:56.997893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:56.997926] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:56.997961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:57.051730] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30084, magic:0x78563412 [2024-09-11 15:55:57.051774] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:57.051781] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:57.080847] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041357080843, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:55:57.087538] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041357087534, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 15:55:57.121072] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4147, replace_start_pos=5400000, replace_num=100000) [2024-09-11 15:55:57.121114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:57.149667] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:57.198199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:57.198245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:57.198252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:57.198261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:57.321258] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:57.398571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:57.398621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:57.398631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:57.398641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:57.453571] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:57.453612] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30092 [2024-09-11 15:55:57.521451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:57.598898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:57.598960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:57.598966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:57.598974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:57.652152] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30092, magic:0x78563412 [2024-09-11 15:55:57.652195] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:57.652203] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:57.721632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:55:57.794880] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:57.799277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:57.799314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:57.799323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:57.799334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:57.921810] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:55:57.999564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:57.999617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:57.999624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:57.999639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:58.006932] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7278, clean_start_pos=1600000, clean_num=200000) [2024-09-11 15:55:58.053965] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:58.054009] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30094 [2024-09-11 15:55:58.088464] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041358088460, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:55:58.095222] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041358095219, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 15:55:58.121996] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:55:58.149781] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:58.207277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:58.207318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:58.207324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:58.207332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:58.252502] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30094, magic:0x78563412 [2024-09-11 15:55:58.252546] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:58.252554] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:58.322176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:55:58.407579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:58.407624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:58.407632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:58.407641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:58.522355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:55:58.607986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:58.608032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:58.608038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:58.608046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:58.655038] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:58.655092] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30108 [2024-09-11 15:55:58.722491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:55:58.796090] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=118] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:58.808294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:58.808342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:58.808350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:58.808358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:58.853058] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30108, magic:0x78563412 [2024-09-11 15:55:58.853099] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:58.853106] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:58.922670] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:55:59.008596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:59.008641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:59.008649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:59.008658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:59.096079] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041359096076, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:55:59.102776] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041359102772, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:55:59.122921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:55:59.149966] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:55:59.208991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:59.209035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:59.209042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:59.209050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:59.255118] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:59.255162] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30110 [2024-09-11 15:55:59.326353] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3300, replace_start_pos=5500000, replace_num=100000) [2024-09-11 15:55:59.326397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:55:59.409352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:59.409395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:59.409402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:59.409410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:59.453382] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30110, magic:0x78563412 [2024-09-11 15:55:59.453427] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:55:59.453435] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:55:59.526537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:55:59.609648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:59.609713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:59.609722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:59.609733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:59.726763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:55:59.797016] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:55:59.809991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:55:59.810033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:55:59.810039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:55:59.810046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:55:59.855420] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:55:59.855464] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30112 [2024-09-11 15:55:59.926878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:00.010282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:00.010325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:00.010331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:00.010338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:00.016951] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6600, clean_start_pos=1800000, clean_num=200000) [2024-09-11 15:56:00.053686] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30112, magic:0x78563412 [2024-09-11 15:56:00.053728] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:00.053735] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:00.089508] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 15:56:00.103633] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041360103629, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:56:00.103669] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 15:56:00.108079] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 15:56:00.110383] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041360110380, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:56:00.110413] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:56:00.127025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:00.150084] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:00.217185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:00.217225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:00.217232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:00.217239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:00.327139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:00.396755] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:00.396807] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:00.396888] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=38, max_check_version=39, global_version=40) [2024-09-11 15:56:00.398899] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2009 [2024-09-11 15:56:00.398983] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=68] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:00.399019] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:56:00.399057] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:56:00.399140] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:00.399248] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:56:00.399304] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:56:00.399316] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:56:00.399327] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:56:00.399363] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:56:00.399423] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:56:00.399444] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:56:00.417455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:00.417491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:00.417498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:00.417506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:00.455880] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:00.455935] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30126 [2024-09-11 15:56:00.527330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:00.617719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:00.617763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:00.617769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:00.617777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:00.654274] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30126, magic:0x78563412 [2024-09-11 15:56:00.654317] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:00.654325] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:00.727462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:00.797815] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:00.818071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:00.818118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:00.818126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:00.818135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:00.927594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:01.018359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:01.018422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:01.018429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:01.018436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:01.056050] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:01.056091] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30128 [2024-09-11 15:56:01.111263] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041361111259, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:56:01.118000] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041361117997, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:56:01.127824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:01.150226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:01.218668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:01.218713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:01.218721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:01.218730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:01.254632] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30128, magic:0x78563412 [2024-09-11 15:56:01.254671] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:01.254680] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:01.327995] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:01.419067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:01.419113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:01.419137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:01.419147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:01.531546] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3362, replace_start_pos=5600000, replace_num=100000) [2024-09-11 15:56:01.531591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:01.619371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:01.619418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:01.619427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:01.619438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:01.656795] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:01.656840] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30142 [2024-09-11 15:56:01.731740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:01.798923] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:01.819663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:01.819704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:01.819711] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:01.819719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:01.855139] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30142, magic:0x78563412 [2024-09-11 15:56:01.855181] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:01.855189] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:01.931930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:02.019980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:02.020025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:02.020035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:02.020063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:02.027671] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7593, clean_start_pos=2000000, clean_num=200000) [2024-09-11 15:56:02.120290] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041362120287, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1009028, add_bytes: 0 [2024-09-11 15:56:02.125634] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041362125630, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 15:56:02.132135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:02.150348] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:02.227942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:02.227984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:02.227992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:02.228000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:02.257559] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:02.257605] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30158 [2024-09-11 15:56:02.332247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:02.428214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:02.428249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:02.428255] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:02.428263] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:02.455443] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30158, magic:0x78563412 [2024-09-11 15:56:02.455499] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:02.455509] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:02.532434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:02.628483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:02.628522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:02.628528] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:02.628536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:02.732612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:02.799855] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:02.828830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:02.828875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:02.828883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:02.828892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:02.857452] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:02.857496] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30174 [2024-09-11 15:56:02.932811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:03.029214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:03.029270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:03.029285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:03.029295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:03.055735] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30174, magic:0x78563412 [2024-09-11 15:56:03.055781] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:03.055788] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:03.126477] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041363126474, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1006187, add_bytes: 0 [2024-09-11 15:56:03.133033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:03.133231] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041363133228, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 15:56:03.150531] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:03.229528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:03.229577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:03.229586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:03.229594] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:03.333157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:03.429841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:03.429887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:03.429895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:03.429926] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:03.457808] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:03.457845] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30188 [2024-09-11 15:56:03.533277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:03.630140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:03.630183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:03.630209] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:03.630216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:03.656221] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30188, magic:0x78563412 [2024-09-11 15:56:03.656264] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:03.656271] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:03.737724] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4325, replace_start_pos=5700000, replace_num=100000) [2024-09-11 15:56:03.737766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:03.800927] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=100] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:03.830456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:03.830502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:03.830509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:03.830518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:03.937867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:04.030821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:04.030864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:04.030870] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:04.030878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:04.038960] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8069, clean_start_pos=2200000, clean_num=200000) [2024-09-11 15:56:04.058222] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:04.058268] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30204 [2024-09-11 15:56:04.134093] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041364134089, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:56:04.138072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:04.140923] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041364140920, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 15:56:04.150719] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:04.239275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:04.239327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:04.239337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:04.239351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:04.256627] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30204, magic:0x78563412 [2024-09-11 15:56:04.256671] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:04.256679] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:04.338195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:04.439606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:04.439649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:04.439656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:04.439665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:04.538322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:04.639978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:04.640025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:04.640033] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:04.640042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:04.658806] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:04.658851] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30210 [2024-09-11 15:56:04.738501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:04.801820] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:04.840301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:04.840342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:04.840368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:04.840378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:04.857062] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30210, magic:0x78563412 [2024-09-11 15:56:04.857102] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:04.857110] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:04.938736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:05.040683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:05.040729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:05.040737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:05.040746] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:05.138927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:05.141723] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041365141720, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:56:05.148465] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726041365148462, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 15:56:05.150860] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:05.241025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:05.241068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:05.241074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:05.241082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:05.259058] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:05.259099] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30224 [2024-09-11 15:56:05.339060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:05.441344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:05.441390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:05.441397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:05.441407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:05.457565] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30224, magic:0x78563412 [2024-09-11 15:56:05.457607] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:05.457615] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:05.539286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:05.641638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:05.641681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:05.641687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:05.641699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:05.739414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:05.802871] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:05.842029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:05.842069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:05.842075] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:05.842082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:05.859241] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:05.859285] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19570 [2024-09-11 15:56:05.943877] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4341, replace_start_pos=5800000, replace_num=100000) [2024-09-11 15:56:05.943931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:06.042287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:06.042330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:06.042336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:06.042344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:06.042518] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=71, refresh_score_time=55, wash_time=0) [2024-09-11 15:56:06.051074] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8546, clean_start_pos=2400000, clean_num=200000) [2024-09-11 15:56:06.058024] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19570, magic:0x78563412 [2024-09-11 15:56:06.058065] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:06.058073] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:06.144019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:06.149385] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041366149382, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007662, add_bytes: 0 [2024-09-11 15:56:06.151097] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:06.156173] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041366156169, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007707, add_bytes: 0 [2024-09-11 15:56:06.251351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:06.251393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:06.251400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:06.251427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:06.344129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:06.451703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:06.451746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:06.451753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:06.451762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:06.459819] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:06.459860] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19582 [2024-09-11 15:56:06.544302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:06.652058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:06.652096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:06.652102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:06.652111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:06.658313] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19582, magic:0x78563412 [2024-09-11 15:56:06.658345] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:06.658352] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:06.744487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:06.803826] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:06.852385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:06.852431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:06.852439] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:06.852448] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:06.944627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:07.052805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:07.052851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:07.052859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:07.052869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:07.060841] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:07.060924] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=77] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19586 [2024-09-11 15:56:07.144830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:07.151296] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:07.157000] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041367156997, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:56:07.163764] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041367163760, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007591, add_bytes: 0 [2024-09-11 15:56:07.253099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:07.253144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:07.253152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:07.253161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:07.259237] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19586, magic:0x78563412 [2024-09-11 15:56:07.259272] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:07.259281] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:07.344970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:07.453392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:07.453429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:07.453437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:07.453447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:07.545110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:07.653678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:07.653717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:07.653723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:07.653731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:07.660856] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:07.660889] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19592 [2024-09-11 15:56:07.745309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:07.804714] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:07.854003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:07.854050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:07.854058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:07.854068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:07.859573] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19592, magic:0x78563412 [2024-09-11 15:56:07.859615] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:07.859623] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:07.945506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:08.054306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:08.054353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:08.054384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:08.054393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:08.061329] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6922, clean_start_pos=2600000, clean_num=200000) [2024-09-11 15:56:08.149551] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3861, replace_start_pos=5900000, replace_num=100000) [2024-09-11 15:56:08.149592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:08.151403] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:08.164684] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041368164680, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 15:56:08.171387] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041368171383, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:56:08.261191] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:08.261237] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19596 [2024-09-11 15:56:08.261578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:08.261608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:08.261615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:08.261625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:08.349738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:08.459812] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19596, magic:0x78563412 [2024-09-11 15:56:08.459849] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:08.459857] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:08.461850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:08.461878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:08.461885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:08.461894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:08.549872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:08.662147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:08.662191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:08.662198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:08.662206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:08.750068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:08.805868] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:08.861394] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:08.861439] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19612 [2024-09-11 15:56:08.862431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:08.862461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:08.862468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:08.862478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:08.950192] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:09.059460] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19612, magic:0x78563412 [2024-09-11 15:56:09.059502] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:09.059509] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:09.062704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:09.062739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:09.062745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:09.062770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:09.150306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:09.151516] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:09.172231] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041369172227, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 15:56:09.179004] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041369178999, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:56:09.263019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:09.263060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:09.263067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:09.263077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:09.350447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:09.461351] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:09.461391] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19622 [2024-09-11 15:56:09.463307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:09.463353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:09.463359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:09.463368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:09.550656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:09.659886] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19622, magic:0x78563412 [2024-09-11 15:56:09.659957] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=66] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:09.659965] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:09.663614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:09.663654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:09.663661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:09.663670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:09.750784] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:09.807012] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:09.863928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:09.863972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:09.863979] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:09.863988] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:09.950921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:10.061729] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:10.061774] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19624 [2024-09-11 15:56:10.064223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:10.064258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:10.064265] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:10.064274] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:10.071730] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7443, clean_start_pos=2800000, clean_num=200000) [2024-09-11 15:56:10.151051] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:10.151605] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=19] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:10.179852] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041370179847, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:56:10.186638] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041370186633, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 15:56:10.260400] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19624, magic:0x78563412 [2024-09-11 15:56:10.260442] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:10.260451] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:10.272000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:10.272037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:10.272045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:10.272055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:10.355530] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4317, replace_start_pos=6000000, replace_num=100000) [2024-09-11 15:56:10.355570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:10.413965] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:10.414011] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:10.414096] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=39, max_check_version=40, global_version=41) [2024-09-11 15:56:10.416126] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2033 [2024-09-11 15:56:10.416190] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:10.416227] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:56:10.416273] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:56:10.416360] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:10.416467] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:56:10.416523] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:56:10.416535] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:56:10.416546] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:56:10.416582] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:56:10.416643] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:56:10.416663] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:56:10.472284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:10.472315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:10.472324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:10.472334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:10.555663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:10.660451] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:10.660495] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19626 [2024-09-11 15:56:10.672560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:10.672599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:10.672605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:10.672614] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:10.755776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:10.807918] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:10.858570] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19626, magic:0x78563412 [2024-09-11 15:56:10.858611] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:10.858618] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:10.872842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:10.872885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:10.872892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:10.872914] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:10.955900] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:11.073153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:11.073210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:11.073217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:11.073226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:11.151717] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:11.156035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:11.187465] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=86] PNIO [ratelimit] time: 1726041371187460, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:56:11.194232] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041371194229, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 15:56:11.260954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:11.260999] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19636 [2024-09-11 15:56:11.273447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:11.273484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:11.273491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:11.273499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:11.356151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:11.459450] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19636, magic:0x78563412 [2024-09-11 15:56:11.459495] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:11.459503] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:11.473728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:11.473780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:11.473787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:11.473795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:11.556280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:11.674038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:11.674080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:11.674086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:11.674095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:11.756461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:11.809061] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:11.861030] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:11.861076] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19640 [2024-09-11 15:56:11.874332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:11.874376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:11.874384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:11.874393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:11.956587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:12.059638] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19640, magic:0x78563412 [2024-09-11 15:56:12.059677] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:12.059685] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:12.074612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:12.074649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:12.074655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:12.074664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:12.083245] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8555, clean_start_pos=3000000, clean_num=200000) [2024-09-11 15:56:12.151882] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:12.156699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:12.195028] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041372195023, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 15:56:12.201809] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041372201804, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 15:56:12.283495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:12.283541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:12.283549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:12.283558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:12.356876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:12.461960] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:12.462001] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19646 [2024-09-11 15:56:12.483778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:12.483821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:12.483828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:12.483837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:12.561451] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4362, replace_start_pos=6100000, replace_num=100000) [2024-09-11 15:56:12.561516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:12.659127] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19646, magic:0x78563412 [2024-09-11 15:56:12.659166] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:12.659174] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:12.684057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:12.684101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:12.684109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:12.684117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:12.761611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:12.810218] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:12.884359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:12.884405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:12.884414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:12.884424] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:12.961823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:13.062036] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:13.062092] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19656 [2024-09-11 15:56:13.084657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:13.084694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:13.084701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:13.084711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:13.152039] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=87] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:13.161956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:13.202640] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041373202636, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:56:13.209488] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041373209485, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:56:13.260273] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19656, magic:0x78563412 [2024-09-11 15:56:13.260311] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:13.260319] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:13.284953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:13.284993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:13.285000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:13.285007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:13.362139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:13.485223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:13.485264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:13.485271] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:13.485281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:13.562275] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:13.661722] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:13.661762] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19664 [2024-09-11 15:56:13.685524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:13.685568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:13.685596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:13.685606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:13.762398] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:13.811276] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:13.860453] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19664, magic:0x78563412 [2024-09-11 15:56:13.860508] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:13.860515] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:13.885830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:13.885873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:13.885880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:13.885890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:13.962576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:14.086135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:14.086175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:14.086182] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:14.086191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:14.093253] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7049, clean_start_pos=3200000, clean_num=200000) [2024-09-11 15:56:14.152143] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:14.162699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:14.210319] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041374210313, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 15:56:14.217079] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041374217075, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 15:56:14.262510] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:14.262548] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19666 [2024-09-11 15:56:14.293482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:14.293519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:14.293525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:14.293532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:14.362918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:14.461176] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19666, magic:0x78563412 [2024-09-11 15:56:14.461218] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:14.461226] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:14.493754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:14.493796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:14.493803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:14.493813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:14.563047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:14.694052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:14.694107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:14.694114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:14.694123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:14.767596] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4361, replace_start_pos=6200000, replace_num=100000) [2024-09-11 15:56:14.767659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:14.812515] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:14.863538] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:14.863579] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19670 [2024-09-11 15:56:14.894345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:14.894404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:14.894412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:14.894420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:14.967763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:15.061621] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19670, magic:0x78563412 [2024-09-11 15:56:15.061664] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:15.061671] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:15.094648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:15.094690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:15.094698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:15.094707] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:15.152274] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:15.167949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:15.217861] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041375217857, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 15:56:15.224693] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041375224690, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:56:15.295010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:15.295063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:15.295075] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:15.295105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:15.368074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:15.462248] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:15.462293] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31694 [2024-09-11 15:56:15.495357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:15.495401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:15.495409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:15.495418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:15.568259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:15.660735] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31694, magic:0x78563412 [2024-09-11 15:56:15.660773] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:15.660780] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:15.695643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:15.695681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:15.695688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:15.695697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:15.768441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:15.813935] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:15.895956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:15.895999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:15.896007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:15.896016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:15.968626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:16.062961] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:16.063001] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31696 [2024-09-11 15:56:16.096319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:16.096366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:16.096375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:16.096384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:16.104565] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8167, clean_start_pos=3400000, clean_num=200000) [2024-09-11 15:56:16.152429] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:16.168770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:16.225506] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041376225501, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 15:56:16.232333] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041376232330, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 15:56:16.261276] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31696, magic:0x78563412 [2024-09-11 15:56:16.261315] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:16.261322] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:16.304808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:16.304851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:16.304859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:16.304868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:16.368946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:16.505104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:16.505148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:16.505155] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:16.505164] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:16.569129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:16.663245] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:16.663289] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31708 [2024-09-11 15:56:16.705380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:16.705413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:16.705420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:16.705428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:16.769252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:16.815251] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:16.861652] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31708, magic:0x78563412 [2024-09-11 15:56:16.861693] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:16.861700] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:16.905768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:16.905808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:16.905816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:16.905827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:16.973800] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4433, replace_start_pos=6300000, replace_num=100000) [2024-09-11 15:56:16.973844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:17.106123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:17.106161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:17.106169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:17.106179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:17.152559] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:17.173944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:17.233091] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041377233088, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007587, add_bytes: 0 [2024-09-11 15:56:17.239866] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041377239863, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007533, add_bytes: 0 [2024-09-11 15:56:17.263499] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:17.263536] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31714 [2024-09-11 15:56:17.306477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:17.306521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:17.306529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:17.306538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:17.374059] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:17.462038] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31714, magic:0x78563412 [2024-09-11 15:56:17.462075] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:17.462082] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:17.506846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:17.506889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:17.506897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:17.506932] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:17.574178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:17.707246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:17.707290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:17.707298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:17.707307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:17.774302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:17.816101] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:17.864216] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:17.864266] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31726 [2024-09-11 15:56:17.907608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:17.907647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:17.907654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:17.907662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:17.974484] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:18.061432] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31726, magic:0x78563412 [2024-09-11 15:56:18.061473] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:18.061481] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:18.107998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:18.108056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:18.108070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:18.108094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:18.116653] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8546, clean_start_pos=3600000, clean_num=200000) [2024-09-11 15:56:18.152670] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:18.174609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:18.240783] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041378240779, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 15:56:18.247483] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041378247479, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:56:18.316955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:18.317000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:18.317007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:18.317016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:18.374717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:18.463508] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:18.463547] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31742 [2024-09-11 15:56:18.517335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:18.517380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:18.517387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:18.517396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:18.574837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:18.661887] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31742, magic:0x78563412 [2024-09-11 15:56:18.661944] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:18.661951] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:18.717710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:18.717756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:18.717764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:18.717774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:18.775036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:18.816993] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:18.918051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:18.918095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:18.918103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:18.918112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:18.975218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:19.064291] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:19.064338] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31752 [2024-09-11 15:56:19.118318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:19.118355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:19.118361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:19.118368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:19.152808] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:19.179623] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4268, replace_start_pos=6400000, replace_num=100000) [2024-09-11 15:56:19.179667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:19.248324] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041379248320, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 15:56:19.255105] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041379255103, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:56:19.262432] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31752, magic:0x78563412 [2024-09-11 15:56:19.262464] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:19.262470] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:19.318613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:19.318651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:19.318659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:19.318668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:19.379777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:19.518994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:19.519038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:19.519045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:19.519054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:19.579961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:19.664114] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:19.664159] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31766 [2024-09-11 15:56:19.719363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:19.719424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:19.719432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:19.719442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:19.780098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:19.818065] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:19.862701] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31766, magic:0x78563412 [2024-09-11 15:56:19.862746] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:19.862754] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:19.919748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:19.919797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:19.919805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:19.919815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:19.980225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:20.120121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:20.120167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:20.120175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:20.120184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:20.128557] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8361, clean_start_pos=3800000, clean_num=200000) [2024-09-11 15:56:20.153008] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:20.180414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:20.255962] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041380255959, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 15:56:20.262701] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041380262698, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 15:56:20.264367] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:20.264409] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31780 [2024-09-11 15:56:20.328833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:20.328874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:20.328881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:20.328890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:20.380543] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:20.429856] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:20.429923] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=66] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:20.430004] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=40, max_check_version=41, global_version=42) [2024-09-11 15:56:20.432025] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2021 [2024-09-11 15:56:20.432068] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:20.432104] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:56:20.432166] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:56:20.432250] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:20.432358] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 15:56:20.432408] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:56:20.432422] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:56:20.432433] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:56:20.432470] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:56:20.432529] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:56:20.432551] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:56:20.463121] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31780, magic:0x78563412 [2024-09-11 15:56:20.463164] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:20.463173] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:20.529158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:20.529204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:20.529211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:20.529221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:20.580730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:20.729470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:20.729513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:20.729521] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:20.729529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:20.780859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:20.818913] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:20.865123] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:20.865168] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31788 [2024-09-11 15:56:20.929818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:20.929865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:20.929871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:20.929879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:20.980990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:21.063645] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31788, magic:0x78563412 [2024-09-11 15:56:21.063679] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:21.063686] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:21.130190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:21.130237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:21.130266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:21.130276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:21.153166] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=86] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:21.181111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:21.263576] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041381263572, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:56:21.270391] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041381270387, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 15:56:21.330577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:21.330626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:21.330634] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:21.330643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:21.385539] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=6500000, replace_num=100000) [2024-09-11 15:56:21.385577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:21.465440] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:21.465477] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31802 [2024-09-11 15:56:21.530879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:21.530949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:21.530957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:21.530966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:21.585663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:21.664939] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31802, magic:0x78563412 [2024-09-11 15:56:21.664980] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:21.664989] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:21.731294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:21.731339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:21.731347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:21.731356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:21.785782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:21.819742] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:21.931670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:21.931708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:21.931715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:21.931724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:21.985927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:22.067265] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:22.067311] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31814 [2024-09-11 15:56:22.131997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:22.132043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:22.132050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:22.132060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:22.139060] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6986, clean_start_pos=4000000, clean_num=200000) [2024-09-11 15:56:22.153292] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:22.186050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:22.265566] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31814, magic:0x78563412 [2024-09-11 15:56:22.265605] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:22.265611] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:22.271184] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041382271180, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:56:22.277940] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041382277936, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:56:22.339447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:22.339492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:22.339500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:22.339510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:22.339703] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:56:22.386179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:22.539974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:22.540017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:22.540025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:22.540034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:22.586389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:22.666415] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:22.666463] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31818 [2024-09-11 15:56:22.740276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:22.740320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:22.740327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:22.740337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:22.786521] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:22.820636] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:22.864862] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31818, magic:0x78563412 [2024-09-11 15:56:22.864916] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:22.864924] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:22.940586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:22.940632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:22.940640] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:22.940648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:22.986640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:23.140987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:23.141040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:23.141048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:23.141057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:23.153496] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:23.186857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:23.267014] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:23.267062] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31828 [2024-09-11 15:56:23.278884] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041383278881, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007701, add_bytes: 0 [2024-09-11 15:56:23.285628] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041383285624, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 15:56:23.341289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:23.341324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:23.341331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:23.341340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:23.387008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:23.464340] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31828, magic:0x78563412 [2024-09-11 15:56:23.464374] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:23.464383] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:23.541567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:23.541614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:23.541622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:23.541630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:23.591574] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4386, replace_start_pos=6600000, replace_num=100000) [2024-09-11 15:56:23.591617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:23.741857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:23.741888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:23.741934] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:23.741948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:23.791701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:23.821634] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:23.866705] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:23.866762] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31830 [2024-09-11 15:56:23.942198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:23.942243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:23.942251] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:23.942260] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:23.991878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:24.064853] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31830, magic:0x78563412 [2024-09-11 15:56:24.064896] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:24.064935] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:24.142497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:24.142542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:24.142550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:24.142558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:24.149775] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7204, clean_start_pos=4200000, clean_num=200000) [2024-09-11 15:56:24.153635] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:24.192106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:24.286485] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726041384286481, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 15:56:24.293164] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041384293161, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 15:56:24.350054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:24.350093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:24.350110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:24.350124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:24.392245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:24.466641] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:24.466685] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31842 [2024-09-11 15:56:24.550437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:24.550477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:24.550485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:24.550494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:24.592363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:24.665293] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31842, magic:0x78563412 [2024-09-11 15:56:24.665334] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:24.665342] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:24.750793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:24.750839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:24.750847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:24.750857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:24.792479] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:24.822585] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:24.951111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:24.951150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:24.951157] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:24.951180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:24.992658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:25.067873] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:25.067935] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31844 [2024-09-11 15:56:25.151425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:25.151464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:25.151471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:25.151480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:25.153770] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:25.192837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:25.266745] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31844, magic:0x78563412 [2024-09-11 15:56:25.266789] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:25.266798] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:25.294044] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041385294039, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:56:25.300856] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041385300853, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 15:56:25.351713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:25.351760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:25.351767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:25.351803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:25.393026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:25.552060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:25.552101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:25.552109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:25.552119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:25.593204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:25.668283] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:25.668328] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50616 [2024-09-11 15:56:25.752343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:25.752394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:25.752404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:25.752413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:25.797777] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4389, replace_start_pos=6700000, replace_num=100000) [2024-09-11 15:56:25.797823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:25.823622] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:25.866288] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50616, magic:0x78563412 [2024-09-11 15:56:25.866329] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:25.866337] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:25.952647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:25.952689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:25.952696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:25.952706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:25.997979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:26.153043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:26.153078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:26.153086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:26.153095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:26.153973] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:26.161261] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8152, clean_start_pos=4400000, clean_num=200000) [2024-09-11 15:56:26.198103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:26.267968] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:26.268010] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50624 [2024-09-11 15:56:26.301655] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041386301651, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:56:26.308409] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041386308406, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:56:26.361530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:26.361573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:26.361580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:26.361589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:26.361800] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=75, refresh_score_time=61, wash_time=0) [2024-09-11 15:56:26.398228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:26.466622] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50624, magic:0x78563412 [2024-09-11 15:56:26.466665] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:26.466671] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:26.562103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:26.562154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:26.562163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:26.562172] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:26.598386] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:26.762473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:26.762520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:26.762529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:26.762538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:26.798518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:26.824528] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:26.868327] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:26.868373] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50632 [2024-09-11 15:56:26.962773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:26.962816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:26.962825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:26.962835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:26.998634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:27.066949] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50632, magic:0x78563412 [2024-09-11 15:56:27.066976] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:27.067003] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:27.154094] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:27.163133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:27.163170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:27.163178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:27.163188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:27.198754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:27.309343] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041387309340, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 15:56:27.316032] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041387316029, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:56:27.363425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:27.363470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:27.363478] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:27.363487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:27.398927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:27.468947] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:27.468988] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50644 [2024-09-11 15:56:27.563784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:27.563831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:27.563839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:27.563884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:27.599067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:27.667484] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50644, magic:0x78563412 [2024-09-11 15:56:27.667523] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:27.667530] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:27.764271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:27.764316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:27.764324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:27.764333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:27.799190] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:27.825307] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:27.964570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:27.964614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:27.964623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:27.964632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:28.003629] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4319, replace_start_pos=6800000, replace_num=100000) [2024-09-11 15:56:28.003667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:28.069954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:28.069984] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50652 [2024-09-11 15:56:28.154227] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:28.164858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:28.164918] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:28.164927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:28.164950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:28.172942] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7977, clean_start_pos=4600000, clean_num=200000) [2024-09-11 15:56:28.203759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:28.268143] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50652, magic:0x78563412 [2024-09-11 15:56:28.268184] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:28.268191] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:28.316960] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041388316955, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:56:28.323648] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041388323644, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:56:28.373203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:28.373248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:28.373257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:28.373267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:28.403893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:28.573494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:28.573540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:28.573546] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:28.573555] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:28.604035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:28.670006] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:28.670051] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50662 [2024-09-11 15:56:28.773792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:28.773829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:28.773836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:28.773845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:28.804220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:28.826439] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:28.868501] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50662, magic:0x78563412 [2024-09-11 15:56:28.868542] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:28.868550] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:28.974064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:28.974109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:28.974116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:28.974124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:29.004411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:29.154423] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:29.174345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:29.174384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:29.174390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:29.174398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:29.204600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:29.269949] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:29.269992] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50672 [2024-09-11 15:56:29.324487] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041389324483, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007528, add_bytes: 0 [2024-09-11 15:56:29.331249] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041389331248, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:56:29.374620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:29.374664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:29.374672] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:29.374682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:29.404797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:29.467839] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50672, magic:0x78563412 [2024-09-11 15:56:29.467881] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:29.467889] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:29.574931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:29.574976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:29.574982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:29.574991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:29.604978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:29.775237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:29.775278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:29.775305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:29.775314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:29.805115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:29.827656] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:29.870083] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:29.870127] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50674 [2024-09-11 15:56:29.975556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:29.975600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:29.975608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:29.975617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:30.005231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:30.068381] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50674, magic:0x78563412 [2024-09-11 15:56:30.068422] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:30.068430] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:30.154604] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:30.175953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:30.175999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:30.176007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:30.176017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:30.184466] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8435, clean_start_pos=4800000, clean_num=200000) [2024-09-11 15:56:30.209736] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4328, replace_start_pos=6900000, replace_num=100000) [2024-09-11 15:56:30.209785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:30.332119] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041390332115, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 15:56:30.338872] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726041390338869, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:56:30.384787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:30.384833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:30.384841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:30.384850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:30.409951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:30.446388] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:30.446441] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:30.446525] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=41, max_check_version=42, global_version=43) [2024-09-11 15:56:30.448530] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2004 [2024-09-11 15:56:30.448569] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:30.448604] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:56:30.448659] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:56:30.448748] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:30.448856] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:56:30.448924] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:56:30.448941] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:56:30.448952] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:56:30.448989] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:56:30.449049] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:56:30.449071] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:56:30.470596] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:30.470642] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50688 [2024-09-11 15:56:30.585102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:30.585171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:30.585179] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:30.585188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:30.610144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:30.669008] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50688, magic:0x78563412 [2024-09-11 15:56:30.669048] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:30.669056] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:30.785490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:30.785533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:30.785542] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:30.785552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:30.810337] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:30.829058] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:30.985850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:30.985894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:30.985922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:30.985933] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:31.010476] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:31.070653] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:31.070692] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50702 [2024-09-11 15:56:31.154827] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:31.186151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:31.186193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:31.186215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:31.186222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:31.210659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:31.269272] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50702, magic:0x78563412 [2024-09-11 15:56:31.269313] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:31.269320] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:31.339726] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041391339723, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:56:31.346482] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041391346478, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:56:31.386523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:31.386560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:31.386568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:31.386578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:31.410848] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:31.586936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:31.586980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:31.586987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:31.586996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:31.611044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:31.671700] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:31.671744] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50712 [2024-09-11 15:56:31.787297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:31.787344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:31.787352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:31.787362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:31.811255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:31.830573] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:31.868825] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50712, magic:0x78563412 [2024-09-11 15:56:31.868870] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:31.868877] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:31.987672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:31.987720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:31.987728] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:31.987738] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:32.011444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:32.154954] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:32.188065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:32.188114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:32.188123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:32.188133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:32.196407] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8259, clean_start_pos=5000000, clean_num=200000) [2024-09-11 15:56:32.211588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:32.270764] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:32.270807] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50714 [2024-09-11 15:56:32.347336] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041392347332, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:56:32.354099] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041392354097, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:56:32.396734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:32.396780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:32.396786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:32.396794] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:32.416136] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4392, replace_start_pos=7000000, replace_num=100000) [2024-09-11 15:56:32.416185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:32.469274] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50714, magic:0x78563412 [2024-09-11 15:56:32.469313] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:32.469320] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:32.597092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:32.597137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:32.597145] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:32.597154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:32.616287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:32.797503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:32.797548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:32.797556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:32.797566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:32.819716] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3329] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:32.831847] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:32.872973] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:32.873018] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50726 [2024-09-11 15:56:32.997810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:32.997854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:32.997862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:32.997871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:33.019860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:33.069946] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50726, magic:0x78563412 [2024-09-11 15:56:33.069987] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:33.069995] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:33.155106] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:33.198174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:33.198231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:33.198247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:33.198258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:33.220067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:33.354979] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041393354974, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007642, add_bytes: 0 [2024-09-11 15:56:33.361712] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726041393361709, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:56:33.398490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:33.398534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:33.398541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:33.398551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:33.420264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:33.471612] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:33.471651] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50734 [2024-09-11 15:56:33.598791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:33.598833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:33.598841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:33.598851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:33.620458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:33.670194] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50734, magic:0x78563412 [2024-09-11 15:56:33.670237] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:33.670245] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:33.799147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:33.799191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:33.799199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:33.799224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:33.820651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:33.833139] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:33.999520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:33.999567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:33.999592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:33.999603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:34.020862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:34.072124] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:34.072168] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50750 [2024-09-11 15:56:34.155274] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:34.199898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:34.199963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:34.199971] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:34.199981] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:34.208363] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8369, clean_start_pos=5200000, clean_num=200000) [2024-09-11 15:56:34.221016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:34.270500] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50750, magic:0x78563412 [2024-09-11 15:56:34.270538] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:34.270549] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:34.362630] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1726041394362626, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007652, add_bytes: 0 [2024-09-11 15:56:34.369477] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041394369473, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007764, add_bytes: 0 [2024-09-11 15:56:34.408695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:34.408758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:34.408768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:34.408778] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:34.421204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:34.609127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:34.609168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:34.609175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:34.609185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:34.625784] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4388, replace_start_pos=7100000, replace_num=100000) [2024-09-11 15:56:34.625833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:34.672991] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:34.673033] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50758 [2024-09-11 15:56:34.809405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:34.809442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:34.809448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:34.809455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:34.825939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:34.834190] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:34.871050] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50758, magic:0x78563412 [2024-09-11 15:56:34.871087] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:34.871094] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:35.009693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:35.009750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:35.009776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:35.009785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:35.026081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:35.155483] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:35.210055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:35.210101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:35.210108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:35.210117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:35.226215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:35.273341] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:35.273383] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50774 [2024-09-11 15:56:35.370187] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041395370184, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:56:35.376948] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041395376944, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007471, add_bytes: 0 [2024-09-11 15:56:35.410353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:35.410398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:35.410406] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:35.410415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:35.426361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:35.471785] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50774, magic:0x78563412 [2024-09-11 15:56:35.471826] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:35.471833] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:35.610650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:35.610694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:35.610702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:35.610712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:35.626626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:35.811038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:35.811086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:35.811094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:35.811103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:35.826815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:35.835238] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:35.874204] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:35.874248] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5690 [2024-09-11 15:56:36.011434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:36.011480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:36.011488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:36.011498] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:36.026959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:36.072553] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5690, magic:0x78563412 [2024-09-11 15:56:36.072590] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:36.072611] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:36.155687] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:36.211822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:36.211867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:36.211875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:36.211885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:36.220469] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8570, clean_start_pos=5400000, clean_num=200000) [2024-09-11 15:56:36.227094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:36.377868] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041396377864, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 15:56:36.384630] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041396384627, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 15:56:36.420803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:36.420849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:36.420857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:36.420866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:36.427233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:36.474321] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:36.474365] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5706 [2024-09-11 15:56:36.621110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:36.621178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:36.621186] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:36.621195] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:36.627422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:36.672952] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5706, magic:0x78563412 [2024-09-11 15:56:36.672982] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:36.672990] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:36.821427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:36.821462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:36.821469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:36.821478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:36.831937] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4387, replace_start_pos=7200000, replace_num=100000) [2024-09-11 15:56:36.831970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:36.836225] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:37.021788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:37.021835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:37.021843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:37.021853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:37.032062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:37.074898] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:37.074951] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5722 [2024-09-11 15:56:37.155816] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:37.222158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:37.222202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:37.222231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:37.222241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:37.232178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:37.273462] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5722, magic:0x78563412 [2024-09-11 15:56:37.273489] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:37.273496] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:37.385458] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041397385452, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007588, add_bytes: 0 [2024-09-11 15:56:37.392191] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041397392187, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 15:56:37.422540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:37.422584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:37.422592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:37.422602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:37.432302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:37.622936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:37.622981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:37.622989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:37.622998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:37.632417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:37.675268] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:37.675301] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5728 [2024-09-11 15:56:37.823259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:37.823302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:37.823310] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:37.823319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:37.832537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:37.874016] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5728, magic:0x78563412 [2024-09-11 15:56:37.874040] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:37.874046] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:37.937117] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:38.023619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:38.023664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:38.023673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:38.023682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:38.032672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:38.155939] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:38.223938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:38.223994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:38.224007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:38.224017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:38.231333] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7301, clean_start_pos=5600000, clean_num=200000) [2024-09-11 15:56:38.232864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:38.275729] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:38.275772] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5744 [2024-09-11 15:56:38.393038] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=137] PNIO [ratelimit] time: 1726041398393035, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007583, add_bytes: 0 [2024-09-11 15:56:38.399878] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041398399865, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:56:38.431674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:38.431717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:38.431725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:38.431735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:38.432993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:38.474292] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5744, magic:0x78563412 [2024-09-11 15:56:38.474320] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:38.474327] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:38.632060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:38.632104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:38.632112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:38.632122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:38.633099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:38.832351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:38.832385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:38.832393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:38.832402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:38.833282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:38.876195] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:38.876240] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5748 [2024-09-11 15:56:38.938192] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:39.032709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:39.032755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:39.032763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:39.032772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:39.037833] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4366, replace_start_pos=7300000, replace_num=100000) [2024-09-11 15:56:39.037882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:39.075220] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5748, magic:0x78563412 [2024-09-11 15:56:39.075271] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:39.075280] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:39.156123] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:39.233071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:39.233116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:39.233123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:39.233134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:39.237979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:39.400723] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041399400717, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:56:39.407432] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726041399407428, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 15:56:39.433456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:39.433495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:39.433502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:39.433511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:39.438148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:39.477277] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:39.477321] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5758 [2024-09-11 15:56:39.633823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:39.633867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:39.633875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:39.633884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:39.638263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:39.675745] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5758, magic:0x78563412 [2024-09-11 15:56:39.675786] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:39.675793] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:39.834182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:39.834226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:39.834258] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:39.834269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:39.838391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:39.939100] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:40.034576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:40.034643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:40.034652] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:40.034662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:40.038515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:40.077738] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:40.077781] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5770 [2024-09-11 15:56:40.156307] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:40.235060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:40.235103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:40.235112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:40.235122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:40.238642] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:40.242058] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6924, clean_start_pos=5800000, clean_num=200000) [2024-09-11 15:56:40.276141] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5770, magic:0x78563412 [2024-09-11 15:56:40.276180] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:40.276188] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:40.408279] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726041400408274, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 15:56:40.415023] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041400415019, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007591, add_bytes: 0 [2024-09-11 15:56:40.438817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:40.442375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:40.442409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:40.442417] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:40.442427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:40.465330] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:40.465383] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:40.465465] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=42, max_check_version=43, global_version=44) [2024-09-11 15:56:40.467520] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2054 [2024-09-11 15:56:40.467558] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:40.467593] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:56:40.467652] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:56:40.467736] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:40.467843] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:56:40.467895] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:56:40.467923] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:56:40.467935] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:56:40.467973] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:56:40.468033] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:56:40.468054] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:56:40.638993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:40.642712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:40.642744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:40.642751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:40.642772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:40.678386] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:40.678430] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5782 [2024-09-11 15:56:40.839122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:40.843013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:40.843045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:40.843051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:40.843058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:40.876805] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5782, magic:0x78563412 [2024-09-11 15:56:40.876845] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:40.876851] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:40.939921] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:41.039304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:41.043368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:41.043394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:41.043403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:41.043412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:41.156456] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:41.243709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:41.243753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:41.243760] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:41.243770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:41.243885] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4389, replace_start_pos=7400000, replace_num=100000) [2024-09-11 15:56:41.243955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:41.279300] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:41.279344] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5796 [2024-09-11 15:56:41.415883] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041401415879, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:56:41.422747] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726041401422745, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007726, add_bytes: 0 [2024-09-11 15:56:41.444032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:41.444055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:41.444070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:41.444084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:41.444094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:41.477586] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5796, magic:0x78563412 [2024-09-11 15:56:41.477629] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:41.477637] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:41.644176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:41.644338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:41.644371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:41.644378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:41.644387] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:41.844313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:41.844638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:41.844669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:41.844677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:41.844686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:41.879585] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:41.879630] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5804 [2024-09-11 15:56:41.940920] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:42.044499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:42.045010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:42.045040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:42.045047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:42.045056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:42.078119] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5804, magic:0x78563412 [2024-09-11 15:56:42.078161] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:42.078168] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:42.156558] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:42.244638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:42.245369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:42.245403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:42.245411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:42.245420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:42.253158] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7724, clean_start_pos=6000000, clean_num=200000) [2024-09-11 15:56:42.423497] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1726041402423492, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:56:42.430260] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726041402430258, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007513, add_bytes: 0 [2024-09-11 15:56:42.444764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:42.453450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:42.453489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:42.453499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:42.453511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:42.479635] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:42.479679] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5816 [2024-09-11 15:56:42.644883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:42.653786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:42.653829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:42.653840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:42.653854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:42.678301] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5816, magic:0x78563412 [2024-09-11 15:56:42.678339] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:42.678347] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:42.845089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:42.854159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:42.854222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:42.854230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:42.854239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:42.941820] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:43.045229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:43.054547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:43.054586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:43.054594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:43.054603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:43.080781] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:43.080835] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5820 [2024-09-11 15:56:43.156678] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:43.245384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:43.254925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:43.254966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:43.254974] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:43.254984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:43.278945] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5820, magic:0x78563412 [2024-09-11 15:56:43.278982] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:43.278990] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:43.431181] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041403431177, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 15:56:43.437884] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726041403437880, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:56:43.449892] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4377, replace_start_pos=7500000, replace_num=100000) [2024-09-11 15:56:43.449960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:43.455201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:43.455233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:43.455239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:43.455246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:43.650120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:43.655468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:43.655508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:43.655514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:43.655521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:43.680812] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:43.680853] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5826 [2024-09-11 15:56:43.850242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:43.855809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:43.855831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:43.855837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:43.855845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:43.879277] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5826, magic:0x78563412 [2024-09-11 15:56:43.879337] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:43.879346] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:43.942857] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:44.050381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:44.056152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:44.056215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:44.056226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:44.056237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:44.156857] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:44.250500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:44.256534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:44.256572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:44.256580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:44.256591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:44.265160] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8555, clean_start_pos=6200000, clean_num=200000) [2024-09-11 15:56:44.281212] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:44.281246] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5834 [2024-09-11 15:56:44.438797] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041404438793, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:56:44.445554] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041404445550, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 15:56:44.450678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:44.465398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:44.465438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:44.465444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:44.465472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:44.479795] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5834, magic:0x78563412 [2024-09-11 15:56:44.479834] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:44.479842] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:44.650884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:44.665683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:44.665731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:44.665737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:44.665745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:44.851050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:44.866018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:44.866070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:44.866077] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:44.866087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:44.881929] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:44.881973] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5838 [2024-09-11 15:56:44.943881] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:45.051235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:45.066326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:45.066375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:45.066383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:45.066392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:45.080574] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5838, magic:0x78563412 [2024-09-11 15:56:45.080628] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:45.080635] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:45.157070] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:45.251423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:45.266638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:45.266677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:45.266685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:45.266694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:45.446415] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041405446411, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:56:45.451611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:45.453105] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041405453103, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:56:45.467005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:45.467046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:45.467053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:45.467062] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:45.482579] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:45.482609] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47652 [2024-09-11 15:56:45.656129] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4344, replace_start_pos=7600000, replace_num=100000) [2024-09-11 15:56:45.656195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:45.667270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:45.667307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:45.667314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:45.667321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:45.681006] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47652, magic:0x78563412 [2024-09-11 15:56:45.681045] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:45.681054] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:45.856296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:45.867549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:45.867590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:45.867597] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:45.867608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:45.945159] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:46.056440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:46.067814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:46.067851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:46.067858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:46.067865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:46.082668] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:46.082710] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47654 [2024-09-11 15:56:46.157279] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:46.256574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:46.268090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:46.268151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:46.268159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:46.268168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:46.275488] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7307, clean_start_pos=6400000, clean_num=200000) [2024-09-11 15:56:46.281207] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47654, magic:0x78563412 [2024-09-11 15:56:46.281242] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:46.281249] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:46.454031] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041406454027, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:56:46.456694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:46.460728] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041406460725, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:56:46.475762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:46.475807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:46.475815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:46.475825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:46.656798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:46.676054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:46.676095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:46.676115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:46.676124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:46.676304] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=87, refresh_score_time=60, wash_time=0) [2024-09-11 15:56:46.683532] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:46.683566] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47662 [2024-09-11 15:56:46.857012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:46.876535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:46.876586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:46.876594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:46.876605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:46.881780] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47662, magic:0x78563412 [2024-09-11 15:56:46.881814] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:46.881822] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:46.946188] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:47.057195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:47.076838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:47.076874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:47.076881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:47.076888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:47.157460] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:47.257318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:47.277129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:47.277172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:47.277178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:47.277200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:47.284040] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:47.284075] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47668 [2024-09-11 15:56:47.457432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:47.461578] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041407461575, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:56:47.468404] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041407468401, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 15:56:47.477439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:47.477480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:47.477487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:47.477497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:47.482351] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47668, magic:0x78563412 [2024-09-11 15:56:47.482386] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:47.482394] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:47.657540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:47.677699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:47.677745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:47.677754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:47.677765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:47.862006] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4337, replace_start_pos=7700000, replace_num=100000) [2024-09-11 15:56:47.862053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:47.878019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:47.878061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:47.878067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:47.878075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:47.884144] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:47.884181] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47680 [2024-09-11 15:56:47.946920] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:48.062137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:48.078310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:48.078355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:48.078363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:48.078371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:48.082591] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47680, magic:0x78563412 [2024-09-11 15:56:48.082631] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:48.082640] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:48.157655] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:48.262321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:48.278608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:48.278656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:48.278664] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:48.278673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:48.286178] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7474, clean_start_pos=6600000, clean_num=200000) [2024-09-11 15:56:48.462448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:48.469304] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726041408469301, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007726, add_bytes: 0 [2024-09-11 15:56:48.476021] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041408476019, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:56:48.485020] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:48.485054] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47684 [2024-09-11 15:56:48.486448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:48.486483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:48.486490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:48.486500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:48.662627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:48.683038] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47684, magic:0x78563412 [2024-09-11 15:56:48.683081] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:48.683088] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:48.686714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:48.686747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:48.686753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:48.686761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:48.862764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:48.887028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:48.887073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:48.887081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:48.887090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:48.947703] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:49.062952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:49.084791] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:49.084828] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47690 [2024-09-11 15:56:49.087294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:49.087325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:49.087332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:49.087339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:49.157781] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:49.263073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:49.283667] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47690, magic:0x78563412 [2024-09-11 15:56:49.283704] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:49.283711] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:49.287588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:49.287634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:49.287641] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:49.287651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:49.463195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:49.476924] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041409476919, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:56:49.483582] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041409483579, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 15:56:49.487871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:49.487922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:49.487930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:49.487937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:49.663395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:49.685577] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:49.685618] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47704 [2024-09-11 15:56:49.688176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:49.688211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:49.688219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:49.688228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:49.863518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:49.884078] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47704, magic:0x78563412 [2024-09-11 15:56:49.884121] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:49.884129] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:49.888571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:49.888607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:49.888634] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:49.888641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:49.948462] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:50.068112] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4408, replace_start_pos=7800000, replace_num=100000) [2024-09-11 15:56:50.068179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:50.088853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:50.088895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:50.088918] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:50.088927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:50.157920] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:50.268353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:50.285729] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:50.285768] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47708 [2024-09-11 15:56:50.289156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:50.289197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:50.289205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:50.289214] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:50.297689] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8460, clean_start_pos=6800000, clean_num=200000) [2024-09-11 15:56:50.468483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:50.481002] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:50.481055] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:56:50.481137] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=43, max_check_version=44, global_version=45) [2024-09-11 15:56:50.483231] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2093 [2024-09-11 15:56:50.483271] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:50.483308] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:56:50.483346] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:56:50.483432] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:56:50.483552] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:56:50.483603] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:56:50.483614] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:56:50.483625] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:56:50.483663] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:56:50.483728] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:56:50.483749] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:56:50.484451] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47708, magic:0x78563412 [2024-09-11 15:56:50.484454] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041410484453, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 15:56:50.484485] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:50.484496] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:50.491193] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041410491189, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:56:50.497971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:50.498000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:50.498008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:50.498017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:50.668666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:50.698246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:50.698282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:50.698289] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:50.698318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:50.868857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:50.886458] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:50.886500] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47712 [2024-09-11 15:56:50.898562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:50.898602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:50.898609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:50.898618] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:50.949314] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:51.069006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:51.085071] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47712, magic:0x78563412 [2024-09-11 15:56:51.085110] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:51.085116] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:51.098981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:51.099034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:51.099042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:51.099052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:51.158069] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:51.269124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:51.299255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:51.299297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:51.299303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:51.299311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:51.469256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:51.486793] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:51.486837] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47722 [2024-09-11 15:56:51.492045] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041411492042, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007589, add_bytes: 0 [2024-09-11 15:56:51.498818] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041411498813, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:56:51.499557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:51.499586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:51.499593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:51.499602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:51.669382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:51.685310] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47722, magic:0x78563412 [2024-09-11 15:56:51.685349] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:51.685356] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:51.699814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:51.699858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:51.699864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:51.699872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:51.869504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:51.900102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:51.900145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:51.900153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:51.900163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:51.950150] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:52.069702] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:52.087240] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:52.087286] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47730 [2024-09-11 15:56:52.100379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:52.100418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:52.100424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:52.100432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:52.158245] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:52.274364] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4428, replace_start_pos=7900000, replace_num=100000) [2024-09-11 15:56:52.274413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:52.285960] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47730, magic:0x78563412 [2024-09-11 15:56:52.286002] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:52.286010] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:52.300643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:52.300691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:52.300698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:52.300706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:52.307455] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6737, clean_start_pos=7000000, clean_num=200000) [2024-09-11 15:56:52.474573] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:52.499723] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041412499719, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 15:56:52.506488] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041412506485, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:56:52.507753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:52.507785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:52.507793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:52.507802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:52.508024] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:56:52.674784] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:52.687610] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:52.687656] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47740 [2024-09-11 15:56:52.708288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:52.708346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:52.708359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:52.708369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:52.874968] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:52.886128] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47740, magic:0x78563412 [2024-09-11 15:56:52.886185] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:52.886194] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:52.908592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:52.908641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:52.908648] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:52.908655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:52.950942] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:53.075115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:53.108896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:53.108970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:53.108978] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:53.108987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:53.158371] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:53.275264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:53.288312] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:53.288373] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47746 [2024-09-11 15:56:53.309274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:53.309315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:53.309321] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:53.309329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:53.475406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:53.486722] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47746, magic:0x78563412 [2024-09-11 15:56:53.486763] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:53.486770] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:53.507292] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041413507287, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 15:56:53.509566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:53.509618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:53.509629] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:53.509639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:53.514041] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041413514038, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:56:53.675597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:53.709874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:53.709937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:53.709945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:53.709954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:53.875786] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:53.888758] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:53.888802] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47750 [2024-09-11 15:56:53.910178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:53.910224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:53.910230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:53.910238] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:53.951856] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:54.075983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:54.087011] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47750, magic:0x78563412 [2024-09-11 15:56:54.087046] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:54.087052] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:54.110471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:54.110531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:54.110540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:54.110550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:54.158488] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:54.276196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:54.310758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:54.310796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:54.310803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:54.310811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:54.317405] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6582, clean_start_pos=7200000, clean_num=200000) [2024-09-11 15:56:54.480055] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3716, replace_start_pos=8000000, replace_num=100000) [2024-09-11 15:56:54.480100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:54.489199] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:54.489243] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47762 [2024-09-11 15:56:54.514889] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041414514886, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 15:56:54.517689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:54.517725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:54.517746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:54.517754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:54.521664] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041414521661, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:56:54.680249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:54.687550] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47762, magic:0x78563412 [2024-09-11 15:56:54.687588] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:54.687596] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:54.718004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:54.718048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:54.718056] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:54.718065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:54.880475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:54.918309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:54.918355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:54.918362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:54.918371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:54.952671] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:55.080603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:55.089322] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:55.089366] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47770 [2024-09-11 15:56:55.118581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:55.118621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:55.118627] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:55.118650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:55.158634] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:55.280723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:55.287683] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47770, magic:0x78563412 [2024-09-11 15:56:55.287714] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:55.287720] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:55.318862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:55.318929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:55.318941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:55.318949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:55.480895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:55.519176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:55.519220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:55.519228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:55.519236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:55.522569] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726041415522566, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 15:56:55.529282] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041415529280, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:56:55.681039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:55.689008] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:55.689046] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2740 [2024-09-11 15:56:55.719442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:55.719485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:55.719491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:55.719498] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:55.881243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:55.887278] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2740, magic:0x78563412 [2024-09-11 15:56:55.887318] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:55.887326] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:55.919701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:55.919746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:55.919752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:55.919760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:55.953414] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:56.081445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:56.120018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:56.120062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:56.120069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:56.120079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:56.159124] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:56.281639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:56.289188] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:56.289229] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2750 [2024-09-11 15:56:56.320311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:56.320353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:56.320360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:56.320370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:56.328610] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8226, clean_start_pos=7400000, clean_num=200000) [2024-09-11 15:56:56.481763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:56.487531] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2750, magic:0x78563412 [2024-09-11 15:56:56.487566] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:56.487574] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:56.528852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:56.528894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:56.528920] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:56.528928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:56.530183] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041416530180, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:56:56.536996] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041416536993, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007713, add_bytes: 0 [2024-09-11 15:56:56.686316] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4369, replace_start_pos=8100000, replace_num=100000) [2024-09-11 15:56:56.686366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:56.729137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:56.729177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:56.729183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:56.729192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:56.886528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:56.889560] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:56.889589] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2766 [2024-09-11 15:56:56.929417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:56.929464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:56.929473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:56.929483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:56.954425] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:57.086710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:57.087879] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2766, magic:0x78563412 [2024-09-11 15:56:57.087924] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:57.087933] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:57.129704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:57.129747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:57.129753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:57.129764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:57.159256] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:57.286832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:57.329997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:57.330040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:57.330063] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:57.330071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:57.487019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:57.490091] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:57.490126] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2772 [2024-09-11 15:56:57.530299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:57.530345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:57.530353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:57.530362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:57.537742] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041417537739, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 15:56:57.544520] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041417544516, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007523, add_bytes: 0 [2024-09-11 15:56:57.687205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:57.688510] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2772, magic:0x78563412 [2024-09-11 15:56:57.688542] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:57.688549] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:57.730591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:57.730627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:57.730634] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:57.730653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:57.887335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:56:57.930874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:57.930936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:57.930945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:57.930955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:57.955431] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:58.087471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:56:58.090412] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:58.090445] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2780 [2024-09-11 15:56:58.131193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:58.131241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:58.131248] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:58.131258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:58.159368] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:58.287645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:56:58.288831] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2780, magic:0x78563412 [2024-09-11 15:56:58.288869] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:58.288883] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:58.331491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:58.331537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:58.331544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:58.331553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:58.338143] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6553, clean_start_pos=7600000, clean_num=200000) [2024-09-11 15:56:58.487827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:56:58.538397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:58.538437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:58.538443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:58.538451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:58.545357] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041418545354, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:56:58.552178] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041418552174, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007658, add_bytes: 0 [2024-09-11 15:56:58.687954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:56:58.690947] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:58.690978] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2794 [2024-09-11 15:56:58.738679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:58.738723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:58.738730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:58.738737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:58.889506] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2794, magic:0x78563412 [2024-09-11 15:56:58.889552] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:58.889562] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:58.892574] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4428, replace_start_pos=8200000, replace_num=100000) [2024-09-11 15:56:58.892615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:56:58.939029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:58.939070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:58.939077] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:58.939084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:58.956487] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:56:59.092704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:56:59.139288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:59.139329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:59.139336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:59.139343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:59.159560] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:56:59.291152] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:59.291192] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2796 [2024-09-11 15:56:59.292821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:56:59.339564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:59.339609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:59.339616] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:59.339625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:59.489844] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2796, magic:0x78563412 [2024-09-11 15:56:59.489884] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:56:59.489892] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:56:59.492923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:56:59.539853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:59.539930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:59.539939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:59.539949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:59.553033] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041419553029, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 15:56:59.559794] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041419559792, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:56:59.693030] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:56:59.740176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:59.740227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:59.740237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:59.740247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:59.891928] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:56:59.891973] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2810 [2024-09-11 15:56:59.893147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:56:59.940473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:56:59.940521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:56:59.940527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:56:59.940534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:56:59.957708] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:00.090221] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2810, magic:0x78563412 [2024-09-11 15:57:00.090265] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:00.090272] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:00.093252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:00.140785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:00.140822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:00.140829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:00.140839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:00.159673] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:00.293362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:00.341065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:00.341111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:00.341119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:00.341128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:00.348792] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7650, clean_start_pos=7800000, clean_num=200000) [2024-09-11 15:57:00.492407] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:00.492446] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2818 [2024-09-11 15:57:00.493482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:00.498125] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:00.498158] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:00.498237] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=44, max_check_version=45, global_version=46) [2024-09-11 15:57:00.500261] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2024 [2024-09-11 15:57:00.500293] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:00.500327] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:57:00.500366] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:57:00.500450] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:00.500569] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:57:00.500623] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:57:00.500635] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:57:00.500646] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:57:00.500682] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:57:00.500746] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:57:00.500770] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:57:00.546522] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 15:57:00.549049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:00.549075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:00.549082] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:00.549091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:00.560651] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041420560648, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:57:00.560687] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 15:57:00.565022] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 15:57:00.567353] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041420567351, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 15:57:00.567387] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:57:00.690641] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2818, magic:0x78563412 [2024-09-11 15:57:00.690682] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:00.690690] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:00.693591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:00.749319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:00.749363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:00.749369] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:00.749377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:00.893699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:00.949590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:00.949634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:00.949641] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:00.949648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:00.958833] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:01.091640] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:01.091680] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2826 [2024-09-11 15:57:01.098245] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4421, replace_start_pos=8300000, replace_num=100000) [2024-09-11 15:57:01.098288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:01.149870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:01.149940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:01.149949] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:01.149958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:01.159815] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:01.289956] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2826, magic:0x78563412 [2024-09-11 15:57:01.289997] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:01.290004] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:01.298440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:01.350179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:01.350222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:01.350228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:01.350235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:01.498620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:01.550464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:01.550508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:01.550515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:01.550524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:01.568199] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726041421568193, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 15:57:01.575029] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726041421575025, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 15:57:01.692069] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:01.692113] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2830 [2024-09-11 15:57:01.698748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:01.750757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:01.750799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:01.750807] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:01.750837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:01.890428] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2830, magic:0x78563412 [2024-09-11 15:57:01.890480] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:01.890487] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:01.898956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:01.951049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:01.951093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:01.951099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:01.951107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:01.959727] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:02.099126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:02.151335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:02.151379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:02.151387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:02.151396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:02.159986] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:02.292893] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:02.292957] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2844 [2024-09-11 15:57:02.299312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:02.351627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:02.351675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:02.351682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:02.351691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:02.361409] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9681, clean_start_pos=8000000, clean_num=200000) [2024-09-11 15:57:02.490936] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2844, magic:0x78563412 [2024-09-11 15:57:02.490976] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:02.490985] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:02.499488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:02.561673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:02.561714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:02.561722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:02.561730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:02.575828] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041422575824, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:57:02.582581] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041422582579, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 15:57:02.699695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:02.761957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:02.761999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:02.762005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:02.762013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:02.893061] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:02.893106] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2854 [2024-09-11 15:57:02.899821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:02.960891] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:02.962246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:02.962276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:02.962284] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:02.962292] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:03.091318] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2854, magic:0x78563412 [2024-09-11 15:57:03.091355] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:03.091363] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:03.100007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:03.160112] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:03.162538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:03.162568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:03.162576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:03.162584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:03.304516] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4338, replace_start_pos=8400000, replace_num=100000) [2024-09-11 15:57:03.304568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:03.362801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:03.362851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:03.362858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:03.362866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:03.494189] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:03.494234] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2864 [2024-09-11 15:57:03.504732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:03.563106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:03.563160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:03.563168] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:03.563177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:03.583439] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041423583433, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:57:03.590257] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041423590253, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 15:57:03.692568] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2864, magic:0x78563412 [2024-09-11 15:57:03.692609] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:03.692617] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:03.704929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:03.763409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:03.763458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:03.763465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:03.763475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:03.905110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:03.962191] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:03.963715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:03.963750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:03.963757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:03.963766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:04.094408] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:04.094451] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2872 [2024-09-11 15:57:04.105234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:04.160300] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:04.164023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:04.164063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:04.164070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:04.164077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:04.292808] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2872, magic:0x78563412 [2024-09-11 15:57:04.292847] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:04.292854] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:04.305369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:04.364279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:04.364320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:04.364327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:04.364334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:04.371135] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6789, clean_start_pos=8200000, clean_num=200000) [2024-09-11 15:57:04.505548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:04.571387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:04.571424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:04.571431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:04.571456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:04.591067] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041424591063, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:57:04.597817] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041424597813, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 15:57:04.694653] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:04.694703] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2886 [2024-09-11 15:57:04.705674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:04.771656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:04.771698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:04.771704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:04.771712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:04.893336] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2886, magic:0x78563412 [2024-09-11 15:57:04.893379] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:04.893386] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:04.905848] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:04.963503] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:04.971955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:04.971994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:04.972001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:04.972010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:05.105973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:05.160482] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:05.172217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:05.172257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:05.172291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:05.172299] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:05.294381] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:05.294438] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2898 [2024-09-11 15:57:05.306161] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:05.372517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:05.372567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:05.372575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:05.372583] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:05.492810] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2898, magic:0x78563412 [2024-09-11 15:57:05.492844] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:05.492852] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:05.510586] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4301, replace_start_pos=8500000, replace_num=100000) [2024-09-11 15:57:05.510636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:05.572818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:05.572869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:05.572876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:05.572885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:05.598861] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041425598857, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007794, add_bytes: 0 [2024-09-11 15:57:05.605491] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041425605487, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 15:57:05.710716] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:05.773986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:05.774028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:05.774034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:05.774042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:05.895247] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:05.895292] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7044 [2024-09-11 15:57:05.910831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:05.964587] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:05.974334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:05.974377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:05.974386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:05.974395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:06.093169] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7044, magic:0x78563412 [2024-09-11 15:57:06.093212] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:06.093219] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:06.110939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:06.160627] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:06.174617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:06.174662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:06.174667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:06.174675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:06.311045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:06.374893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:06.374948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:06.374954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:06.374961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:06.381766] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6792, clean_start_pos=8400000, clean_num=200000) [2024-09-11 15:57:06.495450] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:06.495496] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7054 [2024-09-11 15:57:06.511164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:06.582024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:06.582070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:06.582076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:06.582084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:06.606300] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726041426606296, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007439, add_bytes: 0 [2024-09-11 15:57:06.613122] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041426613117, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:57:06.693522] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7054, magic:0x78563412 [2024-09-11 15:57:06.693563] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:06.693587] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:06.711349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:06.782300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:06.782345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:06.782363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:06.782376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:06.911538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:06.965603] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:06.982592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:06.982639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:06.982648] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:06.982660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:06.982836] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=85, refresh_score_time=57, wash_time=0) [2024-09-11 15:57:07.095781] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:07.095827] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7062 [2024-09-11 15:57:07.111732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:07.160744] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:07.183067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:07.183114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:07.183130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:07.183143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:07.294008] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7062, magic:0x78563412 [2024-09-11 15:57:07.294046] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:07.294055] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:07.311944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:07.383349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:07.383392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:07.383398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:07.383406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:07.512072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:07.583629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:07.583676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:07.583684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:07.583693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:07.613972] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041427613968, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:57:07.620678] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041427620675, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:57:07.695895] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:07.695970] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=70] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7070 [2024-09-11 15:57:07.716675] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4417, replace_start_pos=8600000, replace_num=100000) [2024-09-11 15:57:07.716725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:07.783933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:07.783983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:07.784013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:07.784021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:07.894371] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7070, magic:0x78563412 [2024-09-11 15:57:07.894413] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:07.894420] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:07.916811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:07.966595] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:07.984253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:07.984300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:07.984308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:07.984317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:08.116935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:08.160858] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:08.184616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:08.184661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:08.184668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:08.184676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:08.296788] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:08.296832] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7082 [2024-09-11 15:57:08.317056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:08.384894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:08.384963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:08.384969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:08.384997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:08.396072] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=11061, clean_start_pos=8600000, clean_num=200000) [2024-09-11 15:57:08.494871] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7082, magic:0x78563412 [2024-09-11 15:57:08.494923] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:08.494931] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:08.517160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:08.596341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:08.596379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:08.596386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:08.596395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:08.621595] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041428621590, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:57:08.628288] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041428628284, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:57:08.717256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:08.796612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:08.796646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:08.796652] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:08.796660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:08.895944] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:08.895983] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7088 [2024-09-11 15:57:08.917364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:08.967770] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:08.997016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:08.997070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:08.997102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:08.997113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:09.094203] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7088, magic:0x78563412 [2024-09-11 15:57:09.094237] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:09.094244] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:09.117469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:09.160998] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:09.197327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:09.197370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:09.197376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:09.197384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:09.317639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:09.397622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:09.397670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:09.397678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:09.397703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:09.496332] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:09.496373] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7102 [2024-09-11 15:57:09.517757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:09.597954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:09.597992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:09.597999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:09.598006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:09.629144] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041429629140, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 15:57:09.635959] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041429635956, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:57:09.694748] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7102, magic:0x78563412 [2024-09-11 15:57:09.694786] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:09.694793] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:09.717859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:09.798215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:09.798251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:09.798257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:09.798265] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:09.922275] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4320, replace_start_pos=8700000, replace_num=100000) [2024-09-11 15:57:09.922319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:09.968918] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:09.998497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:09.998538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:09.998544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:09.998551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:10.096854] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:10.096935] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=75] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7106 [2024-09-11 15:57:10.122398] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:10.161112] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:10.198770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:10.198828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:10.198837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:10.198848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:10.294068] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7106, magic:0x78563412 [2024-09-11 15:57:10.294109] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:10.294117] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:10.322496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:10.399061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:10.399098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:10.399104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:10.399112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:10.405647] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6522, clean_start_pos=8800000, clean_num=200000) [2024-09-11 15:57:10.515643] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:10.515691] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:10.515783] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] update_check_range(min_check_version=45, max_check_version=46, global_version=47) [2024-09-11 15:57:10.517817] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2033 [2024-09-11 15:57:10.517858] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:10.517891] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:57:10.517955] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:57:10.518043] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:10.518164] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:57:10.518225] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:57:10.518237] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:57:10.518248] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:57:10.518288] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:57:10.518348] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:57:10.518369] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:57:10.522610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:10.605876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:10.605929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:10.605936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:10.605943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:10.636762] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041430636758, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:57:10.643571] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041430643567, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:57:10.693744] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:10.693781] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7118 [2024-09-11 15:57:10.722698] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:10.806168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:10.806236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:10.806243] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:10.806251] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:10.892337] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7118, magic:0x78563412 [2024-09-11 15:57:10.892375] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:10.892383] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:10.922798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:10.970092] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:11.006491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:11.006544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:11.006552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:11.006561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:11.122897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:11.161323] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:11.206795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:11.206840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:11.206847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:11.206856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:11.294502] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:11.294544] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7120 [2024-09-11 15:57:11.323023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:11.407064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:11.407107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:11.407114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:11.407144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:11.493390] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7120, magic:0x78563412 [2024-09-11 15:57:11.493428] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:11.493434] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:11.523129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:11.607436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:11.607483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:11.607492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:11.607502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:11.644374] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041431644369, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:57:11.651132] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041431651127, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 15:57:11.723409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:11.807838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:11.807877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:11.807885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:11.807892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:11.895275] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:11.895316] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7128 [2024-09-11 15:57:11.923554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:11.971249] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:12.008135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:12.008181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:12.008187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:12.008211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:12.093968] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7128, magic:0x78563412 [2024-09-11 15:57:12.094012] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:12.094020] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:12.128032] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4355, replace_start_pos=8800000, replace_num=100000) [2024-09-11 15:57:12.128080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:12.161429] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:12.208520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:12.208560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:12.208567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:12.208576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:12.328233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:12.408875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:12.408953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:12.408962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:12.408971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:12.415663] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6679, clean_start_pos=9000000, clean_num=200000) [2024-09-11 15:57:12.496265] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:12.496312] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7130 [2024-09-11 15:57:12.528361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:12.615941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:12.615982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:12.615988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:12.615995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:12.652061] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041432652056, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:57:12.658813] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041432658809, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:57:12.694479] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7130, magic:0x78563412 [2024-09-11 15:57:12.694523] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:12.694531] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:12.728498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:12.816208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:12.816248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:12.816254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:12.816261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:12.928635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:12.972454] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:13.016565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:13.016606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:13.016614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:13.016624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:13.096690] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:13.096732] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7142 [2024-09-11 15:57:13.128793] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:13.161542] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=30] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:13.216873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:13.216957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:13.216967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:13.216976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:13.294969] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7142, magic:0x78563412 [2024-09-11 15:57:13.295004] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:13.295011] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:13.328920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:13.417206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:13.417264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:13.417278] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:13.417287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:13.529049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:13.617522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:13.617561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:13.617579] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:13.617588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:13.659659] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1726041433659655, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 15:57:13.666416] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041433666412, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:57:13.697450] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:13.697495] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7158 [2024-09-11 15:57:13.729220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:13.817830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:13.817874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:13.817882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:13.817892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:13.895451] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7158, magic:0x78563412 [2024-09-11 15:57:13.895489] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:13.895495] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:13.929422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:13.973858] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:14.018156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:14.018204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:14.018211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:14.018220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:14.129607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:14.161733] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:14.218539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:14.218603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:14.218611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:14.218621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:14.297175] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:14.297209] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7160 [2024-09-11 15:57:14.333053] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3327, replace_start_pos=8900000, replace_num=100000) [2024-09-11 15:57:14.333090] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:14.418853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:14.418899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:14.418932] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:14.418941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:14.427364] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8410, clean_start_pos=9200000, clean_num=200000) [2024-09-11 15:57:14.494746] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7160, magic:0x78563412 [2024-09-11 15:57:14.494784] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:14.494791] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:14.533188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:14.628112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:14.628163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:14.628190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:14.628199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:14.667222] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041434667218, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 15:57:14.674037] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041434674034, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:57:14.733373] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:14.828445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:14.828489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:14.828496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:14.828505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:14.896844] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:14.896884] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:7176 [2024-09-11 15:57:14.933520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:14.975056] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:15.028754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:15.028808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:15.028816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:15.028825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:15.094015] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:7176, magic:0x78563412 [2024-09-11 15:57:15.094055] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:15.094061] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:15.133645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:15.161862] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:15.229070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:15.229117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:15.229142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:15.229153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:15.333827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:15.429392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:15.429442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:15.429450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:15.429459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:15.495963] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:15.495998] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6458 [2024-09-11 15:57:15.533956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:15.629710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:15.629758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:15.629765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:15.629775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:15.674918] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041435674915, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 15:57:15.681586] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041435681582, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:57:15.694221] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6458, magic:0x78563412 [2024-09-11 15:57:15.694273] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:15.694279] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:15.734131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:15.830016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:15.830060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:15.830066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:15.830073] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:15.934268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:15.976069] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:16.030310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:16.030358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:16.030365] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:16.030374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:16.096282] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:16.096318] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6468 [2024-09-11 15:57:16.134470] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:16.162011] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:16.230696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:16.230748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:16.230757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:16.230767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:16.294818] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6468, magic:0x78563412 [2024-09-11 15:57:16.294853] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:16.294860] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:16.334709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:16.430997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:16.431039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:16.431050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:16.431059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:16.437622] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6551, clean_start_pos=9400000, clean_num=200000) [2024-09-11 15:57:16.538324] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3497, replace_start_pos=9000000, replace_num=100000) [2024-09-11 15:57:16.538354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:16.637891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:16.637953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:16.637958] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:16.637966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:16.682459] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041436682454, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 15:57:16.689201] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041436689198, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:57:16.696984] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:16.697019] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6484 [2024-09-11 15:57:16.738520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:16.838213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:16.838273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:16.838280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:16.838287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:16.895340] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6484, magic:0x78563412 [2024-09-11 15:57:16.895379] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:16.895385] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:16.938643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:16.977089] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:17.038521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:17.038564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:17.038571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:17.038578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:17.138811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:17.162140] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:17.238804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:17.238849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:17.238855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:17.238862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:17.297270] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:17.297315] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6490 [2024-09-11 15:57:17.338937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:17.439167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:17.439206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:17.439228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:17.439239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:17.495708] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6490, magic:0x78563412 [2024-09-11 15:57:17.495750] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:17.495758] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:17.539072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:17.639487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:17.639533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:17.639541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:17.639549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:17.690125] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041437690120, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 15:57:17.696822] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041437696819, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:57:17.739199] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:17.839795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:17.839842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:17.839850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:17.839860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:17.896370] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:17.896429] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6494 [2024-09-11 15:57:17.939332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:17.978277] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:18.040098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:18.040145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:18.040171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:18.040180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:18.094792] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6494, magic:0x78563412 [2024-09-11 15:57:18.094830] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:18.094837] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:18.139533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:18.162255] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:18.240410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:18.240453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:18.240459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:18.240466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:18.339661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:18.440696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:18.440751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:18.440758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:18.440766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:18.447735] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6957, clean_start_pos=9600000, clean_num=200000) [2024-09-11 15:57:18.496961] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:18.497019] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6498 [2024-09-11 15:57:18.539852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:18.648050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:18.648102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:18.648110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:18.648120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:18.695234] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6498, magic:0x78563412 [2024-09-11 15:57:18.695277] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:18.695284] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:18.697738] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041438697734, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:57:18.704438] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041438704435, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:57:18.744363] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4354, replace_start_pos=9100000, replace_num=100000) [2024-09-11 15:57:18.744412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:18.848391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:18.848436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:18.848442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:18.848450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:18.944517] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:18.979424] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:19.048679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:19.048724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:19.048731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:19.048739] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:19.097238] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:19.097281] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6508 [2024-09-11 15:57:19.144748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:19.162430] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:19.249064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:19.249114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:19.249123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:19.249132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:19.295898] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6508, magic:0x78563412 [2024-09-11 15:57:19.295955] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:19.295963] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:19.344884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:19.449358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:19.449403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:19.449409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:19.449418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:19.545078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:19.649740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:19.649810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:19.649820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:19.649829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:19.697503] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:19.697542] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6516 [2024-09-11 15:57:19.705350] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041439705347, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:57:19.712046] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041439712044, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:57:19.745267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:19.850087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:19.850122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:19.850129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:19.850139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:19.896221] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6516, magic:0x78563412 [2024-09-11 15:57:19.896265] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:19.896273] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:19.945395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:19.980681] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:20.050401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:20.050448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:20.050456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:20.050465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:20.145584] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:20.162607] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:20.250795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:20.250861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:20.250869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:20.250878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:20.297023] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:20.297070] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6524 [2024-09-11 15:57:20.345707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:20.451137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:20.451190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:20.451198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:20.451207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:20.457769] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6548, clean_start_pos=9800000, clean_num=200000) [2024-09-11 15:57:20.495559] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6524, magic:0x78563412 [2024-09-11 15:57:20.495601] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:20.495609] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:20.531713] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:20.531761] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:20.531844] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=46, max_check_version=47, global_version=48) [2024-09-11 15:57:20.533860] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2017 [2024-09-11 15:57:20.533897] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:20.533946] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:57:20.533984] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:57:20.534069] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:20.534187] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 15:57:20.534239] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:57:20.534251] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:57:20.534262] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:57:20.534299] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:57:20.534362] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:57:20.534384] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:57:20.545840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:20.658075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:20.658117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:20.658125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:20.658134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:20.712985] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041440712980, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 15:57:20.719665] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726041440719661, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:57:20.745983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:20.858365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:20.858406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:20.858412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:20.858419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:20.897960] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:20.898005] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6526 [2024-09-11 15:57:20.950458] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4283, replace_start_pos=9200000, replace_num=100000) [2024-09-11 15:57:20.950503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:20.981856] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:21.058731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:21.058791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:21.058799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:21.058808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:21.095111] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6526, magic:0x78563412 [2024-09-11 15:57:21.095153] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:21.095161] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:21.150663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:21.162844] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=93] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:21.259067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:21.259111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:21.259119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:21.259128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:21.350784] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:21.459356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:21.459399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:21.459406] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:21.459414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:21.497345] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:21.497421] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=68] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6532 [2024-09-11 15:57:21.550987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:21.659654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:21.659691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:21.659698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:21.659706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:21.695589] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6532, magic:0x78563412 [2024-09-11 15:57:21.695630] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:21.695638] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:21.720529] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041441720524, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 15:57:21.727280] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041441727277, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:57:21.751173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:21.860051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:21.860098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:21.860106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:21.860115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:21.951296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:21.982821] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:22.060415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:22.060460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:22.060469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:22.060478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:22.097447] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:22.097506] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6538 [2024-09-11 15:57:22.151422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:22.162950] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:22.260779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:22.260822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:22.260830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:22.260840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:22.295881] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6538, magic:0x78563412 [2024-09-11 15:57:22.295946] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:22.295954] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:22.351547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:22.461143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:22.461191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:22.461198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:22.461209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:22.468176] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6953, clean_start_pos=10000000, clean_num=200000) [2024-09-11 15:57:22.551667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:22.668503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:22.668573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:22.668582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:22.668591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:22.668787] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:57:22.696649] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:22.696694] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6548 [2024-09-11 15:57:22.728149] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041442728145, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:57:22.734920] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041442734915, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 15:57:22.751778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:22.869123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:22.869178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:22.869187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:22.869197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:22.895226] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6548, magic:0x78563412 [2024-09-11 15:57:22.895269] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:22.895277] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:22.951966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:22.983894] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=101] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:23.069495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:23.069540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:23.069548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:23.069557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:23.156510] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4353, replace_start_pos=9300000, replace_num=100000) [2024-09-11 15:57:23.156578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:23.163071] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:23.269859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:23.269920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:23.269930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:23.269940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:23.295970] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:23.296016] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6552 [2024-09-11 15:57:23.356664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:23.470177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:23.470231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:23.470245] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:23.470255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:23.494489] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6552, magic:0x78563412 [2024-09-11 15:57:23.494531] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:23.494539] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:23.556775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:23.670510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:23.670575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:23.670583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:23.670591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:23.735828] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041443735824, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 15:57:23.742509] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041443742505, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 15:57:23.756891] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:23.870844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:23.870888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:23.870896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:23.870930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:23.896408] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:23.896453] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6568 [2024-09-11 15:57:23.957094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:23.985207] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=100] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:24.071239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:24.071285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:24.071293] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:24.071302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:24.095024] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6568, magic:0x78563412 [2024-09-11 15:57:24.095063] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:24.095071] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:24.157281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:24.163175] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=23] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:24.271610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:24.271656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:24.271665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:24.271674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:24.357401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:24.471950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:24.471994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:24.472001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:24.472011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:24.479946] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7921, clean_start_pos=10200000, clean_num=200000) [2024-09-11 15:57:24.496466] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:24.496508] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6582 [2024-09-11 15:57:24.557507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:24.680267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:24.680311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:24.680319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:24.680328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:24.694547] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6582, magic:0x78563412 [2024-09-11 15:57:24.694593] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:24.694602] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:24.743447] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041444743443, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:57:24.750127] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041444750123, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:57:24.757673] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:24.880617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:24.880659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:24.880667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:24.880676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:24.957787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:24.986121] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:25.081006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:25.081050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:25.081059] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:25.081068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:25.096495] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:25.096539] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6590 [2024-09-11 15:57:25.157926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:25.163320] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:25.281302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:25.281342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:25.281349] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:25.281359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:25.294954] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6590, magic:0x78563412 [2024-09-11 15:57:25.295000] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:25.295008] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:25.362511] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4458, replace_start_pos=9400000, replace_num=100000) [2024-09-11 15:57:25.362555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:25.481613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:25.481656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:25.481663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:25.481672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:25.562705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:25.681923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:25.681965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:25.681973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:25.681982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:25.696081] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:25.696126] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46744 [2024-09-11 15:57:25.751062] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041445751058, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:57:25.757756] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041445757754, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:57:25.762829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:25.882216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:25.882260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:25.882268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:25.882277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:25.893265] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46744, magic:0x78563412 [2024-09-11 15:57:25.893309] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:25.893317] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:25.963017] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:25.987211] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:26.082516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:26.082559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:26.082567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:26.082577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:26.163207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:26.163454] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:26.282881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:26.282952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:26.282961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:26.282971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:26.294819] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:26.294866] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46760 [2024-09-11 15:57:26.363402] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:26.483318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:26.483382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:26.483391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:26.483400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:26.491092] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7678, clean_start_pos=10400000, clean_num=200000) [2024-09-11 15:57:26.493677] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46760, magic:0x78563412 [2024-09-11 15:57:26.493705] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:26.493712] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:26.563637] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:26.691427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:26.691474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:26.691483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:26.691493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:26.758615] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041446758612, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 15:57:26.763820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:26.765384] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041446765381, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:57:26.891788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:26.891835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:26.891843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:26.891868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:26.895960] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:26.895993] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46768 [2024-09-11 15:57:26.964052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:26.988227] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:27.092196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:27.092237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:27.092245] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:27.092254] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:27.094319] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46768, magic:0x78563412 [2024-09-11 15:57:27.094344] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:27.094351] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:27.163556] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=26] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:27.164241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:27.292562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:27.292609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:27.292618] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:27.292627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:27.292850] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=84, refresh_score_time=64, wash_time=0) [2024-09-11 15:57:27.364413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:27.493149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:27.493198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:27.493207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:27.493235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:27.496436] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:27.496469] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46780 [2024-09-11 15:57:27.568941] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4339, replace_start_pos=9500000, replace_num=100000) [2024-09-11 15:57:27.568989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:27.693537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:27.693582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:27.693591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:27.693600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:27.694800] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46780, magic:0x78563412 [2024-09-11 15:57:27.694829] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:27.694837] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:27.766219] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041447766216, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:57:27.769138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:27.772995] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726041447772992, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:57:27.893922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:27.893969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:27.893977] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:27.894003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:27.969374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:27.989449] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:28.094254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:28.094295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:28.094318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:28.094327] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:28.096406] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:28.096437] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46784 [2024-09-11 15:57:28.163668] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:28.169558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:28.294629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:28.294673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:28.294681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:28.294690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:28.295023] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46784, magic:0x78563412 [2024-09-11 15:57:28.295045] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:28.295051] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:28.369755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:28.495039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:28.495093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:28.495105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:28.495147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:28.502436] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7261, clean_start_pos=10600000, clean_num=200000) [2024-09-11 15:57:28.569950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:28.695679] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:28.695721] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46796 [2024-09-11 15:57:28.702697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:28.702734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:28.702741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:28.702749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:28.770136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:28.773836] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041448773833, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:57:28.780604] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726041448780601, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:57:28.894461] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46796, magic:0x78563412 [2024-09-11 15:57:28.894504] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:28.894511] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:28.903018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:28.903053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:28.903060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:28.903069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:28.970260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:28.990443] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:29.103311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:29.103354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:29.103361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:29.103383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:29.163788] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:29.170443] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:29.296809] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:29.296850] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46806 [2024-09-11 15:57:29.303682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:29.303716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:29.303724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:29.303734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:29.370623] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:29.495205] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46806, magic:0x78563412 [2024-09-11 15:57:29.495250] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:29.495257] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:29.504056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:29.504091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:29.504098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:29.504107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:29.570807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:29.704416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:29.704462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:29.704470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:29.704479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:29.775376] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4361, replace_start_pos=9600000, replace_num=100000) [2024-09-11 15:57:29.775424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:29.781468] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041449781464, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:57:29.788218] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041449788215, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:57:29.896981] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:29.897026] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46820 [2024-09-11 15:57:29.904779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:29.904812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:29.904820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:29.904829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:29.975517] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:29.991490] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:30.095690] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46820, magic:0x78563412 [2024-09-11 15:57:30.095732] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:30.095739] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:30.105073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:30.105109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:30.105116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:30.105125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:30.163910] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:30.175735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:30.305450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:30.305493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:30.305501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:30.305510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:30.375925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:30.498430] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:30.498474] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46824 [2024-09-11 15:57:30.505830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:30.505859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:30.505884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:30.505894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:30.513768] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7836, clean_start_pos=10800000, clean_num=200000) [2024-09-11 15:57:30.551173] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:30.551228] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:30.551330] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=47, max_check_version=48, global_version=49) [2024-09-11 15:57:30.553289] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1958 [2024-09-11 15:57:30.553334] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:30.553366] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:57:30.553399] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:57:30.553472] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:30.553554] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:57:30.553601] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:57:30.553610] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:57:30.553619] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:57:30.553650] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:57:30.553700] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:57:30.553715] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:57:30.576103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:30.697023] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46824, magic:0x78563412 [2024-09-11 15:57:30.697064] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:30.697071] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:30.714061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:30.714105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:30.714112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:30.714122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:30.776320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:30.789088] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041450789083, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:57:30.795838] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041450795834, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:57:30.914446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:30.914491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:30.914499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:30.914529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:30.976512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:30.992576] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:31.098612] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:31.098658] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46830 [2024-09-11 15:57:31.114829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:31.114878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:31.114886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:31.114895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:31.164056] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:31.176699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:31.297245] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46830, magic:0x78563412 [2024-09-11 15:57:31.297285] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:31.297291] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:31.315243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:31.315286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:31.315293] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:31.315303] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:31.376880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:31.515534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:31.515581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:31.515588] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:31.515597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:31.577092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:31.699181] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:31.699226] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46832 [2024-09-11 15:57:31.715843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:31.715887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:31.715896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:31.715921] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:31.777267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:31.796693] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=71] PNIO [ratelimit] time: 1726041451796688, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:57:31.803507] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041451803503, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 15:57:31.897756] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46832, magic:0x78563412 [2024-09-11 15:57:31.897800] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:31.897807] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:31.916232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:31.916277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:31.916285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:31.916295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:31.981847] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4392, replace_start_pos=9700000, replace_num=100000) [2024-09-11 15:57:31.981923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:31.993604] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:32.116622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:32.116662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:32.116669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:32.116695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:32.164163] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:32.182081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:32.299797] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:32.299846] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46842 [2024-09-11 15:57:32.317029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:32.317076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:32.317083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:32.317093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:32.382272] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:32.498372] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46842, magic:0x78563412 [2024-09-11 15:57:32.498416] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:32.498424] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:32.517402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:32.517448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:32.517456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:32.517465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:32.526005] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8527, clean_start_pos=11000000, clean_num=200000) [2024-09-11 15:57:32.582459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:32.726346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:32.726392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:32.726400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:32.726409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:32.782593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:32.804396] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041452804391, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007703, add_bytes: 0 [2024-09-11 15:57:32.811124] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041452811120, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:57:32.900272] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:32.900312] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46852 [2024-09-11 15:57:32.926640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:32.926683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:32.926691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:32.926699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:32.982722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:32.994403] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:33.098726] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46852, magic:0x78563412 [2024-09-11 15:57:33.098765] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:33.098772] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:33.127066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:33.127111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:33.127120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:33.127129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:33.164287] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:33.182929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:33.327450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:33.327495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:33.327503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:33.327513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:33.383109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:33.500639] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:33.500690] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46858 [2024-09-11 15:57:33.527757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:33.527803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:33.527811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:33.527820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:33.583308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:33.699110] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46858, magic:0x78563412 [2024-09-11 15:57:33.699150] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:33.699159] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:33.728120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:33.728168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:33.728193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:33.728204] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:33.783498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:33.811933] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041453811929, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007538, add_bytes: 0 [2024-09-11 15:57:33.818691] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041453818687, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 15:57:33.928500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:33.928545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:33.928554] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:33.928563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:33.983686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:33.995346] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:34.101400] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:34.101443] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46864 [2024-09-11 15:57:34.128810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:34.128854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:34.128862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:34.128871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:34.164388] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:34.188211] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4341, replace_start_pos=9800000, replace_num=100000) [2024-09-11 15:57:34.188254] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:34.299702] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46864, magic:0x78563412 [2024-09-11 15:57:34.299740] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:34.299761] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:34.329228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:34.329266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:34.329273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:34.329283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:34.388453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:34.529601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:34.529646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:34.529654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:34.529663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:34.538257] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8579, clean_start_pos=11200000, clean_num=200000) [2024-09-11 15:57:34.588654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:34.701585] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:34.701626] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46868 [2024-09-11 15:57:34.738587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:34.738631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:34.738639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:34.738648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:34.788777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:34.819535] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041454819531, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:57:34.826294] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041454826292, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 15:57:34.900073] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46868, magic:0x78563412 [2024-09-11 15:57:34.900115] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:34.900124] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:34.938996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:34.939039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:34.939047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:34.939056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:34.988958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:34.996319] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:35.139385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:35.139421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:35.139429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:35.139438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:35.164519] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:35.189147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:35.302655] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:35.302698] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46874 [2024-09-11 15:57:35.339740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:35.339784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:35.339793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:35.339802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:35.389356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:35.500576] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46874, magic:0x78563412 [2024-09-11 15:57:35.500611] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:35.500619] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:35.540162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:35.540202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:35.540209] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:35.540219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:35.589548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:35.740519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:35.740564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:35.740573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:35.740582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:35.789745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:35.827223] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041455827218, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:57:35.833979] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041455833976, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:57:35.902954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:35.903000] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57090 [2024-09-11 15:57:35.940881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:35.940944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:35.940953] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:35.940962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:35.989937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:35.997113] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:36.099928] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57090, magic:0x78563412 [2024-09-11 15:57:36.099969] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:36.099976] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:36.141266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:36.141312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:36.141320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:36.141330] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:36.164655] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:36.190129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:36.341636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:36.341682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:36.341690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:36.341700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:36.394319] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4072, replace_start_pos=9900000, replace_num=100000) [2024-09-11 15:57:36.394360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:36.502032] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:36.502076] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57102 [2024-09-11 15:57:36.542024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:36.542067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:36.542076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:36.542085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:36.550586] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8487, clean_start_pos=11400000, clean_num=200000) [2024-09-11 15:57:36.594512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:36.700391] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57102, magic:0x78563412 [2024-09-11 15:57:36.700432] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:36.700441] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:36.750928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:36.750972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:36.750980] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:36.750989] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:36.794651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:36.834762] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041456834757, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 15:57:36.841532] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041456841528, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:57:36.951249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:36.951294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:36.951322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:36.951331] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:36.994860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:36.998171] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:37.100110] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:37.100166] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57110 [2024-09-11 15:57:37.151573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:37.151622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:37.151630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:37.151639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:37.164811] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:37.195072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:37.298807] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57110, magic:0x78563412 [2024-09-11 15:57:37.298846] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:37.298854] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:37.351970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:37.352011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:37.352019] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:37.352028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:37.395268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:37.552272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:37.552310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:37.552318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:37.552343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:37.595483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:37.700126] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:37.700170] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57116 [2024-09-11 15:57:37.752673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:37.752715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:37.752724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:37.752734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:37.795680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:37.842398] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041457842393, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 15:57:37.849225] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041457849220, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 15:57:37.898391] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57116, magic:0x78563412 [2024-09-11 15:57:37.898434] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:37.898441] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:37.953057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:37.953103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:37.953111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:37.953121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:37.995875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:38.099194] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:38.153381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:38.153426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:38.153434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:38.153459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:38.165017] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:38.196088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:38.299464] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:38.299511] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57130 [2024-09-11 15:57:38.353708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:38.353751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:38.353758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:38.353767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:38.396300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:38.497721] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57130, magic:0x78563412 [2024-09-11 15:57:38.497767] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:38.497775] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:38.554045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:38.554101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:38.554114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:38.554124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:38.561158] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7021, clean_start_pos=11600000, clean_num=200000) [2024-09-11 15:57:38.600897] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4404, replace_start_pos=10000000, replace_num=100000) [2024-09-11 15:57:38.600962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:38.761441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:38.761485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:38.761493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:38.761501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:38.801064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:38.850003] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041458849999, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:57:38.856776] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041458856772, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:57:38.899587] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:38.899632] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57140 [2024-09-11 15:57:38.961843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:38.961890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:38.961899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:38.961936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:39.001260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:39.097882] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57140, magic:0x78563412 [2024-09-11 15:57:39.097936] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:39.097959] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:39.099957] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:39.162269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:39.162313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:39.162320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:39.162329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:39.165141] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:39.201453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:39.362637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:39.362676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:39.362684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:39.362693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:39.401649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:39.499153] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:39.499197] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57144 [2024-09-11 15:57:39.563025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:39.563063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:39.563070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:39.563078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:39.601796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:39.697363] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57144, magic:0x78563412 [2024-09-11 15:57:39.697393] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:39.697401] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:39.763341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:39.763384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:39.763393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:39.763402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:39.801928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:39.857626] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041459857621, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:57:39.864463] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041459864459, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:57:39.963640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:39.963676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:39.963683] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:39.963692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:40.002112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:40.099088] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:40.099135] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57152 [2024-09-11 15:57:40.100708] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:40.163951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:40.163995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:40.164002] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:40.164012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:40.165226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=17] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:40.202296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:40.297711] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57152, magic:0x78563412 [2024-09-11 15:57:40.297756] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:40.297764] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:40.364244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:40.364280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:40.364287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:40.364296] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:40.402438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:40.564542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:40.564582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:40.564589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:40.564598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:40.570061] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:40.570100] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:40.570195] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=48, max_check_version=49, global_version=50) [2024-09-11 15:57:40.572419] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2223 [2024-09-11 15:57:40.572456] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:40.572514] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:57:40.572553] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:57:40.572639] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:40.572796] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:57:40.572853] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:57:40.572866] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:57:40.572879] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:57:40.572929] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:57:40.573009] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:57:40.573036] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:57:40.573372] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8762, clean_start_pos=11800000, clean_num=200000) [2024-09-11 15:57:40.602603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:40.699802] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:40.699833] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57154 [2024-09-11 15:57:40.773735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:40.773777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:40.773785] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:40.773795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:40.806640] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3850, replace_start_pos=10100000, replace_num=100000) [2024-09-11 15:57:40.806687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:40.865226] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041460865223, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:57:40.871999] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041460871995, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007536, add_bytes: 0 [2024-09-11 15:57:40.898245] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57154, magic:0x78563412 [2024-09-11 15:57:40.898287] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:40.898295] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:40.974096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:40.974140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:40.974148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:40.974180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:41.006834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:41.101521] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:41.165342] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:41.174500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:41.174559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:41.174567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:41.174576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:41.207088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:41.300358] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:41.300426] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57158 [2024-09-11 15:57:41.374874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:41.374941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:41.374951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:41.374961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:41.407231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:41.498737] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57158, magic:0x78563412 [2024-09-11 15:57:41.498781] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:41.498790] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:41.575208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:41.575253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:41.575261] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:41.575270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:41.607355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:41.775595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:41.775642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:41.775650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:41.775659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:41.807527] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:41.872842] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041461872837, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:57:41.879623] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041461879619, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:57:41.900829] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:41.900875] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57166 [2024-09-11 15:57:41.975981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:41.976026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:41.976034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:41.976043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:42.007734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:42.099217] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57166, magic:0x78563412 [2024-09-11 15:57:42.099260] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:42.099268] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:42.102786] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:42.165456] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:42.176415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:42.176457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:42.176465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:42.176474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:42.207936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:42.376795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:42.376843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:42.376852] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:42.376861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:42.408132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:42.501245] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:42.501289] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57178 [2024-09-11 15:57:42.577159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:42.577202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:42.577210] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:42.577219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:42.584942] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7710, clean_start_pos=12000000, clean_num=200000) [2024-09-11 15:57:42.608313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:42.699645] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57178, magic:0x78563412 [2024-09-11 15:57:42.699687] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:42.699695] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:42.785255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:42.785300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:42.785308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:42.785318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:42.808493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:42.880504] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041462880499, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007662, add_bytes: 0 [2024-09-11 15:57:42.887239] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041462887236, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:57:42.985625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:42.985673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:42.985681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:42.985691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:43.012786] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4062, replace_start_pos=10200000, replace_num=100000) [2024-09-11 15:57:43.012832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:43.101530] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:43.101572] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57188 [2024-09-11 15:57:43.103755] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:43.165586] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:43.186021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:43.186065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:43.186072] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:43.186081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:43.212930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:43.300097] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57188, magic:0x78563412 [2024-09-11 15:57:43.300161] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=59] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:43.300169] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:43.386376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:43.386420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:43.386428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:43.386438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:43.413114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:43.586741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:43.586798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:43.586814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:43.586824] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:43.613305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:43.702095] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:43.702141] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57194 [2024-09-11 15:57:43.787145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:43.787183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:43.787190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:43.787198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:43.813496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:43.888089] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041463888085, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007586, add_bytes: 0 [2024-09-11 15:57:43.894897] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041463894894, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007658, add_bytes: 0 [2024-09-11 15:57:43.900344] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57194, magic:0x78563412 [2024-09-11 15:57:43.900381] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:43.900390] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:43.987463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:43.987508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:43.987515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:43.987524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:44.013625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:44.104613] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:44.165695] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:44.187750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:44.187782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:44.187789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:44.187799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:44.213740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:44.302495] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:44.302532] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57200 [2024-09-11 15:57:44.388035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:44.388075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:44.388082] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:44.388092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:44.413898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:44.501009] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57200, magic:0x78563412 [2024-09-11 15:57:44.501050] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:44.501058] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:44.588344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:44.588380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:44.588387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:44.588395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:44.596693] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8284, clean_start_pos=12200000, clean_num=200000) [2024-09-11 15:57:44.614107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:44.796953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:44.796992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:44.796998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:44.797006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:44.814284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:44.895762] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041464895757, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:57:44.902458] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041464902455, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:57:44.902865] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:44.902897] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57204 [2024-09-11 15:57:44.997229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:44.997270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:44.997278] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:44.997287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:45.014401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:45.101275] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57204, magic:0x78563412 [2024-09-11 15:57:45.101313] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:45.101320] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:45.105823] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:45.165822] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:45.197485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:45.197524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:45.197532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:45.197541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:45.218878] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4374, replace_start_pos=10300000, replace_num=100000) [2024-09-11 15:57:45.218928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:45.397855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:45.397928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:45.397942] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:45.397954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:45.419010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:45.503801] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:45.503839] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32374 [2024-09-11 15:57:45.598183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:45.598224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:45.598230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:45.598237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:45.619142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:45.702079] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32374, magic:0x78563412 [2024-09-11 15:57:45.702112] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:45.702120] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:45.798529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:45.798570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:45.798577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:45.798585] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:45.819257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:45.903320] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041465903316, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 15:57:45.910130] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041465910127, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:57:45.998819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:45.998861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:45.998886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:45.998896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:46.019368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:46.104472] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:46.104515] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32376 [2024-09-11 15:57:46.107250] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:46.165955] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:46.199138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:46.199170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:46.199193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:46.199203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:46.219467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:46.302704] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32376, magic:0x78563412 [2024-09-11 15:57:46.302740] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:46.302748] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:46.399436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:46.399478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:46.399486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:46.399495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:46.419586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:46.599722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:46.599755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:46.599763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:46.599782] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:46.606051] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6256, clean_start_pos=12400000, clean_num=200000) [2024-09-11 15:57:46.619779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:46.704999] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:46.705044] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32392 [2024-09-11 15:57:46.806291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:46.806331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:46.806338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:46.806347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:46.819894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:46.902176] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32392, magic:0x78563412 [2024-09-11 15:57:46.902215] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:46.902222] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:46.910923] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041466910920, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:57:46.917684] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041466917681, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 15:57:47.006572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:47.006613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:47.006620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:47.006645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:47.020004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:47.108479] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:47.166072] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:47.206867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:47.206932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:47.206940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:47.206949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:47.220085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:47.304028] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:47.304076] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32400 [2024-09-11 15:57:47.407156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:47.407185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:47.407190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:47.407198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:47.424560] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4377, replace_start_pos=10400000, replace_num=100000) [2024-09-11 15:57:47.424602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:47.501400] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32400, magic:0x78563412 [2024-09-11 15:57:47.501443] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:47.501452] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:47.607489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:47.607534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:47.607543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:47.607574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:47.607794] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash time detail, (compute_wash_size_time=103, refresh_score_time=63, wash_time=0) [2024-09-11 15:57:47.624752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:47.808098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:47.808145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:47.808153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:47.808163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:47.824943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:47.902675] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:47.902721] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32408 [2024-09-11 15:57:47.918543] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041467918538, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:57:47.925310] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041467925308, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:57:48.008388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:48.008431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:48.008437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:48.008444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:48.025073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:48.100946] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32408, magic:0x78563412 [2024-09-11 15:57:48.100996] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:48.101004] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:48.109570] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:48.166212] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:48.208695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:48.208743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:48.208768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:48.208777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:48.225254] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:48.409080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:48.409125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:48.409133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:48.409144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:48.425479] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:48.503255] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:48.503297] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32418 [2024-09-11 15:57:48.609461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:48.609517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:48.609550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:48.609562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:48.617257] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7682, clean_start_pos=0, clean_num=200000) [2024-09-11 15:57:48.625610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:48.700464] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32418, magic:0x78563412 [2024-09-11 15:57:48.700528] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:48.700537] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:48.817610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:48.817652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:48.817661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:48.817670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:48.825784] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:48.926152] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041468926147, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:57:48.932977] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041468932974, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 15:57:49.018018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:49.018064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:49.018071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:49.018082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:49.025966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:49.102238] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:49.102279] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32424 [2024-09-11 15:57:49.110658] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:49.166402] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:49.218377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:49.218421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:49.218429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:49.218438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:49.226186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:49.300942] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32424, magic:0x78563412 [2024-09-11 15:57:49.300989] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:49.300997] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:49.418736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:49.418780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:49.418789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:49.418799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:49.426367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:49.619118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:49.619164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:49.619172] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:49.619181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:49.630415] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3853, replace_start_pos=10500000, replace_num=100000) [2024-09-11 15:57:49.630459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:49.702120] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:49.702162] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32436 [2024-09-11 15:57:49.819491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:49.819532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:49.819540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:49.819568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:49.830607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:49.900680] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32436, magic:0x78563412 [2024-09-11 15:57:49.900721] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:49.900729] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:49.933775] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726041469933771, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:57:49.940593] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041469940590, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:57:50.019955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:50.019995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:50.020003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:50.020013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:50.030793] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:50.111709] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:50.166618] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:50.220360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:50.220405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:50.220413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:50.220423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:50.230981] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:50.301527] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:50.301571] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32448 [2024-09-11 15:57:50.420671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:50.420716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:50.420741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:50.420751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:50.431166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:50.499886] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32448, magic:0x78563412 [2024-09-11 15:57:50.499941] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:50.499950] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:50.587872] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:50.587943] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=69] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:57:50.588026] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=49, max_check_version=50, global_version=51) [2024-09-11 15:57:50.590032] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2006 [2024-09-11 15:57:50.590074] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:50.590110] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:57:50.590166] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:57:50.590250] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:57:50.590358] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:57:50.590411] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:57:50.590431] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:57:50.590442] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:57:50.590479] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:57:50.590539] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:57:50.590560] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:57:50.621090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:50.621135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:50.621142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:50.621168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:50.628715] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7533, clean_start_pos=200000, clean_num=200000) [2024-09-11 15:57:50.631380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:50.829059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:50.829104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:50.829112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:50.829122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:50.831545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:50.901115] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:50.901159] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32458 [2024-09-11 15:57:50.941385] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041470941381, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:57:50.948167] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041470948164, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 15:57:51.029437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:51.029480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:51.029489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:51.029499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:51.031705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:51.099454] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32458, magic:0x78563412 [2024-09-11 15:57:51.099512] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:51.099520] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:51.112713] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:51.166772] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:51.229812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:51.229857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:51.229881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:51.229891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:51.231918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:51.430152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:51.430199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:51.430206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:51.430215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:51.432097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:51.499986] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:51.500029] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32464 [2024-09-11 15:57:51.630445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:51.630486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:51.630493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:51.630502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:51.632252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:51.698711] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32464, magic:0x78563412 [2024-09-11 15:57:51.698754] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:51.698778] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:51.830736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:51.830781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:51.830789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:51.830797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:51.836502] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4147, replace_start_pos=10600000, replace_num=100000) [2024-09-11 15:57:51.836534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:51.949011] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041471949007, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:57:51.955760] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041471955757, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 15:57:52.031052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:52.031095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:52.031103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:52.031112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:52.036678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:52.101141] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:52.101186] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32480 [2024-09-11 15:57:52.113788] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:52.166954] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:52.231346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:52.231391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:52.231398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:52.231407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:52.236858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:52.299441] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32480, magic:0x78563412 [2024-09-11 15:57:52.299493] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:52.299502] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:52.431644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:52.431691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:52.431699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:52.431708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:52.437092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=87] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:52.632048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:52.632096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:52.632104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:52.632113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:52.637230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:52.639230] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7105, clean_start_pos=400000, clean_num=200000) [2024-09-11 15:57:52.700851] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:52.700896] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32492 [2024-09-11 15:57:52.837401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:52.839590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:52.839641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:52.839650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:52.839659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:52.839851] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:57:52.898649] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32492, magic:0x78563412 [2024-09-11 15:57:52.898692] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:52.898700] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:52.956718] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041472956713, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007706, add_bytes: 0 [2024-09-11 15:57:52.963445] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041472963441, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 15:57:53.037579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:53.040101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:53.040138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:53.040146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:53.040154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:53.114763] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:53.167104] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:53.237735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:53.240484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:53.240519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:53.240527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:53.240536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:53.300588] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:53.300635] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32506 [2024-09-11 15:57:53.437922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:53.440866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:53.440899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:53.440935] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:53.440944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:53.498993] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32506, magic:0x78563412 [2024-09-11 15:57:53.499037] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:53.499052] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:53.638047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:53.641192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:53.641229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:53.641237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:53.641246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:53.838175] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:53.841480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:53.841507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:53.841515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:53.841524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:53.900948] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:53.900994] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32514 [2024-09-11 15:57:53.964304] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041473964298, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007585, add_bytes: 0 [2024-09-11 15:57:53.970993] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041473970989, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:57:54.041844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:54.041895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:54.041939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:54.041954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:54.042708] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4409, replace_start_pos=10700000, replace_num=100000) [2024-09-11 15:57:54.042745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:54.099457] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32514, magic:0x78563412 [2024-09-11 15:57:54.099490] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:54.099497] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:54.115833] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:54.167282] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:54.242232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:54.242278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:54.242286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:54.242297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:54.242829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:54.442603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:54.442646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:54.442654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:54.442664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:54.442932] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:54.501140] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:54.501184] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32526 [2024-09-11 15:57:54.643034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:54.643043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:54.643099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:54.643107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:54.643116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:54.651608] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8479, clean_start_pos=600000, clean_num=200000) [2024-09-11 15:57:54.699854] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32526, magic:0x78563412 [2024-09-11 15:57:54.699883] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:54.699890] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:54.843299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:54.851962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:54.852009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:54.852017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:54.852026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:54.971856] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041474971853, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:57:54.978673] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041474978670, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:57:55.043421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:55.052353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:55.052394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:55.052404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:55.052413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:55.102028] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:55.102071] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:32534 [2024-09-11 15:57:55.116632] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:55.167430] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:55.243541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:55.252710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:55.252746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:55.252754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:55.252764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:55.299295] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:32534, magic:0x78563412 [2024-09-11 15:57:55.299335] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:55.299343] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:55.443667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:55.453080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:55.453117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:55.453125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:55.453135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:55.643843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:55.653485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:55.653523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:55.653531] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:55.653541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:55.701732] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:55.701771] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22610 [2024-09-11 15:57:55.844045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:55.853849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:55.853892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:55.853930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:55.853948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:55.899798] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22610, magic:0x78563412 [2024-09-11 15:57:55.899840] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:55.899847] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:55.979483] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041475979478, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:57:55.986226] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041475986222, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:57:56.044183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:56.054212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:56.054252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:56.054259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:56.054269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:56.117484] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:56.167633] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:56.248393] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4000, replace_start_pos=10800000, replace_num=100000) [2024-09-11 15:57:56.248439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:56.254602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:56.254645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:56.254653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:56.254663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:56.301571] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:56.301614] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22622 [2024-09-11 15:57:56.448591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:56.454999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:56.455041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:56.455048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:56.455057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:56.500205] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22622, magic:0x78563412 [2024-09-11 15:57:56.500247] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:56.500254] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:56.648734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:56.655346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:56.655377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:56.655385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:56.655394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:56.663998] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8591, clean_start_pos=800000, clean_num=200000) [2024-09-11 15:57:56.848949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:56.864260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:56.864304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:56.864312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:56.864321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:56.902576] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:56.902620] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22632 [2024-09-11 15:57:56.987100] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041476987096, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:57:56.993841] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041476993839, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:57:57.049084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:57.064626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:57.064672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:57.064681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:57.064706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:57.100738] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22632, magic:0x78563412 [2024-09-11 15:57:57.100781] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:57.100789] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:57.118612] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:57.167763] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:57.249274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:57.265051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:57.265090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:57.265098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:57.265108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:57.449467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:57.465414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:57.465458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:57.465467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:57.465476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:57.502667] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:57.502712] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22634 [2024-09-11 15:57:57.649664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:57.665785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:57.665830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:57.665838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:57.665848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:57.701343] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22634, magic:0x78563412 [2024-09-11 15:57:57.701385] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:57.701393] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:57.849841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:57:57.866173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:57.866218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:57.866226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:57.866235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:57.994711] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041477994708, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:57:58.001455] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041478001452, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:57:58.050029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:57:58.066530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:58.066573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:58.066581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:58.066591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:58.104425] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:58.104463] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22636 [2024-09-11 15:57:58.120378] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:58.167949] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:58.250218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:57:58.266893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:58.266955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:58.266963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:58.266972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:58.300797] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22636, magic:0x78563412 [2024-09-11 15:57:58.300839] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:58.300847] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:58.453988] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3629, replace_start_pos=10900000, replace_num=100000) [2024-09-11 15:57:58.454035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:57:58.467292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:58.467331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:58.467339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:58.467348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:58.654140] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:57:58.667688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:58.667736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:58.667744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:58.667753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:58.676295] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8528, clean_start_pos=1000000, clean_num=200000) [2024-09-11 15:57:58.702627] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:58.702673] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22640 [2024-09-11 15:57:58.854293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:57:58.876627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:58.876671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:58.876679] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:58.876688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:58.901144] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22640, magic:0x78563412 [2024-09-11 15:57:58.901188] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:58.901195] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:59.002376] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041479002372, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 15:57:59.009072] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041479009068, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:57:59.054489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:57:59.077012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:59.077058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:59.077066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:59.077076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:59.121363] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:57:59.168147] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:57:59.254692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:57:59.277375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:59.277419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:59.277427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:59.277437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:59.302963] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:59.303014] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22650 [2024-09-11 15:57:59.454826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:57:59.477729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:59.477766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:59.477772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:59.477780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:59.501492] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22650, magic:0x78563412 [2024-09-11 15:57:59.501533] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:57:59.501539] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:57:59.654951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:57:59.678078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:59.678114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:59.678122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:59.678131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:59.855132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:57:59.878362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:57:59.878405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:57:59.878413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:57:59.878443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:57:59.903336] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:57:59.903382] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22652 [2024-09-11 15:58:00.009927] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041480009924, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:58:00.009973] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 15:58:00.014431] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 15:58:00.016758] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041480016755, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:58:00.016790] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:58:00.055322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:00.078671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:00.078720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:00.078728] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:00.078737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:00.101864] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22652, magic:0x78563412 [2024-09-11 15:58:00.101923] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:00.101933] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:00.122284] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:00.168265] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:00.255526] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:00.279045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:00.279100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:00.279111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:00.279124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:00.455654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:00.479424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:00.479472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:00.479481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:00.479492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:00.503712] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:00.503754] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22666 [2024-09-11 15:58:00.606388] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:00.606444] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:00.606527] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=50, max_check_version=51, global_version=52) [2024-09-11 15:58:00.608551] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2023 [2024-09-11 15:58:00.608586] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:00.608621] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:58:00.608680] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:58:00.608765] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:00.608873] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:58:00.608940] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:58:00.608957] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:58:00.608968] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:58:00.609005] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:58:00.609065] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:58:00.609086] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:58:00.660127] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4325, replace_start_pos=11000000, replace_num=100000) [2024-09-11 15:58:00.660172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:00.679799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:00.679859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:00.679868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:00.679877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:00.686809] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6919, clean_start_pos=1200000, clean_num=200000) [2024-09-11 15:58:00.702305] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22666, magic:0x78563412 [2024-09-11 15:58:00.702332] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:00.702339] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:00.860322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:00.887087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:00.887133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:00.887140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:00.887149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:01.017608] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726041481017604, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 15:58:01.024394] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041481024390, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 15:58:01.060490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:01.087481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:01.087521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:01.087529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:01.087563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:01.103844] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:01.103891] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22676 [2024-09-11 15:58:01.123288] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:01.168425] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:01.260615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:01.287860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:01.287925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:01.287935] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:01.287944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:01.302946] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22676, magic:0x78563412 [2024-09-11 15:58:01.302990] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:01.302997] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:01.460740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:01.488266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:01.488309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:01.488317] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:01.488328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:01.660924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:01.688544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:01.688578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:01.688584] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:01.688592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:01.705519] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:01.705547] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22686 [2024-09-11 15:58:01.861077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=77] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:01.888840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:01.888883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:01.888891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:01.888917] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:01.903393] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22686, magic:0x78563412 [2024-09-11 15:58:01.903411] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:01.903418] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:02.025170] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041482025166, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 15:58:02.031934] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041482031931, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 15:58:02.061297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:02.089144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:02.089179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:02.089187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:02.089196] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:02.124388] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:02.168543] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:02.261488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:02.289438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:02.289480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:02.289488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:02.289497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:02.305191] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:02.305213] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22692 [2024-09-11 15:58:02.461677] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:02.489756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:02.489794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:02.489801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:02.489810] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:02.503798] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22692, magic:0x78563412 [2024-09-11 15:58:02.503817] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:02.503824] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:02.661810] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:02.690032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:02.690063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:02.690068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:02.690076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:02.696615] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6527, clean_start_pos=1400000, clean_num=200000) [2024-09-11 15:58:02.866323] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4374, replace_start_pos=11100000, replace_num=100000) [2024-09-11 15:58:02.866388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:02.896862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:02.896919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:02.896928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:02.896937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:02.905972] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:02.905988] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22702 [2024-09-11 15:58:03.032842] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041483032837, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 15:58:03.039551] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041483039547, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:58:03.066492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:03.097180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:03.097213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:03.097220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:03.097229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:03.103035] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22702, magic:0x78563412 [2024-09-11 15:58:03.103052] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:03.103059] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:03.125691] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:03.168662] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:03.266669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:03.297460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:03.297503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:03.297510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:03.297519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:03.466858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:03.497770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:03.497812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:03.497820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:03.497829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:03.504350] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:03.504366] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22708 [2024-09-11 15:58:03.667081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:03.698050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:03.698095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:03.698101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:03.698108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:03.702375] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22708, magic:0x78563412 [2024-09-11 15:58:03.702391] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:03.702397] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:03.867328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:03.898335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:03.898380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:03.898406] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:03.898416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:04.040461] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041484040458, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:58:04.047239] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041484047236, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 15:58:04.067463] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:04.098644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:04.098687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:04.098694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:04.098704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:04.104180] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:04.104217] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22720 [2024-09-11 15:58:04.126991] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:04.168837] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:04.267602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:04.298953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:04.298985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:04.298992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:04.299001] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:04.302772] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22720, magic:0x78563412 [2024-09-11 15:58:04.302792] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:04.302799] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:04.467739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:04.499253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:04.499320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:04.499328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:04.499337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:04.667879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:04.699582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:04.699623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:04.699631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:04.699639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:04.704759] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:04.704813] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22726 [2024-09-11 15:58:04.707946] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8293, clean_start_pos=1600000, clean_num=200000) [2024-09-11 15:58:04.868025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:04.903322] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22726, magic:0x78563412 [2024-09-11 15:58:04.903363] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:04.903371] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:04.908259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:04.908293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:04.908300] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:04.908323] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:05.048078] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041485048074, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:58:05.054766] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041485054762, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007526, add_bytes: 0 [2024-09-11 15:58:05.072522] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4356, replace_start_pos=11200000, replace_num=100000) [2024-09-11 15:58:05.072555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:05.108546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:05.108588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:05.108595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:05.108602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:05.128050] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:05.169040] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:05.272646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:05.305528] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:05.305571] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22742 [2024-09-11 15:58:05.308840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:05.308873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:05.308879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:05.308887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:05.472858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:05.504000] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22742, magic:0x78563412 [2024-09-11 15:58:05.504030] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:05.504038] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:05.509102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:05.509149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:05.509157] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:05.509164] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:05.673002] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:05.709395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:05.709433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:05.709442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:05.709451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:05.873122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:05.905813] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:05.905851] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27434 [2024-09-11 15:58:05.909671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:05.909698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:05.909704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:05.909712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:06.055656] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041486055652, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007578, add_bytes: 0 [2024-09-11 15:58:06.062470] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041486062464, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007702, add_bytes: 0 [2024-09-11 15:58:06.073240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:06.104340] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27434, magic:0x78563412 [2024-09-11 15:58:06.104383] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:06.104391] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:06.109964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:06.110003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:06.110010] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:06.110019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:06.128852] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:06.169185] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:06.273383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:06.310228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:06.310267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:06.310274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:06.310281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:06.473498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:06.506892] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:06.506945] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27450 [2024-09-11 15:58:06.510511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:06.510541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:06.510548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:06.510557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:06.673616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:06.705032] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27450, magic:0x78563412 [2024-09-11 15:58:06.705083] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:06.705091] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:06.710882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:06.710944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:06.710954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:06.710963] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:06.718241] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7242, clean_start_pos=1800000, clean_num=200000) [2024-09-11 15:58:06.873798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:06.918575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:06.918615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:06.918622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:06.918631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:07.063319] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726041487063315, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 15:58:07.070072] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041487070068, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:58:07.074011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:07.107073] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:07.107118] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27454 [2024-09-11 15:58:07.118860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:07.118919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:07.118943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:07.118951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:07.129811] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:07.169364] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:07.278583] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4394, replace_start_pos=11300000, replace_num=100000) [2024-09-11 15:58:07.278653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:07.305424] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27454, magic:0x78563412 [2024-09-11 15:58:07.305466] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:07.305473] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:07.319231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:07.319268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:07.319274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:07.319281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:07.478736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:07.519557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:07.519595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:07.519601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:07.519608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:07.678917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:07.707108] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:07.707148] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27466 [2024-09-11 15:58:07.719840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:07.719876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:07.719923] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:07.719934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:07.879124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:07.905677] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27466, magic:0x78563412 [2024-09-11 15:58:07.905713] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:07.905721] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:07.920157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:07.920195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:07.920201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:07.920209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:07.920383] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=66, refresh_score_time=58, wash_time=0) [2024-09-11 15:58:08.070895] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041488070890, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 15:58:08.077624] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041488077621, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:58:08.079250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:08.120586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:08.120624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:08.120630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:08.120638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:08.130895] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:08.169480] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:08.279425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:08.306393] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:08.306434] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27482 [2024-09-11 15:58:08.320872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:08.320913] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:08.320921] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:08.320928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:08.479541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:08.504868] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27482, magic:0x78563412 [2024-09-11 15:58:08.504920] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:08.504929] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:08.521174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:08.521219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:08.521227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:08.521236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:08.679714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:08.721466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:08.721526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:08.721555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:08.721567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:08.728235] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6653, clean_start_pos=2000000, clean_num=200000) [2024-09-11 15:58:08.879936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:08.911179] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:08.911224] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27494 [2024-09-11 15:58:08.928514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:08.928549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:08.928555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:08.928562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:09.078475] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=88] PNIO [ratelimit] time: 1726041489078469, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007579, add_bytes: 0 [2024-09-11 15:58:09.081375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:09.085296] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041489085293, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:58:09.105515] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27494, magic:0x78563412 [2024-09-11 15:58:09.105556] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:09.105564] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:09.128806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:09.128849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:09.128857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:09.128866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:09.132096] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:09.169608] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:09.281551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:09.329088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:09.329132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:09.329139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:09.329162] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:09.486090] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4339, replace_start_pos=11400000, replace_num=100000) [2024-09-11 15:58:09.486140] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:09.507293] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:09.507332] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27506 [2024-09-11 15:58:09.529408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:09.529448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:09.529456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:09.529465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:09.686301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:09.705807] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27506, magic:0x78563412 [2024-09-11 15:58:09.705845] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:09.705853] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:09.729701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:09.729745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:09.729752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:09.729761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:09.886486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:09.930004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:09.930042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:09.930048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:09.930056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:10.086160] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041490086156, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 15:58:10.086643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:10.092861] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041490092857, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 15:58:10.107934] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:10.107974] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27512 [2024-09-11 15:58:10.130294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:10.130335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:10.130343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:10.130351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:10.133091] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:10.169713] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:10.286878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:10.306429] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27512, magic:0x78563412 [2024-09-11 15:58:10.306466] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:10.306473] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:10.330566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:10.330603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:10.330609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:10.330617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:10.487027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:10.531326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:10.531372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:10.531379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:10.531388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:10.623552] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:10.623604] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:10.623689] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=51, max_check_version=52, global_version=53) [2024-09-11 15:58:10.625741] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2050 [2024-09-11 15:58:10.625778] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:10.625813] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:58:10.625867] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:58:10.625968] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:10.626078] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:58:10.626128] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:58:10.626144] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:58:10.626155] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:58:10.626192] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:58:10.626252] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:58:10.626274] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:58:10.687244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:10.708338] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:10.708376] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27522 [2024-09-11 15:58:10.731627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:10.731667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:10.731691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:10.731701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:10.738603] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6844, clean_start_pos=2200000, clean_num=200000) [2024-09-11 15:58:10.887367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:10.907043] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27522, magic:0x78563412 [2024-09-11 15:58:10.907086] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:10.907094] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:10.938964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:10.939006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:10.939013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:10.939020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:11.087548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:11.093771] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041491093766, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:58:11.100530] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041491100527, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 15:58:11.134380] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:11.139321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:11.139361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:11.139368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:11.139377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:11.169828] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:11.287666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:11.307967] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:11.307995] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27534 [2024-09-11 15:58:11.339596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:11.339636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:11.339643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:11.339650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:11.487783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:11.506356] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27534, magic:0x78563412 [2024-09-11 15:58:11.506373] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:11.506380] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:11.539895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:11.539956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:11.539963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:11.539971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:11.692186] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4291, replace_start_pos=11500000, replace_num=100000) [2024-09-11 15:58:11.692230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:11.740221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:11.740264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:11.740270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:11.740278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:11.892312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:11.909136] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:11.909155] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27550 [2024-09-11 15:58:11.940514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:11.940557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:11.940563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:11.940571] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:12.092431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:12.101324] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041492101321, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:58:12.106758] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27550, magic:0x78563412 [2024-09-11 15:58:12.106790] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:12.106796] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:12.108082] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041492108079, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:58:12.135446] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:12.140884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:12.140945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:12.140953] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:12.140962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:12.170008] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:12.292547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:12.341215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:12.341261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:12.341268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:12.341295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:12.492662] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:12.508887] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:12.508916] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27558 [2024-09-11 15:58:12.541596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:12.541634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:12.541643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:12.541652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:12.692775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:12.707059] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27558, magic:0x78563412 [2024-09-11 15:58:12.707075] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:12.707082] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:12.741898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:12.741964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:12.741971] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:12.741980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:12.749548] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7553, clean_start_pos=2400000, clean_num=200000) [2024-09-11 15:58:12.892878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:12.949803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:12.949844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:12.949851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:12.949859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:13.093166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=83] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:13.108944] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041493108940, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:58:13.109200] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:13.109227] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27572 [2024-09-11 15:58:13.115811] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041493115808, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007729, add_bytes: 0 [2024-09-11 15:58:13.136760] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:13.150083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:13.150126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:13.150134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:13.150142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:13.170211] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:13.293350] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:13.307480] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27572, magic:0x78563412 [2024-09-11 15:58:13.307518] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:13.307525] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:13.350442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:13.350483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:13.350491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:13.350501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:13.493480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:13.550742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:13.550782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:13.550788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:13.550795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:13.693614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:13.709830] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:13.709873] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27588 [2024-09-11 15:58:13.751090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:13.751151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:13.751169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:13.751184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:13.897106] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3357, replace_start_pos=11600000, replace_num=100000) [2024-09-11 15:58:13.897150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:13.908130] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27588, magic:0x78563412 [2024-09-11 15:58:13.908178] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:13.908186] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:13.951430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:13.951524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=93][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:13.951532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:13.951539] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:14.097242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:14.116558] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041494116552, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:58:14.123438] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041494123433, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:58:14.137775] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:14.151826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:14.151870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:14.151877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:14.151885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:14.170338] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:14.297359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:14.310038] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:14.310077] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27590 [2024-09-11 15:58:14.352118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:14.352165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:14.352172] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:14.352181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:14.497570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:14.508482] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27590, magic:0x78563412 [2024-09-11 15:58:14.508524] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:14.508533] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:14.552482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:14.552530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:14.552538] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:14.552549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:14.697693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:14.752793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:14.752839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:14.752846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:14.752853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:14.760061] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7196, clean_start_pos=2600000, clean_num=200000) [2024-09-11 15:58:14.897828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:14.910648] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:14.910693] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:27594 [2024-09-11 15:58:14.960317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:14.960362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:14.960369] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:14.960377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:15.097954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:15.107868] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:27594, magic:0x78563412 [2024-09-11 15:58:15.107916] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:15.107923] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:15.124163] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041495124160, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:58:15.131001] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041495130998, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 15:58:15.138872] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:15.160630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:15.160671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:15.160678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:15.160687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:15.170471] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:15.298097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:15.360946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:15.360990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:15.360998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:15.361007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:15.498228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:15.510289] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:15.510328] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11338 [2024-09-11 15:58:15.561263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:15.561310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:15.561319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:15.561329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:15.698344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:15.708427] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11338, magic:0x78563412 [2024-09-11 15:58:15.708457] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:15.708464] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:15.761635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:15.761679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:15.761687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:15.761696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:15.898477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:15.962037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:15.962086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:15.962094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:15.962104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:16.102040] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3428, replace_start_pos=11700000, replace_num=100000) [2024-09-11 15:58:16.102092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:16.110176] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:16.110217] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11354 [2024-09-11 15:58:16.131780] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041496131777, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:58:16.138638] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041496138634, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 15:58:16.139916] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:16.162351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:16.162397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:16.162405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:16.162414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:16.170673] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:16.302173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:16.308945] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11354, magic:0x78563412 [2024-09-11 15:58:16.308985] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:16.308993] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:16.362673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:16.362717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:16.362724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:16.362733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:16.502292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:16.562992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:16.563038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:16.563045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:16.563054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:16.702403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:16.710472] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:16.710507] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11358 [2024-09-11 15:58:16.763278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:16.763323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:16.763329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:16.763337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:16.770075] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6726, clean_start_pos=2800000, clean_num=200000) [2024-09-11 15:58:16.902524] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:16.909183] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11358, magic:0x78563412 [2024-09-11 15:58:16.909220] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:16.909228] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:16.970321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:16.970369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:16.970377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:16.970385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:17.102648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:17.139412] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726041497139408, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:58:17.140779] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:17.146160] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041497146157, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007523, add_bytes: 0 [2024-09-11 15:58:17.170626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:17.170676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:17.170684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:17.170694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:17.170796] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:17.302828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:17.311129] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:17.311188] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11362 [2024-09-11 15:58:17.370961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:17.371009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:17.371017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:17.371027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:17.503022] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:17.509540] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11362, magic:0x78563412 [2024-09-11 15:58:17.509579] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:17.509596] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:17.571275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:17.571320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:17.571327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:17.571335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:17.703233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:17.771552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:17.771598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:17.771605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:17.771613] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:17.903427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:17.912100] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:17.912144] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11368 [2024-09-11 15:58:17.971879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:17.971941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:17.971949] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:17.971959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:18.103564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:18.110226] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11368, magic:0x78563412 [2024-09-11 15:58:18.110264] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:18.110271] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:18.141847] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=46] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:18.147022] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041498147018, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:58:18.153777] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041498153775, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:58:18.170912] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:18.172193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:18.172221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:18.172228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:18.172235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:18.308128] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4379, replace_start_pos=11800000, replace_num=100000) [2024-09-11 15:58:18.308178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:18.372488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:18.372535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:18.372561] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:18.372572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:18.508332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:18.512018] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:18.512051] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11374 [2024-09-11 15:58:18.572808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:18.572851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:18.572860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:18.572869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:18.708523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:18.710643] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11374, magic:0x78563412 [2024-09-11 15:58:18.710673] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:18.710680] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:18.773094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:18.773149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:18.773165] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:18.773179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:18.781408] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8213, clean_start_pos=3000000, clean_num=200000) [2024-09-11 15:58:18.908644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:18.981680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:18.981719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:18.981725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:18.981733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:19.108832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:19.111326] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:19.111357] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11376 [2024-09-11 15:58:19.142801] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:19.154634] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041499154630, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:58:19.161402] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726041499161399, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 15:58:19.171023] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:19.181999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:19.182045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:19.182054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:19.182065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:19.308928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:19.309729] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11376, magic:0x78563412 [2024-09-11 15:58:19.309762] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:19.309770] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:19.382301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:19.382346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:19.382352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:19.382361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:19.509060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:19.582595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:19.582633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:19.582639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:19.582647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:19.709189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:19.711687] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:19.711722] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11388 [2024-09-11 15:58:19.783062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:19.783101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:19.783110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:19.783121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:19.909324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:19.910310] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11388, magic:0x78563412 [2024-09-11 15:58:19.910347] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:19.910355] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:19.983376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:19.983456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:19.983465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:19.983475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:20.109511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:20.143724] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:20.162268] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041500162261, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:58:20.169107] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041500169103, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007704, add_bytes: 0 [2024-09-11 15:58:20.171211] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:20.183770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:20.183816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:20.183824] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:20.183833] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:20.309632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:20.312067] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:20.312099] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11394 [2024-09-11 15:58:20.384045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:20.384083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:20.384089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:20.384096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:20.510721] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11394, magic:0x78563412 [2024-09-11 15:58:20.510759] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:20.510766] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:20.514107] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4361, replace_start_pos=11900000, replace_num=100000) [2024-09-11 15:58:20.514146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:20.584319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:20.584364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:20.584370] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:20.584379] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:20.640038] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:20.640084] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:20.640153] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=52, max_check_version=53, global_version=54) [2024-09-11 15:58:20.641857] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1702 [2024-09-11 15:58:20.641892] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:20.641939] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:58:20.642023] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:58:20.642126] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:20.642213] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 15:58:20.642268] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:58:20.642280] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:58:20.642290] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:58:20.642322] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:58:20.642371] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:58:20.642389] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:58:20.714245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:20.784594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:20.784638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:20.784644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:20.784652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:20.791560] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6877, clean_start_pos=3200000, clean_num=200000) [2024-09-11 15:58:20.912765] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:20.912805] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11398 [2024-09-11 15:58:20.914357] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:20.991894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:20.991960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:20.991968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:20.991977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:21.110453] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11398, magic:0x78563412 [2024-09-11 15:58:21.110497] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:21.110504] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:21.114457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:21.144714] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:21.169872] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041501169868, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 15:58:21.171340] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:21.176630] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041501176626, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007523, add_bytes: 0 [2024-09-11 15:58:21.192215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:21.192263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:21.192270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:21.192277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:21.314562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:21.392540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:21.392587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:21.392611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:21.392620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:21.512304] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:21.512349] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11406 [2024-09-11 15:58:21.514680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:21.592927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:21.592974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:21.592982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:21.592991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:21.710688] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11406, magic:0x78563412 [2024-09-11 15:58:21.710730] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:21.710737] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:21.714788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:21.793253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:21.793296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:21.793304] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:21.793313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:21.914900] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:21.993560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:21.993609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:21.993618] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:21.993627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:22.112805] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:22.112848] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11410 [2024-09-11 15:58:22.115038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:22.145639] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:22.171436] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=19] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:22.177500] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041502177495, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:58:22.184246] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041502184243, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:58:22.193856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:22.193894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:22.193921] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:22.193931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:22.311355] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11410, magic:0x78563412 [2024-09-11 15:58:22.311396] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:22.311404] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:22.315148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:22.394160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:22.394210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:22.394218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:22.394225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:22.515255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:22.594504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:22.594556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:22.594565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:22.594575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:22.713043] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:22.713089] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11412 [2024-09-11 15:58:22.718689] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3306, replace_start_pos=12000000, replace_num=100000) [2024-09-11 15:58:22.718727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:22.794894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:22.794957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:22.794964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:22.794973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:22.803399] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8412, clean_start_pos=3400000, clean_num=200000) [2024-09-11 15:58:22.911592] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11412, magic:0x78563412 [2024-09-11 15:58:22.911633] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:22.911640] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:22.918808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:23.003649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:23.003694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:23.003700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:23.003708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:23.003859] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:58:23.118936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:23.146585] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:23.171563] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:23.185171] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041503185168, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 15:58:23.191857] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041503191854, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:58:23.204087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:23.204126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:23.204132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:23.204141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:23.313752] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:23.313797] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11418 [2024-09-11 15:58:23.319059] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:23.404396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:23.404450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:23.404458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:23.404468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:23.512224] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11418, magic:0x78563412 [2024-09-11 15:58:23.512266] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:23.512292] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:23.519168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:23.604716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:23.604763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:23.604771] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:23.604780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:23.719278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:23.805029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:23.805081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:23.805110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:23.805122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:23.913956] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:23.914000] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11426 [2024-09-11 15:58:23.919397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:24.005366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:24.005413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:24.005420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:24.005429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:24.112508] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11426, magic:0x78563412 [2024-09-11 15:58:24.112552] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:24.112559] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:24.119510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:24.147667] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:24.171743] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:24.192780] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041504192776, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:58:24.199472] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041504199469, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:58:24.205691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:24.205735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:24.205742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:24.205749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:24.319622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:24.406065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:24.406111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:24.406119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:24.406128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:24.513700] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:24.513742] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11442 [2024-09-11 15:58:24.519755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:24.606380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:24.606429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:24.606436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:24.606445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:24.711983] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11442, magic:0x78563412 [2024-09-11 15:58:24.712019] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:24.712027] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:24.719859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:24.806695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:24.806745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:24.806751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:24.806760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:24.813996] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7221, clean_start_pos=3600000, clean_num=200000) [2024-09-11 15:58:24.923687] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3661, replace_start_pos=12100000, replace_num=100000) [2024-09-11 15:58:24.923728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:25.014353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:25.014406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:25.014415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:25.014425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:25.114395] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:25.114440] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11450 [2024-09-11 15:58:25.123820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:25.148621] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:25.171946] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:25.200410] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041505200407, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:58:25.207098] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041505207095, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:58:25.214643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:25.214682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:25.214689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:25.214696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:25.312667] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11450, magic:0x78563412 [2024-09-11 15:58:25.312707] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:25.312714] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:25.324003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:25.414932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:25.414974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:25.414980] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:25.414988] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:25.524194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:25.615222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:25.615267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:25.615273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:25.615281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:25.712275] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:25.712327] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37436 [2024-09-11 15:58:25.724395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:25.815515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:25.815559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:25.815566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:25.815576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:25.910880] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37436, magic:0x78563412 [2024-09-11 15:58:25.910960] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=72] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:25.910970] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:25.924573] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:26.015838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:26.015880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:26.015888] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:26.015896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:26.124769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:26.149737] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:26.172109] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=90] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:26.207963] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041506207960, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:58:26.214773] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726041506214768, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 15:58:26.216161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:26.216191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:26.216197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:26.216204] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:26.312888] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:26.312958] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=64] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37438 [2024-09-11 15:58:26.324928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:26.416470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:26.416517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:26.416525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:26.416535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:26.511473] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37438, magic:0x78563412 [2024-09-11 15:58:26.511515] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:26.511522] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:26.525121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:26.616784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:26.616825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:26.616832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:26.616842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:26.725308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:26.817074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:26.817117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:26.817123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:26.817145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:26.823891] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6735, clean_start_pos=3800000, clean_num=200000) [2024-09-11 15:58:26.912952] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:26.912994] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37440 [2024-09-11 15:58:26.925432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:27.024160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:27.024204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:27.024212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:27.024221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:27.111825] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37440, magic:0x78563412 [2024-09-11 15:58:27.111870] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:27.111878] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:27.129142] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3602, replace_start_pos=12200000, replace_num=100000) [2024-09-11 15:58:27.129179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:27.150656] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:27.172227] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:27.215586] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041507215582, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:58:27.222397] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041507222393, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:58:27.224439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:27.224464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:27.224470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:27.224478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:27.329283] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:27.424731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:27.424778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:27.424798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:27.424810] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:27.513666] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:27.513708] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37448 [2024-09-11 15:58:27.529437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:27.625120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:27.625191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:27.625200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:27.625210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:27.712132] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37448, magic:0x78563412 [2024-09-11 15:58:27.712177] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:27.712184] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:27.729620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:27.825449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:27.825499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:27.825506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:27.825536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:27.929743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:28.025792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:28.025840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:28.025847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:28.025855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:28.114209] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:28.114253] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37460 [2024-09-11 15:58:28.129920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:28.151715] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:28.172349] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:28.223174] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041508223170, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007588, add_bytes: 0 [2024-09-11 15:58:28.226105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:28.226142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:28.226149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:28.226158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:28.226377] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=70, refresh_score_time=68, wash_time=0) [2024-09-11 15:58:28.229948] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041508229945, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:58:28.312781] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37460, magic:0x78563412 [2024-09-11 15:58:28.312823] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:28.312831] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:28.330034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:28.426632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:28.426692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:28.426700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:28.426710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:28.530230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:28.626967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:28.627006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:28.627012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:28.627020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:28.717992] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:28.718036] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37464 [2024-09-11 15:58:28.730412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:28.827244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:28.827305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:28.827336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:28.827347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:28.833920] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6558, clean_start_pos=4000000, clean_num=200000) [2024-09-11 15:58:28.913202] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37464, magic:0x78563412 [2024-09-11 15:58:28.913247] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:28.913274] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:28.930602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:29.034312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:29.034358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:29.034366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:29.034376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:29.130729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:29.153743] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:29.172559] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:29.230817] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041509230814, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 15:58:29.234635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:29.234685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:29.234693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:29.234703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:29.237549] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041509237547, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:58:29.315777] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:29.315817] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37470 [2024-09-11 15:58:29.334192] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3354, replace_start_pos=12300000, replace_num=100000) [2024-09-11 15:58:29.334235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:29.435024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:29.435067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:29.435074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:29.435081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:29.513795] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37470, magic:0x78563412 [2024-09-11 15:58:29.513839] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:29.513848] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:29.534318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:29.635324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:29.635369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:29.635376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:29.635383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:29.734506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:29.835616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:29.835660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:29.835667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:29.835675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:29.914646] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:29.914691] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37478 [2024-09-11 15:58:29.934687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:30.035950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:30.035990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:30.036008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:30.036015] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:30.113238] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37478, magic:0x78563412 [2024-09-11 15:58:30.113279] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:30.113285] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:30.134812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:30.155011] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:30.172752] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:30.236242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:30.236285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:30.236291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:30.236299] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:30.238417] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041510238415, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 15:58:30.245237] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041510245233, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:58:30.334991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:30.436535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:30.436581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:30.436589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:30.436598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:30.515215] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:30.515258] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37490 [2024-09-11 15:58:30.535182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:30.636820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:30.636863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:30.636885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:30.636893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:30.655646] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:30.655697] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:30.655771] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=53, max_check_version=54, global_version=55) [2024-09-11 15:58:30.657673] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1900 [2024-09-11 15:58:30.657716] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:30.657751] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:58:30.657788] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:58:30.657894] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:30.658003] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:58:30.658051] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:58:30.658062] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:58:30.658075] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:58:30.658109] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:58:30.658163] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:58:30.658186] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:58:30.713661] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37490, magic:0x78563412 [2024-09-11 15:58:30.713699] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:30.713706] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:30.735300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:30.837135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:30.837179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:30.837185] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:30.837210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:30.846339] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9115, clean_start_pos=4200000, clean_num=200000) [2024-09-11 15:58:30.935500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:31.046615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:31.046659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:31.046666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:31.046674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:31.115144] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:31.115188] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37494 [2024-09-11 15:58:31.135695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:31.156285] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=105] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:31.172933] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:31.246049] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726041511246043, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 15:58:31.246889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:31.246939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:31.246945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:31.246954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:31.252799] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041511252794, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:58:31.314067] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37494, magic:0x78563412 [2024-09-11 15:58:31.314109] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:31.314118] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:31.335814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:31.447271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:31.447343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:31.447353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:31.447364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:31.540389] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4396, replace_start_pos=12400000, replace_num=100000) [2024-09-11 15:58:31.540441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:31.647676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:31.647723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:31.647731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:31.647740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:31.716050] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:31.716095] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37502 [2024-09-11 15:58:31.740534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:31.848063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:31.848102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:31.848110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:31.848119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:31.914519] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37502, magic:0x78563412 [2024-09-11 15:58:31.914576] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:31.914584] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:31.940655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:32.048420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:32.048467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:32.048475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:32.048485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:32.140835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:32.157510] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:32.173040] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:32.248789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:32.248832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:32.248841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:32.248850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:32.253659] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041512253655, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:58:32.260466] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041512260461, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 15:58:32.316863] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:32.316919] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37506 [2024-09-11 15:58:32.340920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:32.449097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:32.449143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:32.449151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:32.449161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:32.515030] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37506, magic:0x78563412 [2024-09-11 15:58:32.515095] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:32.515102] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:32.541033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:32.649396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:32.649441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:32.649448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:32.649457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:32.741139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:32.849684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:32.849723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:32.849729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:32.849738] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:32.858234] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8483, clean_start_pos=4400000, clean_num=200000) [2024-09-11 15:58:32.917172] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:32.917209] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37508 [2024-09-11 15:58:32.941262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:33.058500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:33.058544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:33.058568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:33.058577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:33.115444] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37508, magic:0x78563412 [2024-09-11 15:58:33.115478] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:33.115486] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:33.141382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:33.158451] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:33.173217] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:33.258820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:33.258863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:33.258869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:33.258878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:33.261328] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041513261325, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 15:58:33.268081] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041513268078, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:58:33.341554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:33.459111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:33.459153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:33.459159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:33.459167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:33.517834] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:33.517865] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37518 [2024-09-11 15:58:33.541729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:33.659397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:33.659455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:33.659462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:33.659470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:33.714942] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37518, magic:0x78563412 [2024-09-11 15:58:33.714963] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:33.714970] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:33.745449] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3609, replace_start_pos=12500000, replace_num=100000) [2024-09-11 15:58:33.745496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:33.859826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:33.859879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:33.859924] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:33.859942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:33.945655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:34.060287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:34.060333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:34.060341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:34.060350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:34.115984] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:34.116036] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37526 [2024-09-11 15:58:34.145785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:34.159586] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:34.173342] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:34.260599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:34.260661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:34.260669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:34.260678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:34.268878] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041514268875, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 15:58:34.275639] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041514275636, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:58:34.314327] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37526, magic:0x78563412 [2024-09-11 15:58:34.314361] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:34.314368] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:34.345924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:34.461039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:34.461083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:34.461091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:34.461100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:34.546053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:34.661406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:34.661449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:34.661456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:34.661466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:34.716047] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:34.716086] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37532 [2024-09-11 15:58:34.746182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:34.861709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:34.861750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:34.861757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:34.861765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:34.869084] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7304, clean_start_pos=4600000, clean_num=200000) [2024-09-11 15:58:34.914672] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37532, magic:0x78563412 [2024-09-11 15:58:34.914720] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:34.914729] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:34.946301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:35.069432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:35.069479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:35.069487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:35.069497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:35.146481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:35.160720] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:35.173467] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:35.269731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:35.269778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:35.269786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:35.269794] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:35.276508] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041515276505, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:58:35.283316] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041515283313, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 15:58:35.317484] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:35.317527] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37546 [2024-09-11 15:58:35.346603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:35.470064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:35.470107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:35.470115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:35.470124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:35.515059] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37546, magic:0x78563412 [2024-09-11 15:58:35.515095] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:35.515102] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:35.546786] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:35.670443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:35.670484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:35.670492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:35.670503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:35.746920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:35.870827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:35.870872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:35.870879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:35.870886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:35.917798] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:35.917842] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59108 [2024-09-11 15:58:35.951439] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4372, replace_start_pos=0, replace_num=100000) [2024-09-11 15:58:35.951490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:36.071193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:36.071236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:36.071244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:36.071253] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:36.115326] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59108, magic:0x78563412 [2024-09-11 15:58:36.115364] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:36.115370] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:36.151646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:36.161934] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:36.173618] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:36.271593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:36.271630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:36.271639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:36.271648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:36.284181] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041516284177, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 15:58:36.290871] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041516290866, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 15:58:36.351836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:36.471887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:36.471947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:36.471955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:36.471964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:36.517625] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:36.517658] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59120 [2024-09-11 15:58:36.552009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:36.672198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:36.672242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:36.672249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:36.672257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:36.715933] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59120, magic:0x78563412 [2024-09-11 15:58:36.715964] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:36.715970] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:36.752135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:36.872480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:36.872520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:36.872546] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:36.872555] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:36.880484] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7915, clean_start_pos=4800000, clean_num=200000) [2024-09-11 15:58:36.952261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:37.080733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:37.080775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:37.080782] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:37.080791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:37.118309] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:37.118342] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59134 [2024-09-11 15:58:37.152382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:37.163036] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:37.173816] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:37.281028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:37.281065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:37.281073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:37.281083] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:37.291742] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041517291738, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 15:58:37.298549] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=73] PNIO [ratelimit] time: 1726041517298545, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 15:58:37.316415] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59134, magic:0x78563412 [2024-09-11 15:58:37.316452] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:37.316458] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:37.352505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:37.481308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:37.481343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:37.481350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:37.481359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:37.552646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:37.681592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:37.681632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:37.681639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:37.681648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:37.718797] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:37.718829] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59144 [2024-09-11 15:58:37.752773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:37.881872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:37.881930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:37.881938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:37.881947] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:37.917094] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59144, magic:0x78563412 [2024-09-11 15:58:37.917116] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:37.917138] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:37.952945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:38.082173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:38.082211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:38.082218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:38.082227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:38.157366] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4294, replace_start_pos=100000, replace_num=100000) [2024-09-11 15:58:38.157411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:38.164257] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:38.174049] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:38.282472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:38.282514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:38.282522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:38.282531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:38.299352] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041518299347, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:58:38.306192] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041518306188, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007643, add_bytes: 0 [2024-09-11 15:58:38.319006] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:38.319047] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59150 [2024-09-11 15:58:38.357605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:38.482835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:38.482876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:38.482884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:38.482894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:38.516351] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59150, magic:0x78563412 [2024-09-11 15:58:38.516393] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:38.516402] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:38.557722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:38.683191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:38.683234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:38.683242] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:38.683251] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:38.757842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:38.883546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:38.883603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:38.883613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:38.883623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:38.892138] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8501, clean_start_pos=5000000, clean_num=200000) [2024-09-11 15:58:38.917337] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:38.917381] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59166 [2024-09-11 15:58:38.957959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:39.092474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:39.092554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=78][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:39.092567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:39.092579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:39.115741] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59166, magic:0x78563412 [2024-09-11 15:58:39.115782] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:39.115790] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:39.158073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:39.165239] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:39.174244] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:39.292888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:39.292960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:39.292968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:39.292978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:39.307029] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041519307025, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:58:39.313733] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041519313729, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 15:58:39.358188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:39.493295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:39.493344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:39.493352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:39.493361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:39.518085] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:39.518129] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59176 [2024-09-11 15:58:39.558309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:39.693670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:39.693718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:39.693726] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:39.693735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:39.716447] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59176, magic:0x78563412 [2024-09-11 15:58:39.716485] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:39.716492] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:39.758446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:39.894055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:39.894100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:39.894109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:39.894118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:39.958562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:40.094421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:40.094466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:40.094475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:40.094491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:40.118181] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:40.118240] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59182 [2024-09-11 15:58:40.158682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:40.166236] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:40.174433] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:40.294814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:40.294854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:40.294876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:40.294886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:40.314587] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041520314582, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 15:58:40.316703] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59182, magic:0x78563412 [2024-09-11 15:58:40.316735] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:40.316743] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:40.321328] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041520321326, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 15:58:40.363127] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4325, replace_start_pos=200000, replace_num=100000) [2024-09-11 15:58:40.363176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:40.495190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:40.495240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:40.495249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:40.495259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:40.563256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:40.672151] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:40.672202] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:40.672285] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=54, max_check_version=55, global_version=56) [2024-09-11 15:58:40.674381] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2096 [2024-09-11 15:58:40.674417] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:40.674453] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:58:40.674491] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:58:40.674576] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:40.674696] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:58:40.674748] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:58:40.674760] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:58:40.674770] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:58:40.674807] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:58:40.674871] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:58:40.674897] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:58:40.695561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:40.695607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:40.695615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:40.695625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:40.722323] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:40.722367] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59196 [2024-09-11 15:58:40.763377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:40.895874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:40.895940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:40.895949] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:40.895959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:40.904463] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8489, clean_start_pos=5200000, clean_num=200000) [2024-09-11 15:58:40.917289] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59196, magic:0x78563412 [2024-09-11 15:58:40.917343] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:40.917350] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:40.963560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:41.104801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:41.104845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:41.104854] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:41.104864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:41.163679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:41.167067] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:41.174571] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:41.305121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:41.305170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:41.305178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:41.305188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:41.319351] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:41.319390] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59212 [2024-09-11 15:58:41.322195] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041521322192, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:58:41.328944] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041521328942, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:58:41.363872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:41.505541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:41.505587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:41.505596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:41.505606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:41.517816] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59212, magic:0x78563412 [2024-09-11 15:58:41.517859] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:41.517866] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:41.564000] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:41.705886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:41.705952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:41.705960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:41.705969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:41.764117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:41.906223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:41.906269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:41.906277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:41.906286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:41.920023] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:41.920064] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59222 [2024-09-11 15:58:41.964236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:42.106571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:42.106610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:42.106632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:42.106643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:42.118534] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59222, magic:0x78563412 [2024-09-11 15:58:42.118575] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:42.118584] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:42.164349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:42.168004] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:42.174733] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=27] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:42.306988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:42.307032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:42.307039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:42.307049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:42.329882] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041522329877, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 15:58:42.336626] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041522336623, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:58:42.364466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:42.507351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:42.507411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:42.507422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:42.507435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:42.520623] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:42.520670] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59236 [2024-09-11 15:58:42.568955] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4372, replace_start_pos=300000, replace_num=100000) [2024-09-11 15:58:42.569001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:42.707667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:42.707712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:42.707719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:42.707729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:42.718943] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59236, magic:0x78563412 [2024-09-11 15:58:42.718965] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:42.718972] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:42.769095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:42.908047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:42.908095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:42.908104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:42.908115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:42.916675] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8547, clean_start_pos=5400000, clean_num=200000) [2024-09-11 15:58:42.969214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:43.117031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:43.117075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:43.117082] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:43.117091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:43.120441] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:43.120472] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59238 [2024-09-11 15:58:43.168813] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:43.169338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:43.174929] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:43.317406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:43.317451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:43.317459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:43.317468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:43.319156] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59238, magic:0x78563412 [2024-09-11 15:58:43.319184] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:43.319192] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:43.337418] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726041523337413, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007536, add_bytes: 0 [2024-09-11 15:58:43.344185] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041523344181, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:58:43.369448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:43.517716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:43.517759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:43.517767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:43.517776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:43.569564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:43.718040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:43.718085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:43.718092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:43.718120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:43.721198] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:43.721228] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59246 [2024-09-11 15:58:43.769683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:43.918431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:43.918485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:43.918494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:43.918504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:43.919630] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59246, magic:0x78563412 [2024-09-11 15:58:43.920147] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=511] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:43.920155] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:43.969793] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:44.118822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:44.118867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:44.118875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:44.118884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:44.169852] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:44.169919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:44.175076] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:44.319194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:44.319245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:44.319252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:44.319261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:44.321227] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:44.321248] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59254 [2024-09-11 15:58:44.345049] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041524345046, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 15:58:44.351787] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041524351785, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:58:44.370032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:44.519509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:44.519554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:44.519561] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:44.519570] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:44.520092] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59254, magic:0x78563412 [2024-09-11 15:58:44.520112] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:44.520118] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:44.570209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:44.719881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:44.719952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:44.719963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:44.719973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:44.774539] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4199, replace_start_pos=400000, replace_num=100000) [2024-09-11 15:58:44.774599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:44.920211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:44.920252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:44.920260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:44.920269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:44.922011] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:44.922044] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59256 [2024-09-11 15:58:44.928959] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8676, clean_start_pos=5600000, clean_num=200000) [2024-09-11 15:58:44.974686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:45.120493] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59256, magic:0x78563412 [2024-09-11 15:58:45.120531] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:45.120538] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:45.129223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:45.129256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:45.129262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:45.129271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:45.170770] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:45.174815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:45.175286] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:45.329508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:45.329551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:45.329558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:45.329567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:45.352678] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041525352673, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:58:45.359479] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041525359476, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 15:58:45.375020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:45.523200] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:45.523242] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54902 [2024-09-11 15:58:45.529804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:45.529836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:45.529843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:45.529852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:45.575138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:45.721132] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54902, magic:0x78563412 [2024-09-11 15:58:45.721168] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:45.721174] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:45.730079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:45.730107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:45.730114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:45.730123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:45.775324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:45.930359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:45.930415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:45.930422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:45.930430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:45.975493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:46.121633] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:46.121672] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54908 [2024-09-11 15:58:46.130659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:46.130690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:46.130697] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:46.130706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:46.171920] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:46.175388] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:46.175628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:46.320324] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54908, magic:0x78563412 [2024-09-11 15:58:46.320361] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:46.320367] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:46.330966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:46.330997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:46.331004] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:46.331013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:46.360275] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726041526360272, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 15:58:46.367028] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041526367025, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:58:46.375737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:46.531223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:46.531252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:46.531259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:46.531266] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:46.575863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:46.722409] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:46.722453] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54914 [2024-09-11 15:58:46.731510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:46.731544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:46.731551] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:46.731559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:46.776004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:46.920922] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54914, magic:0x78563412 [2024-09-11 15:58:46.920955] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:46.920962] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:46.931809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:46.931849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:46.931856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:46.931865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:46.938793] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6895, clean_start_pos=5800000, clean_num=200000) [2024-09-11 15:58:46.979459] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3327, replace_start_pos=500000, replace_num=100000) [2024-09-11 15:58:46.979506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:47.139067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:47.139112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:47.139119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:47.139128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:47.172718] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:47.175565] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:47.179653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:47.322450] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:47.322494] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54918 [2024-09-11 15:58:47.339439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:47.339488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:47.339496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:47.339505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:47.367888] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041527367884, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:58:47.374654] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041527374650, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:58:47.379759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:47.521110] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54918, magic:0x78563412 [2024-09-11 15:58:47.521150] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:47.521158] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:47.539811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:47.539858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:47.539867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:47.539876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:47.579864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:47.740186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:47.740232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:47.740239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:47.740248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:47.780050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:47.922259] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:47.922297] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54928 [2024-09-11 15:58:47.940492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:47.940534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:47.940541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:47.940551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:47.980167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:48.120508] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54928, magic:0x78563412 [2024-09-11 15:58:48.120571] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:48.120580] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:48.140797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:48.140842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:48.140850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:48.140859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:48.173851] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:48.175667] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:48.180281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:48.341092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:48.341130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:48.341138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:48.341148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:48.375519] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726041528375515, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:58:48.380388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:48.382255] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041528382254, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:58:48.522688] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:48.522734] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54930 [2024-09-11 15:58:48.541391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:48.541440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:48.541447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:48.541456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:48.541672] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=81, refresh_score_time=65, wash_time=0) [2024-09-11 15:58:48.580497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:48.720923] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54930, magic:0x78563412 [2024-09-11 15:58:48.720965] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:48.720972] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:48.741955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:48.741999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:48.742006] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:48.742016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:48.780628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:48.942319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:48.942374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:48.942389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:48.942400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:48.950229] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7814, clean_start_pos=6000000, clean_num=200000) [2024-09-11 15:58:48.980749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:49.122749] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:49.122792] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54944 [2024-09-11 15:58:49.150492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:49.150536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:49.150560] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:49.150569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:49.175087] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=109] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:49.175769] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:49.184874] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4014, replace_start_pos=600000, replace_num=100000) [2024-09-11 15:58:49.184944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:49.321306] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54944, magic:0x78563412 [2024-09-11 15:58:49.321344] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:49.321353] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:49.350873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:49.350937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:49.350947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:49.350957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:49.383133] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041529383128, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:58:49.385086] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:49.389944] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726041529389940, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:58:49.551262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:49.551307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:49.551315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:49.551325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:49.585187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:49.723018] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:49.723058] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54950 [2024-09-11 15:58:49.751566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:49.751607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:49.751615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:49.751624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:49.785308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:49.921667] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54950, magic:0x78563412 [2024-09-11 15:58:49.921713] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:49.921722] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:49.951877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:49.951939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:49.951948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:49.951957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:49.985474] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:50.152212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:50.152258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:50.152266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:50.152275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:50.175920] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=9] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:50.176113] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:50.185597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:50.323606] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:50.323642] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54960 [2024-09-11 15:58:50.352588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:50.352651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:50.352660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:50.352669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:50.385771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:50.390745] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041530390742, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:58:50.397540] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041530397537, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 15:58:50.521304] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54960, magic:0x78563412 [2024-09-11 15:58:50.521348] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:50.521355] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:50.552996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:50.553039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:50.553046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:50.553056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:50.585982] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:50.690598] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:50.690650] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:58:50.690730] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=55, max_check_version=56, global_version=57) [2024-09-11 15:58:50.692739] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2007 [2024-09-11 15:58:50.692776] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:50.692811] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:58:50.692849] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:58:50.692949] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:58:50.693068] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:58:50.693119] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:58:50.693130] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:58:50.693141] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:58:50.693178] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:58:50.693244] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:58:50.693262] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:58:50.753359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:50.753404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:50.753412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:50.753422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:50.786169] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:50.923042] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:50.923085] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54972 [2024-09-11 15:58:50.953667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:50.953710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:50.953717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:50.953728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:50.962214] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8472, clean_start_pos=6200000, clean_num=200000) [2024-09-11 15:58:50.986295] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:51.121649] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54972, magic:0x78563412 [2024-09-11 15:58:51.121691] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:51.121698] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:51.162548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:51.162594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:51.162602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:51.162611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:51.176073] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:51.177128] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:51.186498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:51.362947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:51.362987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:51.362994] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:51.363003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:51.391028] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4344, replace_start_pos=700000, replace_num=100000) [2024-09-11 15:58:51.391081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:51.398429] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041531398425, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 15:58:51.405123] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041531405120, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007583, add_bytes: 0 [2024-09-11 15:58:51.523556] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:51.523599] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54980 [2024-09-11 15:58:51.563310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:51.563356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:51.563364] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:51.563374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:51.591244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:51.722181] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54980, magic:0x78563412 [2024-09-11 15:58:51.722224] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:51.722232] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:51.763693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:51.763739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:51.763748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:51.763757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:51.791434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:51.964077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:51.964118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:51.964126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:51.964136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:51.991614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:52.123277] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:52.123321] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54982 [2024-09-11 15:58:52.164482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:52.164549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:52.164558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:52.164567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:52.176201] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:52.178120] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:52.191735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:52.321766] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54982, magic:0x78563412 [2024-09-11 15:58:52.321810] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:52.321818] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:52.364820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:52.364863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:52.364871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:52.364881] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:52.391945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:52.405963] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041532405960, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007535, add_bytes: 0 [2024-09-11 15:58:52.412739] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041532412735, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:58:52.565184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:52.565231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:52.565239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:52.565249] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:52.592143] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:52.723556] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:52.723601] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54994 [2024-09-11 15:58:52.765553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:52.765616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:52.765625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:52.765634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:52.792269] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:52.922133] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54994, magic:0x78563412 [2024-09-11 15:58:52.922167] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:52.922174] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:52.965886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:52.965949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:52.965957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:52.965966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:52.974449] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8469, clean_start_pos=6400000, clean_num=200000) [2024-09-11 15:58:52.992577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:53.174779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:53.174822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:53.174830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:53.174840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:53.175063] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:58:53.176329] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:53.178997] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:53.192701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:53.323046] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:53.323100] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55008 [2024-09-11 15:58:53.375321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:53.375365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:53.375372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:53.375382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:53.392884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:53.413595] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041533413591, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:58:53.420341] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041533420339, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 15:58:53.520608] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55008, magic:0x78563412 [2024-09-11 15:58:53.520652] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:53.520659] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:53.575682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:53.575724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:53.575732] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:53.575741] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:53.597394] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4368, replace_start_pos=800000, replace_num=100000) [2024-09-11 15:58:53.597446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:53.776067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:53.776129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:53.776137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:53.776147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:53.797590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:53.922699] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:53.922742] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55022 [2024-09-11 15:58:53.976466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:53.976524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:53.976539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:53.976550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:53.997772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:54.120892] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55022, magic:0x78563412 [2024-09-11 15:58:54.120962] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=65] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:54.120970] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:54.176429] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=25] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:54.176854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:54.176887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:54.176896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:54.176931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:54.179896] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:54.197954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:54.377199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:54.377239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:54.377246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:54.377270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:54.398135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:54.421207] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041534421204, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:58:54.428021] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041534428018, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 15:58:54.523386] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:54.523431] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55032 [2024-09-11 15:58:54.577570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:54.577615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:54.577623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:54.577633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:54.598261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:54.721450] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55032, magic:0x78563412 [2024-09-11 15:58:54.721487] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:54.721495] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:54.777968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:54.778011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:54.778018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:54.778027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:54.798495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:54.978292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:54.978332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:54.978340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:54.978350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:54.986003] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7641, clean_start_pos=6600000, clean_num=200000) [2024-09-11 15:58:54.998684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:55.123444] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:55.123486] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55038 [2024-09-11 15:58:55.176551] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:55.180975] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:55.186331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:55.186365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:55.186373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:55.186383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:55.198863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:55.321744] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55038, magic:0x78563412 [2024-09-11 15:58:55.321785] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:55.321792] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:55.386719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:55.386761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:55.386769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:55.386779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:55.399111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:55.429013] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041535429007, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007803, add_bytes: 0 [2024-09-11 15:58:55.435639] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041535435636, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:58:55.587095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:55.587135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:55.587143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:55.587153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:55.599238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:55.724014] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:55.724053] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50684 [2024-09-11 15:58:55.787450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:55.787491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:55.787500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:55.787509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:55.803351] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3991, replace_start_pos=900000, replace_num=100000) [2024-09-11 15:58:55.803394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:55.922318] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50684, magic:0x78563412 [2024-09-11 15:58:55.922377] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:55.922386] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:55.987887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:55.987954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:55.987962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:55.987972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:56.003539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:56.176683] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:56.181782] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:56.188216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:56.188251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:56.188259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:56.188268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:56.203664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:56.323296] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:56.323335] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50692 [2024-09-11 15:58:56.388572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:56.388616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:56.388624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:56.388634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:56.403882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:56.436446] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041536436442, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007435, add_bytes: 0 [2024-09-11 15:58:56.443193] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041536443191, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 15:58:56.521841] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50692, magic:0x78563412 [2024-09-11 15:58:56.521897] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:56.521942] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:56.588890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:56.588961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:56.588969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:56.588978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:56.604076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:56.789303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:56.789350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:56.789359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:56.789368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:56.804262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:56.924255] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:56.924293] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50704 [2024-09-11 15:58:56.989694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:56.989739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:56.989748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:56.989757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:56.998311] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8522, clean_start_pos=6800000, clean_num=200000) [2024-09-11 15:58:57.004452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:57.122386] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50704, magic:0x78563412 [2024-09-11 15:58:57.122430] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:57.122439] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:57.176797] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:57.182514] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:57.198632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:57.198673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:57.198681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:57.198691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:57.204645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:57.399033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:57.399076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:57.399085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:57.399094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:57.404827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:57.444048] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041537444045, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:58:57.450807] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041537450803, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:58:57.524921] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:57.524964] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50708 [2024-09-11 15:58:57.599400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:57.599445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:57.599453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:57.599478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:57.605005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:57.722979] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50708, magic:0x78563412 [2024-09-11 15:58:57.723023] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:57.723031] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:57.799720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:57.799763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:57.799772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:57.799781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:57.805222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:58:58.000053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:58.000100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:58.000107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:58.000116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:58.009729] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=1000000, replace_num=100000) [2024-09-11 15:58:58.009774] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:58:58.124714] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:58.124772] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50722 [2024-09-11 15:58:58.176991] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:58.183220] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:58.200367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:58.200413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:58.200421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:58.200448] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:58.209973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:58:58.323082] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50722, magic:0x78563412 [2024-09-11 15:58:58.323118] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:58.323127] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:58.400695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:58.400740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:58.400748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:58.400757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:58.410155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:58:58.451673] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041538451670, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:58:58.458414] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041538458411, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:58:58.601039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:58.601083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:58.601092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:58.601101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:58.610332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:58:58.725535] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:58.725580] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50728 [2024-09-11 15:58:58.801342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:58.801383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:58.801391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:58.801401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:58.810468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:58:58.923833] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50728, magic:0x78563412 [2024-09-11 15:58:58.923874] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:58.923881] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:59.001642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:59.001697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:59.001710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:59.001720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:59.008862] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7130, clean_start_pos=7000000, clean_num=200000) [2024-09-11 15:58:59.010648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:58:59.177128] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:58:59.183956] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:58:59.209173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:59.209212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:59.209220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:59.209230] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:59.210832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:58:59.325449] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:59.325492] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50732 [2024-09-11 15:58:59.409537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:59.409583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:59.409591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:59.409601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:59.410962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:58:59.459296] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041539459290, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:58:59.466035] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041539466029, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:58:59.523991] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50732, magic:0x78563412 [2024-09-11 15:58:59.524035] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:58:59.524043] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:58:59.609851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:59.609897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:59.609925] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:59.609934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:59.611059] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:58:59.810150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:58:59.810192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:58:59.810219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:58:59.810227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:58:59.811144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:58:59.926016] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:58:59.926058] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50734 [2024-09-11 15:59:00.010471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:00.010515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:00.010523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:00.010532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:00.011237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:00.124530] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50734, magic:0x78563412 [2024-09-11 15:59:00.124568] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:00.124575] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:00.177253] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:00.184824] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:00.210843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:00.210882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:00.210889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:00.210897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:00.214751] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3416, replace_start_pos=1100000, replace_num=100000) [2024-09-11 15:59:00.214780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:00.411166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:00.411211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:00.411236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:00.411245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:00.414876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:00.452830] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 15:59:00.466891] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041540466888, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 15:59:00.466943] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 15:59:00.471331] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 15:59:00.473645] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041540473644, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:59:00.473663] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=17] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 15:59:00.526492] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:00.526532] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50740 [2024-09-11 15:59:00.611482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:00.611526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:00.611534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:00.611542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:00.614993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:00.709660] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:00.709715] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:00.709813] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] update_check_range(min_check_version=56, max_check_version=57, global_version=58) [2024-09-11 15:59:00.711808] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1993 [2024-09-11 15:59:00.711848] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:00.711884] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:59:00.711941] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:59:00.712016] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:00.712111] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:59:00.712154] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:59:00.712163] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:59:00.712172] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:59:00.712206] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:59:00.712254] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:59:00.712272] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:59:00.724846] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50740, magic:0x78563412 [2024-09-11 15:59:00.724879] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:00.724886] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:00.811766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:00.811808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:00.811816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:00.811823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:00.815178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:01.012055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:01.012101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:01.012109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:01.012134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:01.015291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:01.020009] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7862, clean_start_pos=7200000, clean_num=200000) [2024-09-11 15:59:01.126940] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:01.126982] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50746 [2024-09-11 15:59:01.177405] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:01.185611] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:01.215398] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:01.220257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:01.220291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:01.220297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:01.220305] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:01.325442] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50746, magic:0x78563412 [2024-09-11 15:59:01.325504] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:01.325514] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:01.415521] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:01.420527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:01.420562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:01.420569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:01.420576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:01.474515] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041541474509, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:59:01.481344] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=5] PNIO [ratelimit] time: 1726041541481340, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 15:59:01.615670] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:01.620825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:01.620864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:01.620870] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:01.620878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:01.727034] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:01.727088] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50758 [2024-09-11 15:59:01.815813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:01.821106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:01.821134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:01.821140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:01.821147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:01.925688] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50758, magic:0x78563412 [2024-09-11 15:59:01.925721] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:01.925728] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:02.015927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:02.021374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:02.021412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:02.021418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:02.021426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:02.177526] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:02.186516] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:02.216109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:02.221745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:02.221778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:02.221805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:02.221814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:02.326516] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:02.326561] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50766 [2024-09-11 15:59:02.420576] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4338, replace_start_pos=1200000, replace_num=100000) [2024-09-11 15:59:02.420619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:02.422070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:02.422098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:02.422106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:02.422115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:02.482192] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041542482187, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 15:59:02.488914] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041542488898, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:59:02.525146] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50766, magic:0x78563412 [2024-09-11 15:59:02.525189] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:02.525197] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:02.620780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:02.622430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:02.622456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:02.622480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:02.622489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:02.820980] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:02.822787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:02.822813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:02.822820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:02.822829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:02.925764] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:02.925805] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50782 [2024-09-11 15:59:03.021158] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:03.023140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:03.023168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:03.023176] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:03.023185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:03.031078] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7879, clean_start_pos=7400000, clean_num=200000) [2024-09-11 15:59:03.124490] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50782, magic:0x78563412 [2024-09-11 15:59:03.124530] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:03.124552] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:03.177656] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:03.187342] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:03.221346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:03.231430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:03.231473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:03.231497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:03.231508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:03.421523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:03.431818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:03.431865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:03.431874] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:03.431883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:03.489814] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041543489810, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 15:59:03.496569] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041543496565, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 15:59:03.526341] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:03.526386] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50788 [2024-09-11 15:59:03.621710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:03.632216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:03.632256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:03.632264] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:03.632273] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:03.724951] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50788, magic:0x78563412 [2024-09-11 15:59:03.724992] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:03.725016] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:03.821893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:03.832526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:03.832572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:03.832580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:03.832591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:04.022141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:04.032897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:04.032967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:04.032975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:04.032985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:04.127432] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:04.127478] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50790 [2024-09-11 15:59:04.177789] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:04.188353] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:04.222342] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:04.233281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:04.233320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:04.233326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:04.233335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:04.325492] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50790, magic:0x78563412 [2024-09-11 15:59:04.325537] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:04.325544] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:04.422516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:04.433662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:04.433705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:04.433713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:04.433722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:04.497359] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041544497355, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 15:59:04.504179] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041544504175, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:59:04.627075] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4361, replace_start_pos=1300000, replace_num=100000) [2024-09-11 15:59:04.627119] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:04.634045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:04.634074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:04.634080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:04.634088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:04.727532] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:04.727572] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50802 [2024-09-11 15:59:04.827260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:04.834331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:04.834367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:04.834388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:04.834397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:04.925991] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50802, magic:0x78563412 [2024-09-11 15:59:04.926037] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:04.926045] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:05.027448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:05.034702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:05.034747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:05.034755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:05.034765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:05.042626] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7846, clean_start_pos=7600000, clean_num=200000) [2024-09-11 15:59:05.177923] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:05.189383] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:05.227569] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:05.243018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:05.243065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:05.243073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:05.243082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:05.326153] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:05.326197] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:50818 [2024-09-11 15:59:05.427682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:05.443387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:05.443430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:05.443456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:05.443466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:05.504987] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041545504982, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 15:59:05.511801] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041545511796, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:59:05.524881] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:50818, magic:0x78563412 [2024-09-11 15:59:05.524944] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:05.524953] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:05.627854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:05.643767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:05.643812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:05.643820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:05.643830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:05.828136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:05.844133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:05.844178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:05.844186] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:05.844195] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:05.927083] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:05.927141] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37994 [2024-09-11 15:59:06.028315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:06.044503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:06.044551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:06.044559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:06.044568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:06.124189] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37994, magic:0x78563412 [2024-09-11 15:59:06.124231] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:06.124240] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:06.178064] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:06.190255] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:06.228493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:06.244897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:06.244965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:06.244973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:06.244983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:06.428610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:06.445223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:06.445262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:06.445270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:06.445279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:06.512594] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041546512589, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 15:59:06.519349] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041546519346, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 15:59:06.526879] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:06.526949] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=63] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38006 [2024-09-11 15:59:06.628729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:06.645584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:06.645632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:06.645640] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:06.645650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:06.724832] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38006, magic:0x78563412 [2024-09-11 15:59:06.724876] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:06.724885] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:06.832663] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3714, replace_start_pos=1400000, replace_num=100000) [2024-09-11 15:59:06.832705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:06.845986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:06.846028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:06.846034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:06.846043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:07.032847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:07.046345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:07.046406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:07.046415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:07.046425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:07.055084] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8646, clean_start_pos=7800000, clean_num=200000) [2024-09-11 15:59:07.126030] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:07.126074] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38016 [2024-09-11 15:59:07.178259] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:07.191328] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:07.233054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:07.255348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:07.255393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:07.255400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:07.255409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:07.324238] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38016, magic:0x78563412 [2024-09-11 15:59:07.324280] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:07.324287] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:07.433317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:07.455704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:07.455749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:07.455757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:07.455767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:07.520202] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041547520197, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:59:07.526956] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726041547526954, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:59:07.633502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:07.656024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:07.656066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:07.656074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:07.656083] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:07.726230] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:07.726268] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38020 [2024-09-11 15:59:07.833686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:07.856428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:07.856474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:07.856482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:07.856491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:07.924600] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38020, magic:0x78563412 [2024-09-11 15:59:07.924636] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:07.924643] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:08.033875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:08.056795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:08.056842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:08.056850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:08.056877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:08.178474] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:08.192691] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:08.234088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:08.257120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:08.257176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:08.257185] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:08.257194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:08.326325] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:08.326361] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38034 [2024-09-11 15:59:08.434279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:08.457493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:08.457540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:08.457549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:08.457559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:08.524979] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38034, magic:0x78563412 [2024-09-11 15:59:08.525018] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:08.525026] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:08.527822] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041548527819, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:59:08.534592] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041548534589, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 15:59:08.634485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:08.657864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:08.657929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:08.657955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:08.657965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:08.834614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:08.858265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:08.858305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:08.858313] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:08.858323] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:08.858538] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=76, refresh_score_time=60, wash_time=0) [2024-09-11 15:59:08.927129] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:08.927173] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38050 [2024-09-11 15:59:09.038951] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4147, replace_start_pos=1500000, replace_num=100000) [2024-09-11 15:59:09.039003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:09.058778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:09.058820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:09.058825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:09.058833] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:09.067277] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8431, clean_start_pos=8000000, clean_num=200000) [2024-09-11 15:59:09.125453] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38050, magic:0x78563412 [2024-09-11 15:59:09.125496] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:09.125503] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:09.178668] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:09.193989] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:09.239168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:09.267659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:09.267702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:09.267710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:09.267720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:09.439320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:09.468081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:09.468125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:09.468133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:09.468142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:09.527966] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:09.528010] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38060 [2024-09-11 15:59:09.535436] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041549535432, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:59:09.542254] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041549542251, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007662, add_bytes: 0 [2024-09-11 15:59:09.639451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:09.668380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:09.668425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:09.668433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:09.668442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:09.725849] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38060, magic:0x78563412 [2024-09-11 15:59:09.725888] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:09.725895] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:09.839631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:09.868756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:09.868795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:09.868803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:09.868813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:10.039811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:10.069113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:10.069158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:10.069167] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:10.069176] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:10.128172] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:10.128216] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38064 [2024-09-11 15:59:10.178858] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:10.195182] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:10.239942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:10.269475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:10.269521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:10.269529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:10.269539] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:10.325544] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38064, magic:0x78563412 [2024-09-11 15:59:10.325603] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:10.325612] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:10.440062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:10.469771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:10.469803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:10.469811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:10.469821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:10.543047] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041550543043, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:59:10.549810] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041550549809, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 15:59:10.640247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:10.670053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:10.670095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:10.670102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:10.670111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:10.725983] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:10.726038] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:10.726126] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=57, max_check_version=58, global_version=59) [2024-09-11 15:59:10.726872] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:10.726962] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=83] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38066 [2024-09-11 15:59:10.728298] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2173 [2024-09-11 15:59:10.728338] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:10.728376] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:59:10.728416] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:59:10.728526] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:10.728682] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:59:10.728738] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:59:10.728750] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:59:10.728762] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:59:10.728800] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:59:10.728864] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:59:10.728894] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:59:10.840444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:10.870418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:10.870457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:10.870465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:10.870475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:10.924664] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38066, magic:0x78563412 [2024-09-11 15:59:10.924704] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:10.924712] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:11.040639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:11.070774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:11.070820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:11.070828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:11.070855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:11.079318] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8449, clean_start_pos=8200000, clean_num=200000) [2024-09-11 15:59:11.179029] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:11.196299] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:11.244820] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3988, replace_start_pos=1600000, replace_num=100000) [2024-09-11 15:59:11.244887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:11.279640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:11.279678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:11.279687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:11.279697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:11.326511] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:11.326550] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38080 [2024-09-11 15:59:11.445051] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:11.480037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:11.480077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:11.480085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:11.480094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:11.525201] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38080, magic:0x78563412 [2024-09-11 15:59:11.525244] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:11.525253] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:11.550677] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041551550674, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 15:59:11.557428] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726041551557424, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:59:11.645242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:11.680430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:11.680475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:11.680484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:11.680494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:11.845442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:11.880795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:11.880844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:11.880852] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:11.880861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:11.927500] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:11.927538] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38094 [2024-09-11 15:59:12.045624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:12.081160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:12.081204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:12.081212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:12.081221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:12.125776] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38094, magic:0x78563412 [2024-09-11 15:59:12.125834] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:12.125843] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:12.179242] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:12.197613] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:12.245818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:12.281519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:12.281574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:12.281583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:12.281592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:12.446006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:12.481821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:12.481857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:12.481864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:12.481872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:12.527518] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:12.527559] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38102 [2024-09-11 15:59:12.558284] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041552558280, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:59:12.565056] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041552565053, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 15:59:12.646197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:12.682101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:12.682145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:12.682152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:12.682162] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:12.726102] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38102, magic:0x78563412 [2024-09-11 15:59:12.726159] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:12.726167] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:12.846324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:12.882473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:12.882520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:12.882528] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:12.882538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:13.046522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:13.082843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:13.082883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:13.082890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:13.082898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:13.089457] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6529, clean_start_pos=8400000, clean_num=200000) [2024-09-11 15:59:13.128227] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:13.128269] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38114 [2024-09-11 15:59:13.179382] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:13.198816] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:13.246641] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:13.289723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:13.289765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:13.289771] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:13.289779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:13.326549] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38114, magic:0x78563412 [2024-09-11 15:59:13.326602] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:13.326609] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:13.450756] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3990, replace_start_pos=1700000, replace_num=100000) [2024-09-11 15:59:13.450800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:13.490016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:13.490051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:13.490057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:13.490064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:13.565978] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041553565975, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 15:59:13.572748] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041553572745, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 15:59:13.650887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:13.690407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:13.690459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:13.690468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:13.690478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:13.728488] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:13.728536] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38124 [2024-09-11 15:59:13.851084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:13.890824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:13.890870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:13.890877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:13.890885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:13.925980] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38124, magic:0x78563412 [2024-09-11 15:59:13.926025] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:13.926034] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:14.051306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:14.091084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:14.091130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:14.091137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:14.091146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:14.179498] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:14.199742] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:14.251508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:14.291455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:14.291501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:14.291509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:14.291518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:14.327984] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:14.328027] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38130 [2024-09-11 15:59:14.451701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:14.491870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:14.491952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:14.491962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:14.491972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:14.526564] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38130, magic:0x78563412 [2024-09-11 15:59:14.526606] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:14.526613] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:14.573516] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041554573512, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 15:59:14.580340] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041554580338, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 15:59:14.651893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:14.692278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:14.692324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:14.692333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:14.692343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:14.852115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:14.892646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:14.892692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:14.892700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:14.892710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:14.928382] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:14.928426] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38138 [2024-09-11 15:59:15.052304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:15.093002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:15.093047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:15.093054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:15.093063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:15.100071] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6994, clean_start_pos=8600000, clean_num=200000) [2024-09-11 15:59:15.126767] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38138, magic:0x78563412 [2024-09-11 15:59:15.126810] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:15.126818] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:15.179636] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:15.200660] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:15.252498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:15.300393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:15.300434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:15.300442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:15.300451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:15.452625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:15.500763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:15.500808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:15.500816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:15.500826] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:15.528686] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:15.528731] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34738 [2024-09-11 15:59:15.581130] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041555581125, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:59:15.587887] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041555587886, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:59:15.657174] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4349, replace_start_pos=1800000, replace_num=100000) [2024-09-11 15:59:15.657222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:15.701150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:15.701195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:15.701203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:15.701213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:15.727304] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34738, magic:0x78563412 [2024-09-11 15:59:15.727343] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:15.727352] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:15.857372] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:15.901444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:15.901487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:15.901495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:15.901504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:16.057499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:16.101824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:16.101869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:16.101877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:16.101886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:16.129203] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:16.129247] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34748 [2024-09-11 15:59:16.179842] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:16.201771] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:16.257678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:16.302180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:16.302221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:16.302229] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:16.302239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:16.327733] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34748, magic:0x78563412 [2024-09-11 15:59:16.327775] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:16.327783] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:16.457798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:16.502452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:16.502482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:16.502489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:16.502497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:16.588755] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041556588751, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:59:16.595514] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041556595511, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:59:16.657922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:16.702817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:16.702862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:16.702870] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:16.702880] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:16.730367] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:16.730410] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34752 [2024-09-11 15:59:16.858031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:16.903191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:16.903233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:16.903241] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:16.903251] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:16.928422] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34752, magic:0x78563412 [2024-09-11 15:59:16.928459] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:16.928466] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:17.058152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:17.103482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:17.103519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:17.103542] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:17.103552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:17.112038] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8473, clean_start_pos=8800000, clean_num=200000) [2024-09-11 15:59:17.180050] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:17.202830] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:17.258334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:17.312304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:17.312346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:17.312354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:17.312364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:17.330546] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:17.330591] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34762 [2024-09-11 15:59:17.458516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:17.512661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:17.512709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:17.512716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:17.512726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:17.528889] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34762, magic:0x78563412 [2024-09-11 15:59:17.528939] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:17.528947] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:17.596358] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041557596354, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:59:17.603196] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041557603193, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 15:59:17.658725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:17.713047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:17.713090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:17.713098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:17.713107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:17.863317] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4371, replace_start_pos=1900000, replace_num=100000) [2024-09-11 15:59:17.863364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:17.913344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:17.913388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:17.913397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:17.913406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:17.930682] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:17.930721] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34768 [2024-09-11 15:59:18.063513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:18.113647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:18.113685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:18.113693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:18.113702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:18.129400] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34768, magic:0x78563412 [2024-09-11 15:59:18.129466] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:18.129474] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:18.180253] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:18.203887] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:18.263701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:18.314047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:18.314091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:18.314100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:18.314109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:18.463916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:18.514420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:18.514465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:18.514473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:18.514483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:18.531437] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:18.531478] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34772 [2024-09-11 15:59:18.604040] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041558604037, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 15:59:18.610804] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041558610801, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 15:59:18.664100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:18.714808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:18.714855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:18.714863] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:18.714872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:18.729784] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34772, magic:0x78563412 [2024-09-11 15:59:18.729828] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:18.729837] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:18.864284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:18.915278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:18.915322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:18.915330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:18.915340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:19.064466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:19.115673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:19.115732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:19.115748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:19.115758] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:19.123332] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7560, clean_start_pos=9000000, clean_num=200000) [2024-09-11 15:59:19.131968] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:19.132012] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34788 [2024-09-11 15:59:19.180386] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:19.204813] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:19.264658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:19.323661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:19.323707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:19.323716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:19.323726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:19.330308] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34788, magic:0x78563412 [2024-09-11 15:59:19.330345] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:19.330353] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:19.464839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:19.524069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:19.524116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:19.524124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:19.524134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:19.611597] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041559611594, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 15:59:19.618424] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041559618421, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:59:19.665077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:19.665127] INFO run1 (ob_timer.cpp:374) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] dump timer info(this=0x7f529d2ad960, tasks_num=0, wakeup_time=102217319988) [2024-09-11 15:59:19.724441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:19.724481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:19.724489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:19.724498] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:19.732020] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:19.732061] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34790 [2024-09-11 15:59:19.865270] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:19.924805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:19.924851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:19.924859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:19.924868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:19.930761] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34790, magic:0x78563412 [2024-09-11 15:59:19.930795] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:19.930802] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:20.069824] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4405, replace_start_pos=2000000, replace_num=100000) [2024-09-11 15:59:20.069876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:20.125182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:20.125231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:20.125239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:20.125248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:20.180509] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:20.205684] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:20.269970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:20.325558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:20.325601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:20.325610] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:20.325620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:20.333010] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:20.333051] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34802 [2024-09-11 15:59:20.470149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:20.525946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:20.525993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:20.526001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:20.526011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:20.531493] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34802, magic:0x78563412 [2024-09-11 15:59:20.531526] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:20.531550] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:20.619207] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041560619203, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:59:20.625966] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041560625966, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 15:59:20.670357] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:20.726310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:20.726352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:20.726360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:20.726370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:20.744149] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:20.744201] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:20.744282] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=58, max_check_version=59, global_version=60) [2024-09-11 15:59:20.746379] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2096 [2024-09-11 15:59:20.746420] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:20.746456] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:59:20.746494] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:59:20.746578] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:20.746698] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 15:59:20.746748] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:59:20.746760] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:59:20.746771] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:59:20.746807] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:59:20.746871] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:59:20.746898] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:59:20.870532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:20.926683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:20.926732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:20.926740] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:20.926751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:20.933928] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:20.933974] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34812 [2024-09-11 15:59:21.070720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:21.127091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:21.127140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:21.127149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:21.127159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:21.132052] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34812, magic:0x78563412 [2024-09-11 15:59:21.132114] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:21.132124] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:21.135786] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8612, clean_start_pos=9200000, clean_num=200000) [2024-09-11 15:59:21.180655] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:21.206600] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:21.270862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:21.336126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:21.336174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:21.336182] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:21.336191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:21.471079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:21.534367] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:21.534411] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34816 [2024-09-11 15:59:21.536427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:21.536457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:21.536463] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:21.536472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:21.626836] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041561626833, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:59:21.633650] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726041561633647, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:59:21.671270] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:21.732419] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34816, magic:0x78563412 [2024-09-11 15:59:21.732465] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:21.732472] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:21.736703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:21.736739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:21.736746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:21.736755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:21.871462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:21.937076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:21.937120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:21.937128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:21.937138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:22.071590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:22.132672] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:22.132718] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34820 [2024-09-11 15:59:22.137382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:22.137415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:22.137423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:22.137431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:22.180772] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:22.207359] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:22.276084] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4353, replace_start_pos=2100000, replace_num=100000) [2024-09-11 15:59:22.276136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:22.330117] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34820, magic:0x78563412 [2024-09-11 15:59:22.330161] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:22.330168] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:22.337731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:22.337775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:22.337783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:22.337794] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:22.476359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:22.538097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:22.538145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:22.538153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:22.538163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:22.634439] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041562634435, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 15:59:22.641197] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041562641196, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:59:22.676554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:22.731776] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:22.731822] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34834 [2024-09-11 15:59:22.738421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:22.738455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:22.738462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:22.738472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:22.876754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:22.930306] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34834, magic:0x78563412 [2024-09-11 15:59:22.930337] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:22.930343] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:22.938791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:22.938816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:22.938822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:22.938829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:23.076984] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:23.139127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:23.139172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:23.139180] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:23.139191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:23.147755] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8549, clean_start_pos=9400000, clean_num=200000) [2024-09-11 15:59:23.180900] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:23.208420] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:23.277117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:23.332802] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:23.332843] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34840 [2024-09-11 15:59:23.348061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:23.348104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:23.348112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:23.348121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:23.348324] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:59:23.477301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:23.529947] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34840, magic:0x78563412 [2024-09-11 15:59:23.529989] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:23.529996] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:23.548631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:23.548677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:23.548685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:23.548695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:23.642120] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041563642116, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:59:23.648815] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726041563648812, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:59:23.677487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:23.748976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:23.749020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:23.749027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:23.749036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:23.877677] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:23.931779] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:23.931842] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34844 [2024-09-11 15:59:23.949353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:23.949396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:23.949405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:23.949415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:24.077869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:24.130190] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34844, magic:0x78563412 [2024-09-11 15:59:24.130246] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:24.130261] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:24.149754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:24.149801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:24.149809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:24.149819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:24.181023] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:24.209560] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:24.278074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:24.350123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:24.350166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:24.350174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:24.350183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:24.482623] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4365, replace_start_pos=2200000, replace_num=100000) [2024-09-11 15:59:24.482671] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:24.531638] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:24.531698] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34856 [2024-09-11 15:59:24.550484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:24.550525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:24.550533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:24.550544] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:24.649686] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041564649682, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 15:59:24.656435] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041564656431, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:59:24.682826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:24.729659] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34856, magic:0x78563412 [2024-09-11 15:59:24.729698] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:24.729706] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:24.750801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:24.750843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:24.750851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:24.750860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:24.883022] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:24.951173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:24.951216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:24.951242] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:24.951252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:25.083146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:25.131962] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:25.132007] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:34872 [2024-09-11 15:59:25.151589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:25.151636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:25.151644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:25.151653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:25.160175] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8509, clean_start_pos=9600000, clean_num=200000) [2024-09-11 15:59:25.181221] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:25.210574] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:25.283343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:25.330149] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:34872, magic:0x78563412 [2024-09-11 15:59:25.330189] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:25.330197] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:25.360499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:25.360543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:25.360551] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:25.360560] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:25.483549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:25.560858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:25.560898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:25.560946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:25.560956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:25.657372] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041565657368, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:59:25.664129] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041565664126, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 15:59:25.683735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:25.731984] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:25.732025] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35754 [2024-09-11 15:59:25.761254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:25.761299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:25.761307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:25.761317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:25.883927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:25.930526] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35754, magic:0x78563412 [2024-09-11 15:59:25.930571] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:25.930580] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:25.961631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:25.961676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:25.961684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:25.961695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:26.084117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:26.162038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:26.162084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:26.162091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:26.162100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:26.181426] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:26.211672] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:26.284351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:26.332524] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:26.332570] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35770 [2024-09-11 15:59:26.362336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:26.362380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:26.362387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:26.362397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:26.484534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:26.531029] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35770, magic:0x78563412 [2024-09-11 15:59:26.531072] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:26.531080] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:26.562630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:26.562675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:26.562683] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:26.562691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:26.664912] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041566664899, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007531, add_bytes: 0 [2024-09-11 15:59:26.671681] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041566671678, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:59:26.689105] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4381, replace_start_pos=2300000, replace_num=100000) [2024-09-11 15:59:26.689147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:26.763032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:26.763078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:26.763086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:26.763095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:26.889232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:26.932523] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:26.932562] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35776 [2024-09-11 15:59:26.963335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:26.963375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:26.963382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:26.963391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:27.089415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:27.130636] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35776, magic:0x78563412 [2024-09-11 15:59:27.130677] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:27.130684] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:27.163642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:27.163686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:27.163694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:27.163703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:27.172269] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8551, clean_start_pos=9800000, clean_num=200000) [2024-09-11 15:59:27.181622] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:27.212724] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:27.289620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:27.372544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:27.372588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:27.372595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:27.372605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:27.489800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:27.532610] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:27.532656] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35792 [2024-09-11 15:59:27.572849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:27.572896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:27.572928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:27.572937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:27.672520] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726041567672516, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 15:59:27.679294] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041567679291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:59:27.689991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:27.730843] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35792, magic:0x78563412 [2024-09-11 15:59:27.730919] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:27.730927] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:27.773181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:27.773221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:27.773228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:27.773238] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:27.890164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:27.973491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:27.973536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:27.973543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:27.973553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:28.090349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:28.132859] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:28.132922] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35804 [2024-09-11 15:59:28.173802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:28.173847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:28.173855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:28.173864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:28.181806] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:28.214175] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:28.290477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:28.331445] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35804, magic:0x78563412 [2024-09-11 15:59:28.331483] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:28.331505] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:28.374178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:28.374223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:28.374231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:28.374241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:28.490654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:28.574484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:28.574532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:28.574540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:28.574550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:28.680133] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041568680129, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:59:28.686924] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041568686921, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 15:59:28.690770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:28.733326] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:28.733370] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35816 [2024-09-11 15:59:28.774786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:28.774828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:28.774836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:28.774845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:28.895192] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4231, replace_start_pos=2400000, replace_num=100000) [2024-09-11 15:59:28.895239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:28.931920] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35816, magic:0x78563412 [2024-09-11 15:59:28.931964] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:28.931973] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:28.975103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:28.975151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:28.975159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:28.975169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:29.095400] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:29.175427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:29.175481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:29.175489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:29.175505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:29.175732] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash time detail, (compute_wash_size_time=105, refresh_score_time=66, wash_time=0) [2024-09-11 15:59:29.181998] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:29.183458] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7713, clean_start_pos=10000000, clean_num=200000) [2024-09-11 15:59:29.215293] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:29.295589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:29.333964] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:29.334008] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35818 [2024-09-11 15:59:29.383781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:29.383834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:29.383842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:29.383851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:29.495772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:29.532429] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35818, magic:0x78563412 [2024-09-11 15:59:29.532470] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:29.532479] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:29.584144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:29.584184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:29.584192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:29.584202] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:29.687768] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041569687763, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 15:59:29.694516] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041569694514, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 15:59:29.695957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:29.784483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:29.784526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:29.784536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:29.784549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:29.896069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:29.934448] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:29.934486] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35828 [2024-09-11 15:59:29.984869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:29.984938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:29.984948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:29.984958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:30.096187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:30.132758] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35828, magic:0x78563412 [2024-09-11 15:59:30.132801] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:30.132810] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:30.182213] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:30.185282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:30.185313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:30.185321] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:30.185330] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:30.216051] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:30.296310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:30.385627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:30.385665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:30.385673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:30.385683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:30.496414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:30.534790] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:30.534835] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35838 [2024-09-11 15:59:30.585993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:30.586037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:30.586045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:30.586054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:30.695367] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041570695363, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 15:59:30.696552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:30.702125] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726041570702124, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:59:30.733251] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35838, magic:0x78563412 [2024-09-11 15:59:30.733295] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:30.733303] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:30.763479] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:30.763534] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:30.763619] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=59, max_check_version=60, global_version=61) [2024-09-11 15:59:30.765720] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2099 [2024-09-11 15:59:30.765779] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:30.765814] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:59:30.765852] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:59:30.765950] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:30.766059] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:59:30.766114] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:59:30.766126] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:59:30.766136] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:59:30.766173] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:59:30.766233] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:59:30.766254] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:59:30.786336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:30.786380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:30.786391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:30.786404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:30.896663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:30.986708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:30.986753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:30.986761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:30.986771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:31.100991] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4205, replace_start_pos=2500000, replace_num=100000) [2024-09-11 15:59:31.101030] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:31.135576] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:31.135621] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35840 [2024-09-11 15:59:31.182370] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:31.187047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:31.187080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:31.187104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:31.187113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:31.194768] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7642, clean_start_pos=10200000, clean_num=200000) [2024-09-11 15:59:31.217200] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:31.301112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:31.333805] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35840, magic:0x78563412 [2024-09-11 15:59:31.333847] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:31.333855] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:31.395053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:31.395101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:31.395109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:31.395117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:31.501250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:31.595366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:31.595412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:31.595420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:31.595429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:31.701433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:31.702978] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041571702975, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 15:59:31.709741] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726041571709739, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:59:31.735701] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:31.735760] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35844 [2024-09-11 15:59:31.795735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:31.795802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:31.795810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:31.795820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:31.901618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:31.933994] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35844, magic:0x78563412 [2024-09-11 15:59:31.934025] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:31.934033] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:31.996077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:31.996120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:31.996128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:31.996137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:32.101815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:32.182558] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:32.196385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:32.196424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:32.196432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:32.196441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:32.218303] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:32.301943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:32.336053] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:32.336100] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35860 [2024-09-11 15:59:32.396768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:32.396821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:32.396850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:32.396860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:32.502072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:32.534767] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35860, magic:0x78563412 [2024-09-11 15:59:32.534811] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:32.534819] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:32.597107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:32.597154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:32.597162] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:32.597171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:32.702186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:32.710598] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041572710594, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:59:32.717367] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726041572717364, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:59:32.797411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:32.797454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:32.797462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:32.797472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:32.902364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:32.936574] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:32.936608] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35866 [2024-09-11 15:59:32.997708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:32.997755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:32.997763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:32.997773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:33.102593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:33.133803] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35866, magic:0x78563412 [2024-09-11 15:59:33.133850] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:33.133858] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:33.182774] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:33.198012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:33.198051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:33.198059] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:33.198067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:33.205016] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6937, clean_start_pos=10400000, clean_num=200000) [2024-09-11 15:59:33.219532] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:33.306704] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3985, replace_start_pos=2600000, replace_num=100000) [2024-09-11 15:59:33.306752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:33.405319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:33.405366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:33.405374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:33.405383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:33.506837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:33.535990] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:33.536036] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35876 [2024-09-11 15:59:33.605693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:33.605740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:33.605748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:33.605757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:33.707029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:33.718215] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041573718210, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:59:33.724994] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041573724989, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:59:33.734512] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35876, magic:0x78563412 [2024-09-11 15:59:33.734558] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:33.734565] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:33.806060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:33.806097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:33.806103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:33.806112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:33.907223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:34.006352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:34.006396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:34.006405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:34.006414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:34.107441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:34.137380] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:34.137426] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35878 [2024-09-11 15:59:34.182979] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:34.206640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:34.206688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:34.206695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:34.206704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:34.220733] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:34.307566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:34.335113] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35878, magic:0x78563412 [2024-09-11 15:59:34.335157] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:34.335164] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:34.407030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:34.407076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:34.407084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:34.407093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:34.507705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:34.607338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:34.607379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:34.607398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:34.607407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:34.707896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:34.725859] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041574725854, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 15:59:34.732593] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041574732589, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 15:59:34.736932] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:34.736963] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35892 [2024-09-11 15:59:34.807642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:34.807682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:34.807689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:34.807697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:34.908121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:34.935426] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35892, magic:0x78563412 [2024-09-11 15:59:34.935464] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:34.935472] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:35.007976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:35.008022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:35.008030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:35.008055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:35.108303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:35.183188] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:35.208359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:35.208403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:35.208412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:35.208422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:35.217113] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8678, clean_start_pos=10600000, clean_num=200000) [2024-09-11 15:59:35.221786] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:35.308492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:35.337792] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:35.337836] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35900 [2024-09-11 15:59:35.417372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:35.417415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:35.417424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:35.417433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:35.513037] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4368, replace_start_pos=2700000, replace_num=100000) [2024-09-11 15:59:35.513078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:35.536101] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35900, magic:0x78563412 [2024-09-11 15:59:35.536146] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:35.536155] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:35.617728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:35.617774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:35.617799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:35.617809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:35.713223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:35.733445] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041575733441, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007587, add_bytes: 0 [2024-09-11 15:59:35.740204] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041575740203, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:59:35.818060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:35.818103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:35.818111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:35.818120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:35.913350] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:35.939245] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:35.939290] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8202 [2024-09-11 15:59:36.018410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:36.018457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:36.018465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:36.018475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:36.113487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:36.137009] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8202, magic:0x78563412 [2024-09-11 15:59:36.137068] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:36.137077] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:36.183337] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:36.218775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:36.218820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:36.218828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:36.218838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:36.222703] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:36.313676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:36.419172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:36.419217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:36.419224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:36.419234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:36.513863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:36.537831] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:36.537875] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8212 [2024-09-11 15:59:36.619546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:36.619592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:36.619599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:36.619608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:36.714077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:36.736191] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8212, magic:0x78563412 [2024-09-11 15:59:36.736236] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:36.736262] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:36.741067] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041576741062, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:59:36.747831] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726041576747828, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:59:36.819832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:36.819890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:36.819899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:36.819931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:36.914273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:37.020226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:37.020276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:37.020285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:37.020294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:37.114409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:37.137799] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:37.137845] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8220 [2024-09-11 15:59:37.183532] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:37.220589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:37.220635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:37.220643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:37.220670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:37.223790] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:37.228789] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8106, clean_start_pos=10800000, clean_num=200000) [2024-09-11 15:59:37.314627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:37.335851] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8220, magic:0x78563412 [2024-09-11 15:59:37.335894] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:37.335933] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:37.429057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:37.429097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:37.429104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:37.429113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:37.514865] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:37.629410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:37.629454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:37.629462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:37.629473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:37.719148] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4082, replace_start_pos=2800000, replace_num=100000) [2024-09-11 15:59:37.719193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:37.737579] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:37.737619] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8224 [2024-09-11 15:59:37.748678] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041577748675, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:59:37.755440] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041577755439, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:59:37.829774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:37.829826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:37.829834] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:37.829844] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:37.919338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:37.934942] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8224, magic:0x78563412 [2024-09-11 15:59:37.934968] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:37.934974] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:38.030143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:38.030191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:38.030199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:38.030209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:38.119462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:38.183715] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:38.224622] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=46] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:38.230509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:38.230549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:38.230557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:38.230567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:38.319577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:38.337459] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:38.337492] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8240 [2024-09-11 15:59:38.430872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:38.430943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:38.430974] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:38.430984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:38.519753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:38.535747] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8240, magic:0x78563412 [2024-09-11 15:59:38.535793] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:38.535800] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:38.631280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:38.631324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:38.631333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:38.631343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:38.719941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:38.756300] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041578756295, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 15:59:38.763060] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041578763057, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 15:59:38.831638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:38.831676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:38.831684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:38.831693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:38.920142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:38.936759] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:38.936804] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8246 [2024-09-11 15:59:39.032040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:39.032084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:39.032092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:39.032101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:39.120339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:39.135099] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8246, magic:0x78563412 [2024-09-11 15:59:39.135143] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:39.135151] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:39.183850] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:39.225712] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:39.232399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:39.232435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:39.232444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:39.232453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:39.240666] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8200, clean_start_pos=11000000, clean_num=200000) [2024-09-11 15:59:39.320513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:39.441033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:39.441076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:39.441084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:39.441093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:39.520706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:39.536971] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:39.537015] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8260 [2024-09-11 15:59:39.641354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:39.641395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:39.641403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:39.641412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:39.720918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:39.735599] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8260, magic:0x78563412 [2024-09-11 15:59:39.735633] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:39.735642] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:39.763911] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041579763908, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:59:39.770681] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041579770678, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:59:39.841710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:39.841754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:39.841762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:39.841779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:39.925411] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4308, replace_start_pos=2900000, replace_num=100000) [2024-09-11 15:59:39.925469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:40.042077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:40.042123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:40.042131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:40.042141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:40.125617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:40.137719] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:40.137767] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8270 [2024-09-11 15:59:40.183968] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:40.226700] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:40.242395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:40.242440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:40.242448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:40.242457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:40.325757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:40.336110] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8270, magic:0x78563412 [2024-09-11 15:59:40.336153] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:40.336160] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:40.442755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:40.442799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:40.442806] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:40.442816] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:40.525897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:40.643063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:40.643122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:40.643130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:40.643139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:40.726038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:40.738498] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:40.738543] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8276 [2024-09-11 15:59:40.771534] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041580771529, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 15:59:40.778300] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041580778297, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 15:59:40.781333] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:40.781362] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:40.781432] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=60, max_check_version=61, global_version=62) [2024-09-11 15:59:40.783199] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1766 [2024-09-11 15:59:40.783230] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:40.783276] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:59:40.783309] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:59:40.783385] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:40.783467] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:59:40.783514] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 15:59:40.783523] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:59:40.783532] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:59:40.783563] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:59:40.783611] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:59:40.783628] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:59:40.843455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:40.843517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:40.843526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:40.843535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:40.926222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:40.936867] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8276, magic:0x78563412 [2024-09-11 15:59:40.936926] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:40.936935] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:41.043828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:41.043873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:41.043882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:41.043891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:41.126358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:41.184118] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:41.227782] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:41.244205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:41.244250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:41.244257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:41.244267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:41.252690] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8410, clean_start_pos=11200000, clean_num=200000) [2024-09-11 15:59:41.326487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:41.337474] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:41.337513] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8290 [2024-09-11 15:59:41.453022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:41.453081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:41.453089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:41.453098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:41.526623] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:41.536089] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8290, magic:0x78563412 [2024-09-11 15:59:41.536133] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:41.536141] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:41.653397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:41.653443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:41.653451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:41.653461] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:41.726809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:41.779147] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041581779143, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 15:59:41.785993] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041581785990, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 15:59:41.853758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:41.853798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:41.853806] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:41.853816] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:41.926995] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:41.938540] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:41.938580] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8306 [2024-09-11 15:59:42.054136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:42.054183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:42.054191] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:42.054201] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:42.131535] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4358, replace_start_pos=3000000, replace_num=100000) [2024-09-11 15:59:42.131579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:42.136733] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8306, magic:0x78563412 [2024-09-11 15:59:42.136759] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:42.136765] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:42.184320] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:42.228675] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:42.254499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:42.254546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:42.254554] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:42.254564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:42.331665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:42.454865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:42.454933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:42.454943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:42.454953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:42.531847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:42.540167] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:42.540215] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8314 [2024-09-11 15:59:42.655258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:42.655303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:42.655311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:42.655321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:42.731968] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:42.737207] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8314, magic:0x78563412 [2024-09-11 15:59:42.737246] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:42.737254] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:42.786762] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041582786758, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:59:42.793532] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041582793529, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 15:59:42.855557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:42.855601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:42.855609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:42.855618] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:42.932084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:43.055950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:43.055999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:43.056007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:43.056018] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:43.132219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:43.139137] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:43.139181] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8320 [2024-09-11 15:59:43.184537] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:43.229739] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:43.256336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:43.256376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:43.256385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:43.256394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:43.264919] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8511, clean_start_pos=11400000, clean_num=200000) [2024-09-11 15:59:43.332405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:43.337440] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8320, magic:0x78563412 [2024-09-11 15:59:43.337469] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:43.337477] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:43.465254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:43.465302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:43.465310] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:43.465320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:43.532595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:43.665641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:43.665687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:43.665695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:43.665705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:43.732745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:43.739708] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:43.739752] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8322 [2024-09-11 15:59:43.794375] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041583794371, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 15:59:43.801148] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041583801145, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 15:59:43.865979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:43.866012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:43.866020] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:43.866029] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:43.932962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:43.938147] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8322, magic:0x78563412 [2024-09-11 15:59:43.938182] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:43.938189] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:44.066258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:44.066302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:44.066330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:44.066340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:44.133084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:44.184721] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:44.230925] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:44.266569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:44.266627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:44.266655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:44.266665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:44.337589] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4382, replace_start_pos=3100000, replace_num=100000) [2024-09-11 15:59:44.337635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:44.339848] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:44.339867] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8326 [2024-09-11 15:59:44.466878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:44.466936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:44.466943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:44.466950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:44.537785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:44.538286] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8326, magic:0x78563412 [2024-09-11 15:59:44.538308] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:44.538315] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:44.667260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:44.667306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:44.667335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:44.667346] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:44.737996] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:44.802000] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041584801996, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:59:44.808834] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041584808831, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 15:59:44.867671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:44.867719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:44.867727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:44.867736] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:44.938213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:44.940554] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:44.940581] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8340 [2024-09-11 15:59:45.068071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:45.068118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:45.068126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:45.068136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:45.138399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:45.138894] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8340, magic:0x78563412 [2024-09-11 15:59:45.138942] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:45.138949] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:45.184926] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:45.232112] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:45.268430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:45.268498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:45.268508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:45.268517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:45.276099] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7569, clean_start_pos=11600000, clean_num=200000) [2024-09-11 15:59:45.338523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:45.476373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:45.476415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:45.476422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:45.476431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:45.538647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:45.540741] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:45.540767] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38418 [2024-09-11 15:59:45.676768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:45.676822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:45.676830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:45.676839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:45.738769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:45.739258] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38418, magic:0x78563412 [2024-09-11 15:59:45.739300] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:45.739306] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:45.809605] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041585809602, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:59:45.816375] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041585816370, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 15:59:45.877140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:45.877182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:45.877191] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:45.877201] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:45.938893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:46.077512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:46.077557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:46.077565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:46.077574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:46.139102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:46.141514] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:46.141544] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38422 [2024-09-11 15:59:46.185137] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:46.233408] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:46.277887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:46.277955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:46.277963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:46.277972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:46.339296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:46.339808] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38422, magic:0x78563412 [2024-09-11 15:59:46.339827] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:46.339834] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:46.478272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:46.478308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:46.478316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:46.478325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:46.543855] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4342, replace_start_pos=3200000, replace_num=100000) [2024-09-11 15:59:46.543912] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:46.678555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:46.678598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:46.678606] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:46.678615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:46.740614] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:46.740661] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38424 [2024-09-11 15:59:46.743994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:46.817231] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041586817227, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:59:46.824001] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041586823998, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 15:59:46.878870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:46.878937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:46.878946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:46.878955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:46.939086] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38424, magic:0x78563412 [2024-09-11 15:59:46.939124] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:46.939131] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:46.944094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:47.079203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:47.079251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:47.079258] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:47.079267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:47.144206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:47.185334] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:47.234465] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:47.279569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:47.279613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:47.279621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:47.279631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:47.288204] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8560, clean_start_pos=11800000, clean_num=200000) [2024-09-11 15:59:47.339368] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:47.339413] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38426 [2024-09-11 15:59:47.344317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:47.488473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:47.488511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:47.488519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:47.488528] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:47.537762] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38426, magic:0x78563412 [2024-09-11 15:59:47.537805] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:47.537813] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:47.544497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:47.688829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:47.688875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:47.688883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:47.688893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:47.744615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:47.824854] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041587824849, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 15:59:47.831628] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726041587831624, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 15:59:47.889231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:47.889277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:47.889286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:47.889295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:47.939499] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:47.939539] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38432 [2024-09-11 15:59:47.944730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:48.089623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:48.089669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:48.089678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:48.089688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:48.138008] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38432, magic:0x78563412 [2024-09-11 15:59:48.138050] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:48.138057] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:48.144822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:48.185465] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:48.235343] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:48.290034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:48.290071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:48.290079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:48.290088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:48.344930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:48.490335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:48.490377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:48.490385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:48.490394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:48.539917] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:48.539975] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38442 [2024-09-11 15:59:48.545048] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:48.690701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:48.690749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:48.690757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:48.690767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:48.740378] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38442, magic:0x78563412 [2024-09-11 15:59:48.740420] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:48.740428] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:48.749462] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4321, replace_start_pos=3300000, replace_num=100000) [2024-09-11 15:59:48.749503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:48.832459] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726041588832455, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 15:59:48.839283] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041588839281, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 15:59:48.891047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:48.891092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:48.891099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:48.891108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:48.949678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:49.091412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:49.091456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:49.091464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:49.091473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:49.142714] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:49.142759] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38446 [2024-09-11 15:59:49.149877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:49.185663] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:49.236121] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:49.291782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:49.291839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:49.291854] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:49.291866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:49.300359] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8479, clean_start_pos=12000000, clean_num=200000) [2024-09-11 15:59:49.341131] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38446, magic:0x78563412 [2024-09-11 15:59:49.341173] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:49.341181] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:49.350076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:49.500690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:49.500733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:49.500741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:49.500750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:49.501011] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=78, refresh_score_time=64, wash_time=0) [2024-09-11 15:59:49.550209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:49.701344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:49.701391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:49.701400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:49.701409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:49.742772] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:49.742816] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38452 [2024-09-11 15:59:49.750422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:49.840073] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041589840070, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 15:59:49.846919] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041589846915, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 15:59:49.901643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:49.901692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:49.901700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:49.901709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:49.941520] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38452, magic:0x78563412 [2024-09-11 15:59:49.941553] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:49.941559] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:49.950607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:50.102032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:50.102075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:50.102082] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:50.102092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:50.150795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:50.185783] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:50.237179] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:50.302322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:50.302358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:50.302365] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:50.302374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:50.343159] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:50.343206] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38462 [2024-09-11 15:59:50.350915] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:50.502670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:50.502716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:50.502724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:50.502733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:50.541038] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38462, magic:0x78563412 [2024-09-11 15:59:50.541072] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:50.541079] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:50.551018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:50.702986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:50.703053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:50.703061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:50.703070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:50.751124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:50.798859] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:50.798931] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=69] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 15:59:50.799017] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=61, max_check_version=62, global_version=63) [2024-09-11 15:59:50.801068] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2051 [2024-09-11 15:59:50.801103] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:50.801140] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 15:59:50.801201] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 15:59:50.801291] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 15:59:50.801398] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 15:59:50.801449] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 15:59:50.801463] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 15:59:50.801474] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 15:59:50.801512] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 15:59:50.801572] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 15:59:50.801594] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 15:59:50.847750] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041590847746, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 15:59:50.854460] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041590854456, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 15:59:50.903304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:50.903348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:50.903355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:50.903364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:50.942111] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:50.942157] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38476 [2024-09-11 15:59:50.955577] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4334, replace_start_pos=3400000, replace_num=100000) [2024-09-11 15:59:50.955620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:51.103611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:51.103648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:51.103655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:51.103664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:51.140310] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38476, magic:0x78563412 [2024-09-11 15:59:51.140354] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:51.140361] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:51.155765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:51.185942] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:51.238168] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:51.303898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:51.303959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:51.303967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:51.303977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:51.311158] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7166, clean_start_pos=12200000, clean_num=200000) [2024-09-11 15:59:51.355976] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:51.511481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:51.511526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:51.511556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:51.511568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:51.542438] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:51.542483] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38492 [2024-09-11 15:59:51.556172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:51.711821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:51.711871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:51.711880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:51.711890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:51.740726] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38492, magic:0x78563412 [2024-09-11 15:59:51.740768] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:51.740776] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:51.756371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:51.855316] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041591855312, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 15:59:51.862061] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041591862059, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 15:59:51.912221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:51.912267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:51.912275] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:51.912285] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:51.956493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:52.112543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:52.112577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:52.112584] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:52.112593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:52.142658] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:52.142702] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38504 [2024-09-11 15:59:52.156686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:52.186129] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:52.239313] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:52.312896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:52.312958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:52.312967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:52.312976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:52.341232] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38504, magic:0x78563412 [2024-09-11 15:59:52.341272] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:52.341280] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:52.356872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:52.513273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:52.513315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:52.513324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:52.513333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:52.557095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:52.713631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:52.713670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:52.713678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:52.713687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:52.741823] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:52.741865] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38510 [2024-09-11 15:59:52.757243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:52.862927] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041592862923, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 15:59:52.869760] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041592869757, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007698, add_bytes: 0 [2024-09-11 15:59:52.913943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:52.913988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:52.913995] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:52.914005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:52.940606] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38510, magic:0x78563412 [2024-09-11 15:59:52.940640] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:52.940646] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:52.957360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:53.114262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:53.114327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:53.114335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:53.114344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:53.161890] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4402, replace_start_pos=3500000, replace_num=100000) [2024-09-11 15:59:53.161950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:53.186266] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:53.314649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:53.314693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:53.314701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:53.314711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:53.322454] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7729, clean_start_pos=12400000, clean_num=200000) [2024-09-11 15:59:53.340352] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:53.342629] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:53.342665] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38516 [2024-09-11 15:59:53.362042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:53.522784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:53.522831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:53.522839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:53.522848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:53.523053] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 15:59:53.541283] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38516, magic:0x78563412 [2024-09-11 15:59:53.541322] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:53.541343] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:53.562167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:53.723366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:53.723414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:53.723422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:53.723431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:53.762337] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:53.870608] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041593870604, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 15:59:53.877308] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041593877306, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 15:59:53.923731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:53.923775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:53.923783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:53.923792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:53.943534] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:53.943576] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38520 [2024-09-11 15:59:53.962470] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:54.124103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:54.124150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:54.124158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:54.124190] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:54.141691] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38520, magic:0x78563412 [2024-09-11 15:59:54.141728] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:54.141735] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:54.162600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:54.186382] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:54.324492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:54.324546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:54.324562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:54.324572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:54.341343] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:54.362730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:54.524879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:54.524946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:54.524956] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:54.524967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:54.543854] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:54.543899] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38528 [2024-09-11 15:59:54.562925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:54.725206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:54.725249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:54.725256] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:54.725266] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:54.742052] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38528, magic:0x78563412 [2024-09-11 15:59:54.742090] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:54.742096] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:54.763060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:54.878159] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041594878156, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 15:59:54.884934] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041594884931, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 15:59:54.925594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:54.925640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:54.925649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:54.925658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:54.963186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:55.125983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:55.126027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:55.126034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:55.126043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:55.144043] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:55.144087] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38542 [2024-09-11 15:59:55.163406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:55.186507] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:55.326288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:55.326329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:55.326336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:55.326345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:55.334888] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8529, clean_start_pos=0, clean_num=200000) [2024-09-11 15:59:55.342387] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:55.342634] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38542, magic:0x78563412 [2024-09-11 15:59:55.342653] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:55.342659] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:55.367783] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4225, replace_start_pos=3600000, replace_num=100000) [2024-09-11 15:59:55.367826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:55.535227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:55.535272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:55.535280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:55.535290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:55.567918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:55.735519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:55.735561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:55.735570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:55.735579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:55.745038] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:55.745095] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5176 [2024-09-11 15:59:55.768031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:55.885833] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041595885829, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 15:59:55.892544] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041595892540, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 15:59:55.935899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:55.935976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:55.935984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:55.935993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:55.943233] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5176, magic:0x78563412 [2024-09-11 15:59:55.943273] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:55.943280] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:55.968156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:56.136377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:56.136423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:56.136430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:56.136440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:56.168389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:56.186642] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:56.336740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:56.336810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:56.336819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:56.336828] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:56.343501] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:56.345517] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:56.345554] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5188 [2024-09-11 15:59:56.368566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:56.537147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:56.537194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:56.537202] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:56.537212] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:56.543775] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5188, magic:0x78563412 [2024-09-11 15:59:56.543821] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:56.543829] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:56.568691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:56.737521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:56.737565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:56.737573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:56.737584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:56.768815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:56.893392] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041596893386, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 15:59:56.900220] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041596900216, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 15:59:56.937884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:56.937956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:56.937965] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:56.937974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:56.945954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:56.945990] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5196 [2024-09-11 15:59:56.969027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:57.138233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:57.138280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:57.138287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:57.138297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:57.144287] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5196, magic:0x78563412 [2024-09-11 15:59:57.144316] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:57.144322] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:57.169151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:57.186772] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:57.338600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:57.338647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:57.338655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:57.338665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:57.344468] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:57.345912] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7214, clean_start_pos=200000, clean_num=200000) [2024-09-11 15:59:57.369285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:57.546224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:57.546283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:57.546292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:57.546302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:57.546537] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:57.546571] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5204 [2024-09-11 15:59:57.573895] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4425, replace_start_pos=3700000, replace_num=100000) [2024-09-11 15:59:57.573949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:57.744657] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5204, magic:0x78563412 [2024-09-11 15:59:57.744696] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:57.744702] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:57.746531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:57.746564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:57.746572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:57.746580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:57.774029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 15:59:57.901070] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041597901066, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 15:59:57.907778] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041597907773, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 15:59:57.946877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:57.946950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:57.946959] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:57.946968] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:57.974158] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 15:59:58.146933] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:58.146976] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5220 [2024-09-11 15:59:58.147197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:58.147228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:58.147236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:58.147245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:58.174280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 15:59:58.186954] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:58.345317] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5220, magic:0x78563412 [2024-09-11 15:59:58.345347] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:58.345353] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:58.345373] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:58.347479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:58.347505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:58.347514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:58.347523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:58.374494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 15:59:58.547821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:58.547864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:58.547872] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:58.547899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:58.574611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 15:59:58.747023] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:58.747065] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5226 [2024-09-11 15:59:58.748180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:58.748215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:58.748222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:58.748231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:58.774730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 15:59:58.908681] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041598908676, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 15:59:58.915446] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041598915442, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 15:59:58.945585] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5226, magic:0x78563412 [2024-09-11 15:59:58.945632] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:58.945641] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:58.948479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:58.948515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:58.948522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:58.948531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:58.974854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 15:59:59.148784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:59.148828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:59.148834] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:59.148842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:59.175069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 15:59:59.187089] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 15:59:59.346589] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 15:59:59.347674] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:59.348126] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=441] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5228 [2024-09-11 15:59:59.349047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:59.349071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:59.349076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:59.349083] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:59.355821] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6727, clean_start_pos=400000, clean_num=200000) [2024-09-11 15:59:59.375193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 15:59:59.546121] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5228, magic:0x78563412 [2024-09-11 15:59:59.546169] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 15:59:59.546177] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 15:59:59.556078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:59.556124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:59.556130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:59.556139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:59.575309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 15:59:59.756402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:59.756446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:59.756454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:59.756463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:59.778764] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3326, replace_start_pos=3800000, replace_num=100000) [2024-09-11 15:59:59.778808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 15:59:59.916234] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041599916230, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 15:59:59.922992] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041599922990, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 15:59:59.947456] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 15:59:59.947486] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5232 [2024-09-11 15:59:59.956754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 15:59:59.956783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 15:59:59.956789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 15:59:59.956797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 15:59:59.978888] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:00.145822] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5232, magic:0x78563412 [2024-09-11 16:00:00.145865] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:00.145887] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:00.157094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:00.157133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:00.157141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:00.157152] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:00.179013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:00.187221] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:00.348944] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=1448] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:00.357442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:00.357478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:00.357486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:00.357496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:00.379137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:00.546720] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:00.546763] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5236 [2024-09-11 16:00:00.557798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:00.557842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:00.557850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:00.557860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:00.579260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:00.745006] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5236, magic:0x78563412 [2024-09-11 16:00:00.745052] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:00.745059] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:00.758156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:00.758200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:00.758208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:00.758217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:00.779379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:00.817167] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:00.817216] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:00.817298] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=62, max_check_version=63, global_version=64) [2024-09-11 16:00:00.819328] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2029 [2024-09-11 16:00:00.819367] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:00.819402] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:00:00.819461] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:00:00.819545] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:00.819652] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:00:00.819708] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:00:00.819724] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:00:00.819735] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:00:00.819772] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:00:00.819832] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:00:00.819853] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:00:00.909773] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:00:00.923853] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041600923848, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:00:00.923899] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:00:00.928353] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:00:00.930672] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041600930670, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:00:00.930700] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:00:00.958512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:00.958558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:00.958566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:00.958575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:00.979558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:01.145931] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:01.145977] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5238 [2024-09-11 16:00:01.158812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:01.158855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:01.158862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:01.158872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:01.179739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:01.187378] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:01.344595] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5238, magic:0x78563412 [2024-09-11 16:00:01.344639] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:01.344648] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:01.350226] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:01.359177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:01.359212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:01.359220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:01.359229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:01.366984] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7741, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:00:01.379857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:01.567351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:01.567399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:01.567407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:01.567416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:01.579986] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:01.745849] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:01.745894] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5242 [2024-09-11 16:00:01.767670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:01.767716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:01.767724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:01.767733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:01.780174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:01.931477] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726041601931472, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:00:01.938241] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041601938236, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:00:01.944169] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5242, magic:0x78563412 [2024-09-11 16:00:01.944214] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:01.944220] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:01.968018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:01.968061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:01.968069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:01.968079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:01.984006] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3702, replace_start_pos=3900000, replace_num=100000) [2024-09-11 16:00:01.984055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:02.168314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:02.168361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:02.168368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:02.168377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:02.184148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:02.187497] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:02.345719] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:02.345763] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5244 [2024-09-11 16:00:02.351060] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:02.368617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:02.368660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:02.368668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:02.368677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:02.384280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:02.543320] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5244, magic:0x78563412 [2024-09-11 16:00:02.543362] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:02.543370] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:02.568956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:02.568999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:02.569007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:02.569016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:02.584404] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:02.769356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:02.769406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:02.769414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:02.769424] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:02.784531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:02.939096] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041602939092, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:00:02.945060] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:02.945102] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5256 [2024-09-11 16:00:02.945856] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041602945853, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:00:02.969673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:02.969729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:02.969740] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:02.969752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:02.984669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:03.143714] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5256, magic:0x78563412 [2024-09-11 16:00:03.143754] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:03.143760] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:03.170041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:03.170086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:03.170094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:03.170102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:03.184873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:03.187611] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:03.351949] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:03.370400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:03.370438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:03.370446] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:03.370455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:03.378215] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7746, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:00:03.385077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:03.545854] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:03.545900] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5262 [2024-09-11 16:00:03.578471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:03.578518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:03.578526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:03.578535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:03.585307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:03.744356] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5262, magic:0x78563412 [2024-09-11 16:00:03.744400] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:03.744408] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:03.778863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:03.778937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:03.778951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:03.778964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:03.785437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:03.946714] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041603946710, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:00:03.953475] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041603953470, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:00:03.979293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:03.979343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:03.979351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:03.979361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:03.985624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:04.146691] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:04.146731] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5270 [2024-09-11 16:00:04.179606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:04.179653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:04.179660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:04.179670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:04.187716] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=28] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:04.190140] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4383, replace_start_pos=4000000, replace_num=100000) [2024-09-11 16:00:04.190178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:04.344816] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5270, magic:0x78563412 [2024-09-11 16:00:04.344860] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:04.344867] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:04.352790] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:04.379999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:04.380036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:04.380044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:04.380054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:04.390309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:04.580349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:04.580395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:04.580403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:04.580412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:04.590501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:04.746807] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:04.746849] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5280 [2024-09-11 16:00:04.780633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:04.780672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:04.780678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:04.780686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:04.790668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:04.945073] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5280, magic:0x78563412 [2024-09-11 16:00:04.945115] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:04.945123] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:04.954315] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041604954312, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:00:04.961075] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041604961070, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:00:04.981013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:04.981061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:04.981069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:04.981079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:04.990797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:05.181305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:05.181341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:05.181348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:05.181357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:05.187917] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:05.190929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:05.346061] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:05.346105] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5290 [2024-09-11 16:00:05.353689] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:05.381616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:05.381655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:05.381665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:05.381676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:05.389799] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8108, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:00:05.391108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:05.544473] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5290, magic:0x78563412 [2024-09-11 16:00:05.544515] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:05.544523] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:05.590133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:05.590178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:05.590185] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:05.590195] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:05.591224] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:05.790425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:05.790467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:05.790475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:05.790485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:05.791349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:05.945463] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:05.945504] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35438 [2024-09-11 16:00:05.961996] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041605961991, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:00:05.968698] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041605968694, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:00:05.990727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:05.990771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:05.990779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:05.990787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:05.991521] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:06.143792] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35438, magic:0x78563412 [2024-09-11 16:00:06.143833] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:06.143840] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:06.188115] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:06.191024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:06.191057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:06.191065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:06.191074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:06.191629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:06.354844] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:06.391321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:06.391361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:06.391368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:06.391393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:06.395240] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3426, replace_start_pos=4100000, replace_num=100000) [2024-09-11 16:00:06.395270] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:06.546273] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:06.546316] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35440 [2024-09-11 16:00:06.591690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:06.591743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:06.591752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:06.591762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:06.595355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:06.744383] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35440, magic:0x78563412 [2024-09-11 16:00:06.744427] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:06.744434] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:06.792013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:06.792053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:06.792060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:06.792069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:06.795467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:06.969620] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041606969616, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:00:06.976417] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041606976413, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007719, add_bytes: 0 [2024-09-11 16:00:06.992421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:06.992460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:06.992466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:06.992473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:06.995682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:07.146010] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:07.146048] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35446 [2024-09-11 16:00:07.188258] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:07.192718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:07.192758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:07.192766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:07.192774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:07.195858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:07.344568] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35446, magic:0x78563412 [2024-09-11 16:00:07.344614] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:07.344622] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:07.355933] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:07.393048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:07.393099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:07.393106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:07.393115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:07.395965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:07.400850] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7701, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:00:07.596131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:07.601185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:07.601228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:07.601236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:07.601245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:07.746712] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:07.746754] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35452 [2024-09-11 16:00:07.796277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:07.801548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:07.801590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:07.801598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:07.801607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:07.945010] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35452, magic:0x78563412 [2024-09-11 16:00:07.945048] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:07.945056] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:07.979119] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041607979115, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1009499, add_bytes: 0 [2024-09-11 16:00:07.983974] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041607983971, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:00:07.996403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:08.001848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:08.001887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:08.001896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:08.001929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:08.188383] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:08.196522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:08.202146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:08.202185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:08.202192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:08.202200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:08.346653] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:08.346695] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35454 [2024-09-11 16:00:08.356886] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:08.396709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:08.402441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:08.402494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:08.402502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:08.402512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:08.545434] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35454, magic:0x78563412 [2024-09-11 16:00:08.545474] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:08.545482] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:08.601329] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4393, replace_start_pos=4200000, replace_num=100000) [2024-09-11 16:00:08.601379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:08.602799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:08.602844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:08.602852] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:08.602863] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:08.801475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:08.803058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:08.803086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:08.803093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:08.803101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:08.947512] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:08.947559] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35456 [2024-09-11 16:00:08.984777] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726041608984773, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1005658, add_bytes: 0 [2024-09-11 16:00:08.991539] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041608991537, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:00:09.001591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:09.003309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:09.003337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:09.003358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:09.003365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:09.145886] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35456, magic:0x78563412 [2024-09-11 16:00:09.145943] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:09.145952] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:09.188529] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:09.201762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:09.203626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:09.203652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:09.203658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:09.203665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:09.357809] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:09.401896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:09.403866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:09.403894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:09.403915] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:09.403923] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:09.410719] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6784, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:00:09.547572] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:09.547616] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35460 [2024-09-11 16:00:09.602039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:09.611015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:09.611048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:09.611053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:09.611077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:09.746186] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35460, magic:0x78563412 [2024-09-11 16:00:09.746226] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:09.746234] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:09.802176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:09.811305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:09.811348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:09.811355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:09.811364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:09.811577] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=74, refresh_score_time=62, wash_time=0) [2024-09-11 16:00:09.992457] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041609992454, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:00:09.999220] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726041609999217, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:00:10.002317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:10.011873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:10.011923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:10.011932] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:10.011941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:10.148636] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:10.148680] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35470 [2024-09-11 16:00:10.188718] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:10.202434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:10.212273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:10.212317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:10.212324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:10.212332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:10.345442] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35470, magic:0x78563412 [2024-09-11 16:00:10.345481] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:10.345489] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:10.358799] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=113] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:10.402564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:10.412548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:10.412594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:10.412601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:10.412609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:10.602747] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:10.612941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:10.612985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:10.612992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:10.613000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:10.748940] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:10.748984] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35482 [2024-09-11 16:00:10.806332] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3372, replace_start_pos=4300000, replace_num=100000) [2024-09-11 16:00:10.806374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:10.813208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:10.813244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:10.813250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:10.813258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:10.834896] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:10.834965] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=68] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:10.835045] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=63, max_check_version=64, global_version=65) [2024-09-11 16:00:10.837061] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2015 [2024-09-11 16:00:10.837104] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:10.837138] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:00:10.837193] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:00:10.837282] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:10.837390] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:00:10.837448] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:00:10.837469] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:00:10.837481] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:00:10.837518] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:00:10.837578] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:00:10.837599] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:00:10.946158] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35482, magic:0x78563412 [2024-09-11 16:00:10.946188] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:10.946195] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:11.000073] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041611000070, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:00:11.006547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:11.006782] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041611006780, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:00:11.013499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:11.013532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:11.013540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:11.013548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:11.188928] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:11.206723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:11.213779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:11.213814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:11.213822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:11.213830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:11.348181] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:11.348220] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35488 [2024-09-11 16:00:11.359933] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:11.406927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:11.414151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:11.414196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:11.414202] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:11.414210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:11.420953] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6731, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:00:11.546657] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35488, magic:0x78563412 [2024-09-11 16:00:11.546706] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:11.546713] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:11.607057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:11.621224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:11.621268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:11.621275] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:11.621283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:11.807193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:11.821537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:11.821573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:11.821580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:11.821589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:11.948413] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:11.948457] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35502 [2024-09-11 16:00:12.007324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:12.007635] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041612007632, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:00:12.014400] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726041612014397, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:00:12.021795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:12.021841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:12.021847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:12.021854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:12.146891] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35502, magic:0x78563412 [2024-09-11 16:00:12.146966] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=68] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:12.146975] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:12.189057] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:12.207457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:12.222061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:12.222116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:12.222125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:12.222137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:12.360788] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:12.407596] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:12.422376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:12.422420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:12.422426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:12.422435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:12.549139] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:12.549184] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35504 [2024-09-11 16:00:12.607793] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:12.622670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:12.622716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:12.622724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:12.622765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:12.747409] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35504, magic:0x78563412 [2024-09-11 16:00:12.747453] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:12.747461] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:12.807973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:12.823012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:12.823052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:12.823058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:12.823065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:13.012497] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4378, replace_start_pos=4400000, replace_num=100000) [2024-09-11 16:00:13.012546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:13.015238] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726041613015237, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:00:13.022083] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041613022081, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:00:13.023285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:13.023319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:13.023327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:13.023336] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:13.149475] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:13.149520] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35520 [2024-09-11 16:00:13.189205] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:13.212644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:13.223597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:13.223641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:13.223648] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:13.223657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:13.347634] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35520, magic:0x78563412 [2024-09-11 16:00:13.347675] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:13.347683] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:13.361919] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:13.412780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:13.423875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:13.423939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:13.423946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:13.423953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:13.430439] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6473, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:00:13.612920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:13.630710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:13.630762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:13.630769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:13.630779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:13.749645] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:13.749689] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35536 [2024-09-11 16:00:13.813039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:13.831040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:13.831111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:13.831118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:13.831126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:13.948028] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35536, magic:0x78563412 [2024-09-11 16:00:13.948072] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:13.948081] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:14.013215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:14.022863] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726041614022860, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:00:14.029684] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041614029680, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:00:14.031427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:14.031462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:14.031469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:14.031477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:14.189329] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:14.213365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:14.231706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:14.231747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:14.231754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:14.231761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:14.349756] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:14.349802] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35538 [2024-09-11 16:00:14.362959] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:14.413484] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:14.432001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:14.432043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:14.432049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:14.432056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:14.548360] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35538, magic:0x78563412 [2024-09-11 16:00:14.548410] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:14.548419] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:14.613603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:14.632299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:14.632345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:14.632353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:14.632363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:14.813795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:14.832592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:14.832632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:14.832656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:14.832663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:14.949046] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:14.949084] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35552 [2024-09-11 16:00:15.013983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:15.030536] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726041615030532, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:00:15.032945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:15.032979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:15.032988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:15.032997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:15.037252] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041615037250, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:00:15.147692] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35552, magic:0x78563412 [2024-09-11 16:00:15.147733] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:15.147741] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:15.189459] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:15.218517] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4347, replace_start_pos=4500000, replace_num=100000) [2024-09-11 16:00:15.218560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:15.233239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:15.233309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:15.233317] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:15.233327] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:15.365679] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=1839] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:15.418708] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:15.433618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:15.433664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:15.433671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:15.433680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:15.440780] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7087, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:00:15.549454] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:15.549498] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25574 [2024-09-11 16:00:15.618927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:15.641045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:15.641090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:15.641098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:15.641107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:15.748210] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25574, magic:0x78563412 [2024-09-11 16:00:15.748252] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:15.748259] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:15.819113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:15.841352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:15.841402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:15.841430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:15.841440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:16.019234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:16.038157] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041616038153, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:00:16.041745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:16.041784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:16.041855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:16.041867] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:16.044868] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726041616044866, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:00:16.150742] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:16.150789] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25580 [2024-09-11 16:00:16.189594] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:16.219347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:16.242169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:16.242220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:16.242229] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:16.242240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:16.348538] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25580, magic:0x78563412 [2024-09-11 16:00:16.348596] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:16.348604] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:16.366432] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:16.419523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:16.442485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:16.442556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:16.442563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:16.442571] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:16.619645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:16.642865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:16.642931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:16.642940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:16.642950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:16.750234] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:16.750278] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25586 [2024-09-11 16:00:16.819828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:16.843188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:16.843226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:16.843232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:16.843240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:16.949059] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25586, magic:0x78563412 [2024-09-11 16:00:16.949098] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:16.949106] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:17.019924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:17.043543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:17.043589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:17.043597] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:17.043607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:17.045705] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041617045702, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:00:17.052471] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041617052468, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:00:17.189824] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:17.220056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:17.243851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:17.243892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:17.243898] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:17.243930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:17.349923] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:17.349963] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25594 [2024-09-11 16:00:17.368219] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:17.424584] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4394, replace_start_pos=4600000, replace_num=100000) [2024-09-11 16:00:17.424634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:17.444153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:17.444193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:17.444200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:17.444207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:17.450949] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6729, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:00:17.548417] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25594, magic:0x78563412 [2024-09-11 16:00:17.548455] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:17.548462] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:17.624784] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:17.651235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:17.651281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:17.651289] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:17.651299] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:17.824959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:17.851517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:17.851559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:17.851566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:17.851574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:17.950233] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:17.950269] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25608 [2024-09-11 16:00:18.025090] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:18.051951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:18.051991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:18.052011] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:18.052019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:18.053323] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726041618053321, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:00:18.060154] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726041618060151, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:00:18.148922] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25608, magic:0x78563412 [2024-09-11 16:00:18.148956] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:18.148964] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:18.190002] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:18.225211] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:18.252325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:18.252372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:18.252380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:18.252390] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:18.369389] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:18.425346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:18.452691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:18.452737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:18.452745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:18.452755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:18.551074] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:18.551120] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25624 [2024-09-11 16:00:18.625485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:18.653018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:18.653066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:18.653091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:18.653099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:18.749338] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25624, magic:0x78563412 [2024-09-11 16:00:18.749375] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:18.749382] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:18.825608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:18.853320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:18.853366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:18.853373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:18.853380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:19.025785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:19.053648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:19.053689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:19.053695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:19.053703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:19.061005] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041619061002, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:00:19.067761] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041619067759, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:00:19.151661] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:19.151698] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25640 [2024-09-11 16:00:19.190143] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:19.225920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:19.254055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:19.254105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:19.254112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:19.254120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:19.350033] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25640, magic:0x78563412 [2024-09-11 16:00:19.350075] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:19.350081] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:19.370645] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:19.426056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:19.454416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:19.454462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:19.454471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:19.454481] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:19.463099] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8603, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:00:19.630572] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4322, replace_start_pos=4700000, replace_num=100000) [2024-09-11 16:00:19.630620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:19.663378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:19.663424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:19.663432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:19.663440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:19.751495] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:19.751539] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25650 [2024-09-11 16:00:19.830774] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:19.863702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:19.863743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:19.863749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:19.863757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:19.950242] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25650, magic:0x78563412 [2024-09-11 16:00:19.950282] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:19.950290] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:20.030959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:20.064034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:20.064079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:20.064087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:20.064097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:20.068620] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041620068617, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:00:20.075317] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041620075312, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:00:20.190269] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:20.231077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:20.264329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:20.264371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:20.264379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:20.264388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:20.352525] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:20.352569] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25664 [2024-09-11 16:00:20.371954] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:20.431196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:20.464685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:20.464734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:20.464742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:20.464750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:20.550960] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25664, magic:0x78563412 [2024-09-11 16:00:20.551002] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:20.551009] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:20.631326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:20.665067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:20.665108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:20.665115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:20.665123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:20.831495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:20.850617] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:20.850688] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=68] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:20.850771] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] update_check_range(min_check_version=64, max_check_version=65, global_version=66) [2024-09-11 16:00:20.852779] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2008 [2024-09-11 16:00:20.852815] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:20.852849] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:00:20.852888] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:00:20.852987] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:20.853106] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:00:20.853155] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:00:20.853167] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:00:20.853178] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:00:20.853219] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:00:20.853279] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:00:20.853300] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:00:20.865362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:20.865413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:20.865420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:20.865428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:20.951535] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:20.951582] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25670 [2024-09-11 16:00:21.031684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:21.065646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:21.065694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:21.065700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:21.065727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:21.076175] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041621076171, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:00:21.082940] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041621082937, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:00:21.150169] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25670, magic:0x78563412 [2024-09-11 16:00:21.150215] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:21.150222] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:21.190509] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=87] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:21.231921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:21.265975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:21.266018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:21.266024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:21.266031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:21.373467] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:21.432110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:21.466254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:21.466299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:21.466305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:21.466313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:21.473047] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6722, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:00:21.552705] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:21.552748] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25686 [2024-09-11 16:00:21.632299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:21.673329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:21.673374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:21.673402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:21.673411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:21.750983] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25686, magic:0x78563412 [2024-09-11 16:00:21.751026] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:21.751035] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:21.836756] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4274, replace_start_pos=4800000, replace_num=100000) [2024-09-11 16:00:21.836802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:21.873649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:21.873692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:21.873698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:21.873706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:22.036894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:22.073970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:22.074019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:22.074027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:22.074036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:22.083783] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041622083779, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:00:22.090551] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041622090547, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:00:22.152552] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:22.152591] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25694 [2024-09-11 16:00:22.190623] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:22.237032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:22.274345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:22.274396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:22.274404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:22.274413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:22.351299] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25694, magic:0x78563412 [2024-09-11 16:00:22.351342] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:22.351349] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:22.374511] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:22.437142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:22.474705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:22.474743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:22.474749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:22.474757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:22.637245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:22.675059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:22.675103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:22.675111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:22.675118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:22.754104] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:22.754150] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25698 [2024-09-11 16:00:22.837361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:22.875381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:22.875425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:22.875432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:22.875441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:22.950826] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25698, magic:0x78563412 [2024-09-11 16:00:22.950866] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:22.950875] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:23.037551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:23.075676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:23.075723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:23.075731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:23.075745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:23.091400] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041623091396, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:00:23.098166] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041623098163, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:00:23.190763] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:23.237730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:23.275980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:23.276024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:23.276030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:23.276037] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:23.353326] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:23.353370] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25708 [2024-09-11 16:00:23.375522] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:23.437926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:23.476284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:23.476330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:23.476338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:23.476347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:23.484263] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7902, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:00:23.550472] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25708, magic:0x78563412 [2024-09-11 16:00:23.550513] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:23.550522] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:23.638114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:23.684525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:23.684573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:23.684579] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:23.684588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:23.684744] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:00:23.838304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:23.885024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:23.885066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:23.885073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:23.885084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:23.952526] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:23.952570] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25712 [2024-09-11 16:00:24.042840] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4418, replace_start_pos=4900000, replace_num=100000) [2024-09-11 16:00:24.042889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:24.085301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:24.085346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:24.085352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:24.085360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:24.098183] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041624098178, bytes: 0, bw: 0.000000 MB/s, add_ts: 1000015, add_bytes: 0 [2024-09-11 16:00:24.099162] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041624099159, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007763, add_bytes: 0 [2024-09-11 16:00:24.150851] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25712, magic:0x78563412 [2024-09-11 16:00:24.150891] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:24.150898] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:24.190888] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:24.243046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:24.285580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:24.285625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:24.285631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:24.285639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:24.376729] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:24.443241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:24.485868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:24.485934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:24.485941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:24.485949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:24.551938] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:24.551980] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25718 [2024-09-11 16:00:24.643438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:24.686175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:24.686220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:24.686226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:24.686234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:24.750372] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25718, magic:0x78563412 [2024-09-11 16:00:24.750421] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:24.750429] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:24.843558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:24.886495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:24.886549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:24.886556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:24.886565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:25.043680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:25.086788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:25.086831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:25.086837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:25.086844] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:25.105206] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=131] PNIO [ratelimit] time: 1726041625105202, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007024, add_bytes: 0 [2024-09-11 16:00:25.106630] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=258] PNIO [ratelimit] time: 1726041625106629, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007470, add_bytes: 0 [2024-09-11 16:00:25.152574] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:25.152620] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25734 [2024-09-11 16:00:25.191026] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:25.243895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:25.287059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:25.287100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:25.287106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:25.287114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:25.350804] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25734, magic:0x78563412 [2024-09-11 16:00:25.350849] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:25.350858] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:25.377704] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:25.444101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:25.487366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:25.487408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:25.487415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:25.487422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:25.494104] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6669, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:00:25.644310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:25.694371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:25.694416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:25.694424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:25.694433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:25.752858] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:25.752920] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40122 [2024-09-11 16:00:25.844507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:25.894679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:25.894732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:25.894740] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:25.894750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:25.951513] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40122, magic:0x78563412 [2024-09-11 16:00:25.951571] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:25.951580] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:26.044691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:26.095015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:26.095061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:26.095068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:26.095077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:26.112818] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041626112814, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:00:26.114243] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726041626114243, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:00:26.191223] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:26.249225] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4346, replace_start_pos=5000000, replace_num=100000) [2024-09-11 16:00:26.249275] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:26.295409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:26.295450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:26.295459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:26.295468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:26.352220] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:26.352264] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40130 [2024-09-11 16:00:26.379059] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:26.449427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:26.495704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:26.495748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:26.495756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:26.495783] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:26.550781] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40130, magic:0x78563412 [2024-09-11 16:00:26.550824] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:26.550832] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:26.649609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:26.696089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:26.696132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:26.696139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:26.696147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:26.849792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:26.896370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:26.896411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:26.896418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:26.896425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:26.953119] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:26.953164] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40138 [2024-09-11 16:00:27.049973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:27.096645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:27.096704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:27.096710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:27.096717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:27.120505] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041627120500, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:00:27.121869] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=10] PNIO [ratelimit] time: 1726041627121868, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:00:27.151366] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40138, magic:0x78563412 [2024-09-11 16:00:27.151401] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:27.151408] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:27.191436] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:27.250171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:27.296971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:27.297010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:27.297016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:27.297023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:27.380495] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:27.450311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:27.497261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:27.497309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:27.497317] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:27.497325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:27.506152] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8814, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:00:27.553571] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:27.553613] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40140 [2024-09-11 16:00:27.650442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:27.706409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:27.706454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:27.706460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:27.706468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:27.751764] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40140, magic:0x78563412 [2024-09-11 16:00:27.751800] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:27.751806] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:27.850576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:27.906764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:27.906810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:27.906818] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:27.906828] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:28.050705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:28.107068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:28.107116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:28.107123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:28.107136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:28.128118] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041628128113, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:00:28.129492] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726041628129490, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:00:28.153704] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:28.153751] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40152 [2024-09-11 16:00:28.191565] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:28.250898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:28.307399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:28.307442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:28.307448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:28.307456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:28.352298] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40152, magic:0x78563412 [2024-09-11 16:00:28.352342] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:28.352348] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:28.381616] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:28.455518] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=142] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4341, replace_start_pos=5100000, replace_num=100000) [2024-09-11 16:00:28.455568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:28.507689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:28.507735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:28.507742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:28.507750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:28.655713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:28.707998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:28.708039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:28.708061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:28.708069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:28.754407] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:28.754452] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40164 [2024-09-11 16:00:28.855849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:28.908312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:28.908362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:28.908368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:28.908377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:28.952860] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40164, magic:0x78563412 [2024-09-11 16:00:28.952934] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:28.952945] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:29.055962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:29.108680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:29.108726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:29.108734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:29.108743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:29.135665] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041629135661, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:00:29.137100] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041629137098, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:00:29.191707] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:29.256078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:29.309026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:29.309070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:29.309077] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:29.309086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:29.353804] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:29.353849] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40176 [2024-09-11 16:00:29.382836] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:29.456195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:29.509330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:29.509372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:29.509380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:29.509389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:29.518645] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9241, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:00:29.552091] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40176, magic:0x78563412 [2024-09-11 16:00:29.552122] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:29.552128] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:29.656314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:29.719010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:29.719059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:29.719067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:29.719078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:29.856552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:29.919356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:29.919401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:29.919409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:29.919418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:29.954591] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:29.954635] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40184 [2024-09-11 16:00:30.056667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:30.119651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:30.119697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:30.119704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:30.119712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:30.119889] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=76, refresh_score_time=58, wash_time=0) [2024-09-11 16:00:30.143295] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726041630143291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:00:30.144771] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726041630144769, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:00:30.152411] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40184, magic:0x78563412 [2024-09-11 16:00:30.152444] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:30.152451] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:30.191886] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:30.256773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:30.320059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:30.320094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:30.320100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:30.320108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:30.384036] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:30.456892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:30.520345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:30.520396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:30.520404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:30.520412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:30.554868] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:30.554920] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40198 [2024-09-11 16:00:30.661362] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=5200000, replace_num=100000) [2024-09-11 16:00:30.661405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:30.720647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:30.720691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:30.720698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:30.720706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:30.753039] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40198, magic:0x78563412 [2024-09-11 16:00:30.753087] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:30.753096] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:30.861485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:30.868277] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:30.868299] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:30.868377] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=65, max_check_version=66, global_version=67) [2024-09-11 16:00:30.870409] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2031 [2024-09-11 16:00:30.870450] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:30.870485] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:00:30.870531] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:00:30.870623] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:30.870707] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:00:30.870751] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:00:30.870760] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:00:30.870771] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:00:30.870803] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:00:30.870851] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:00:30.870869] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:00:30.921023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:30.921065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:30.921074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:30.921084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:31.061592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:31.121378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:31.121416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:31.121423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:31.121450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:31.150963] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041631150959, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:00:31.152345] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726041631152342, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007573, add_bytes: 0 [2024-09-11 16:00:31.154649] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:31.154673] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40212 [2024-09-11 16:00:31.192051] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=89] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:31.261708] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:31.321734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:31.321778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:31.321786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:31.321795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:31.353375] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40212, magic:0x78563412 [2024-09-11 16:00:31.353408] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:31.353415] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:31.384991] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:31.461818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:31.522052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:31.522093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:31.522100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:31.522109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:31.530757] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8634, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:00:31.661930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:31.731030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:31.731102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:31.731109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:31.731117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:31.755125] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:31.755171] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40226 [2024-09-11 16:00:31.862044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:31.931330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:31.931369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:31.931375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:31.931383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:31.953771] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40226, magic:0x78563412 [2024-09-11 16:00:31.953812] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:31.953819] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:32.062159] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:32.131679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:32.131718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:32.131724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:32.131732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:32.153202] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041632153196, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1000854, add_bytes: 0 [2024-09-11 16:00:32.158587] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041632158583, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:00:32.192231] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:32.262272] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:32.332074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:32.332119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:32.332127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:32.332137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:32.356325] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:32.356369] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40232 [2024-09-11 16:00:32.386141] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:32.462381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:32.532385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:32.532436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:32.532444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:32.532453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:32.554420] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40232, magic:0x78563412 [2024-09-11 16:00:32.554461] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:32.554469] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:32.662509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:32.732688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:32.732732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:32.732738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:32.732746] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:32.866996] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4369, replace_start_pos=5300000, replace_num=100000) [2024-09-11 16:00:32.867043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:32.933008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:32.933052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:32.933058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:32.933065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:32.956554] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:32.956594] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40234 [2024-09-11 16:00:33.067124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:33.133360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:33.133398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:33.133405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:33.133413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:33.154862] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40234, magic:0x78563412 [2024-09-11 16:00:33.154900] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:33.154923] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:33.159375] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041633159372, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1006176, add_bytes: 0 [2024-09-11 16:00:33.166133] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041633166129, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:00:33.192428] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:33.267232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:33.333633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:33.333696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:33.333702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:33.333710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:33.387616] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:33.467338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:33.533986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:33.534028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:33.534036] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:33.534045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:33.541393] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7334, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:00:33.556424] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:33.556461] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40240 [2024-09-11 16:00:33.667447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:33.741636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:33.741671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:33.741678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:33.741687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:33.755132] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40240, magic:0x78563412 [2024-09-11 16:00:33.755168] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:33.755174] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:33.867560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:33.941976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:33.942019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:33.942026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:33.942039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:34.067662] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:34.142256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:34.142303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:34.142309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:34.142317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:34.155694] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:34.155739] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40250 [2024-09-11 16:00:34.167000] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726041634166995, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:00:34.173753] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041634173749, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:00:34.192619] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:34.267842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:34.342522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:34.342564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:34.342590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:34.342599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:34.354499] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40250, magic:0x78563412 [2024-09-11 16:00:34.354534] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:34.354542] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:34.388919] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:34.468037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:34.542830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:34.542890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:34.542926] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:34.542941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:34.668234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:34.743446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:34.743529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:34.743537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:34.743578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:34.756747] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:34.756790] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40258 [2024-09-11 16:00:34.868411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:34.943826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:34.943865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:34.943873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:34.943882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:34.955175] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40258, magic:0x78563412 [2024-09-11 16:00:34.955216] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:34.955224] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:35.072516] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3920, replace_start_pos=5400000, replace_num=100000) [2024-09-11 16:00:35.072559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:35.144236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:35.144283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:35.144290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:35.144299] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:35.174612] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041635174608, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:00:35.181366] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041635181362, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:00:35.192760] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:35.272638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:35.344599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:35.344640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:35.344647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:35.344655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:35.357412] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:35.357468] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40260 [2024-09-11 16:00:35.389918] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:35.472754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:35.544866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:35.544928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:35.544954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:35.544961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:35.552453] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7480, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:00:35.555523] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40260, magic:0x78563412 [2024-09-11 16:00:35.555549] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:35.555555] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:35.672868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:35.752694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:35.752734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:35.752741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:35.752749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:35.872987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:35.953072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:35.953112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:35.953118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:35.953126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:35.957229] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:35.957270] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20972 [2024-09-11 16:00:36.073104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:36.153391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:36.153441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:36.153450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:36.153459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:36.155811] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20972, magic:0x78563412 [2024-09-11 16:00:36.155841] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:36.155849] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:36.182222] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041636182217, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:00:36.189053] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041636189050, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:00:36.192898] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:36.273212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:36.353715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:36.353758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:36.353766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:36.353775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:36.391186] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:36.473330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:36.554071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:36.554114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:36.554122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:36.554132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:36.557881] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:36.557940] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20974 [2024-09-11 16:00:36.673528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:36.754439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:36.754482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:36.754489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:36.754496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:36.756440] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20974, magic:0x78563412 [2024-09-11 16:00:36.756474] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:36.756482] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:36.873650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:36.954751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:36.954797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:36.954805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:36.954814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:37.073773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:37.155051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:37.155091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:37.155097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:37.155120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:37.158256] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:37.158280] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20980 [2024-09-11 16:00:37.189842] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041637189839, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:00:37.193028] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:37.196614] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041637196612, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:00:37.278283] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4390, replace_start_pos=5500000, replace_num=100000) [2024-09-11 16:00:37.278324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:37.355376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:37.355432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:37.355440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:37.355449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:37.356964] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20980, magic:0x78563412 [2024-09-11 16:00:37.357005] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:37.357013] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:37.392405] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:37.478414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:37.555709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:37.555755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:37.555763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:37.555772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:37.564235] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8448, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:00:37.678668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:37.759136] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:37.759183] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20990 [2024-09-11 16:00:37.764477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:37.764510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:37.764516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:37.764524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:37.878812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:37.957452] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20990, magic:0x78563412 [2024-09-11 16:00:37.957490] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:37.957498] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:37.964756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:37.964788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:37.964795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:37.964802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:38.078934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:38.165051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:38.165091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:38.165097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:38.165105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:38.193200] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:38.197469] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041638197465, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:00:38.204227] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041638204224, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:00:38.279038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:38.359497] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:38.359530] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21004 [2024-09-11 16:00:38.365470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:38.365504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:38.365513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:38.365522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:38.393746] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:38.479253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:38.556926] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21004, magic:0x78563412 [2024-09-11 16:00:38.556961] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:38.556967] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:38.565769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:38.565811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:38.565820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:38.565829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:38.679386] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:38.766071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:38.766120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:38.766128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:38.766156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:38.879520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:38.959076] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:38.959119] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21010 [2024-09-11 16:00:38.966403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:38.966440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:38.966447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:38.966456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:39.079709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:39.157294] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21010, magic:0x78563412 [2024-09-11 16:00:39.157324] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:39.157332] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:39.166695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:39.166737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:39.166743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:39.166751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:39.193347] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:39.205072] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041639205068, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:00:39.211890] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041639211888, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:00:39.279847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:39.367021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:39.367064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:39.367070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:39.367078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:39.394583] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:39.483312] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3337, replace_start_pos=5600000, replace_num=100000) [2024-09-11 16:00:39.483360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:39.559719] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:39.559759] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21024 [2024-09-11 16:00:39.567380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:39.567413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:39.567421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:39.567428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:39.574283] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6843, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:00:39.683507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:39.758009] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21024, magic:0x78563412 [2024-09-11 16:00:39.758060] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:39.758069] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:39.774551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:39.774586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:39.774594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:39.774613] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:39.883629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:39.974919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:39.974963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:39.974970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:39.974978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:40.083760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:40.161173] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:40.161216] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21026 [2024-09-11 16:00:40.175205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:40.175253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:40.175259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:40.175267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:40.193468] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:40.212771] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1726041640212767, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007699, add_bytes: 0 [2024-09-11 16:00:40.219514] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041640219511, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:00:40.283889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:40.358405] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21026, magic:0x78563412 [2024-09-11 16:00:40.358463] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:40.358471] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:40.375493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:40.375538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:40.375544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:40.375551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:40.395433] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:40.484035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:40.575807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:40.575849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:40.575856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:40.575866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:40.684224] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:40.759915] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:40.759957] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21042 [2024-09-11 16:00:40.776168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:40.776216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:40.776223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:40.776232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:40.883964] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:40.884007] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:40.884078] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=66, max_check_version=67, global_version=68) [2024-09-11 16:00:40.884349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:40.885861] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1783 [2024-09-11 16:00:40.885895] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:40.885939] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:00:40.885973] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:00:40.886048] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:40.886143] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,685,568 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 198,416 used= 186,136 count= 23 avg_used= 8,092 block_cnt= 23 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,685,568 used= 76,271,908 count= 1,550 avg_used= 49,207 mod=SUMMARY [2024-09-11 16:00:40.886187] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:00:40.886196] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:00:40.886205] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:00:40.886237] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:00:40.886288] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:00:40.886305] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:00:40.958644] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21042, magic:0x78563412 [2024-09-11 16:00:40.958690] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:40.958697] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:40.976546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:40.976598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:40.976607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:40.976618] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:41.084476] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:41.176880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:41.176942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:41.176948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:41.176956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:41.193614] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:41.220366] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041641220360, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:00:41.227073] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041641227069, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:00:41.284612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:41.360079] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:41.360124] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21046 [2024-09-11 16:00:41.377204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:41.377258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:41.377265] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:41.377273] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:41.396423] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:41.484809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:41.558142] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21046, magic:0x78563412 [2024-09-11 16:00:41.558178] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:41.558187] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:41.577565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:41.577602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:41.577608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:41.577615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:41.584668] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7041, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:00:41.688815] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3816, replace_start_pos=5700000, replace_num=100000) [2024-09-11 16:00:41.688860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:41.785031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:41.785078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:41.785103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:41.785112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:41.889015] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:41.960355] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:41.960402] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21054 [2024-09-11 16:00:41.985410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:41.985452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:41.985458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:41.985466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:42.089153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:42.158618] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21054, magic:0x78563412 [2024-09-11 16:00:42.158657] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:42.158665] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:42.185756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:42.185792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:42.185799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:42.185807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:42.193793] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:42.227919] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041642227914, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:00:42.234745] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041642234742, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:00:42.289340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:42.386073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:42.386123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:42.386132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:42.386142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:42.397441] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:42.489459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:42.560894] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:42.560947] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21068 [2024-09-11 16:00:42.586373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:42.586409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:42.586416] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:42.586425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:42.689580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:42.758083] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21068, magic:0x78563412 [2024-09-11 16:00:42.758125] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:42.758133] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:42.786654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:42.786700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:42.786706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:42.786715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:42.889783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:42.987016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:42.987063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:42.987070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:42.987079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:43.090033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:43.159667] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:43.159709] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21074 [2024-09-11 16:00:43.187297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:43.187331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:43.187337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:43.187344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:43.194033] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:43.235593] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041643235588, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:00:43.242358] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041643242354, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:00:43.290230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:43.358302] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21074, magic:0x78563412 [2024-09-11 16:00:43.358338] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:43.358361] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:43.387580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:43.387620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:43.387628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:43.387636] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:43.398662] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:43.490366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:43.587850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:43.587891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:43.587897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:43.587916] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:43.595165] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7237, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:00:43.690549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:43.760255] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:43.760296] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21080 [2024-09-11 16:00:43.795406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:43.795447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:43.795453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:43.795461] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:43.895188] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4398, replace_start_pos=5800000, replace_num=100000) [2024-09-11 16:00:43.895239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:43.958775] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21080, magic:0x78563412 [2024-09-11 16:00:43.958819] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:43.958842] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:43.995725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:43.995778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:43.995786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:43.995795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:44.095322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:44.194166] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:44.196024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:44.196059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:44.196066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:44.196075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:44.243209] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041644243205, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:00:44.249921] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041644249917, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:00:44.295445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:44.360772] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:44.360817] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21094 [2024-09-11 16:00:44.396301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:44.396335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:44.396341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:44.396368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:44.399560] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:44.495680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:44.559232] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21094, magic:0x78563412 [2024-09-11 16:00:44.559274] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:44.559281] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:44.596589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:44.596635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:44.596649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:44.596658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:44.695777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:44.796864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:44.796931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:44.796941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:44.796950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:44.895892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:44.961441] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:44.961486] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21100 [2024-09-11 16:00:44.997176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:44.997218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:44.997225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:44.997235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:45.096019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:45.159665] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21100, magic:0x78563412 [2024-09-11 16:00:45.159704] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:45.159711] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:45.194335] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=86] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:45.197454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:45.197481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:45.197488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:45.197495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:45.250827] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041645250822, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:00:45.257616] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041645257613, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 16:00:45.296135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:45.397733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:45.397769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:45.397776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:45.397785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:45.400385] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:45.496255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:45.560169] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:45.560214] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14244 [2024-09-11 16:00:45.598044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:45.598082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:45.598089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:45.598098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:45.605389] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7259, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:00:45.696367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:45.758928] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14244, magic:0x78563412 [2024-09-11 16:00:45.758971] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:45.758978] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:45.805647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:45.805698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:45.805704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:45.805712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:45.896567] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:46.005962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:46.006004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:46.006010] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:46.006017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:46.101080] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4335, replace_start_pos=5900000, replace_num=100000) [2024-09-11 16:00:46.101142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:46.160983] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:46.161043] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14248 [2024-09-11 16:00:46.194493] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:46.208206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:46.208243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:46.208250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:46.208257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:46.258449] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041646258445, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:00:46.265134] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041646265130, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007517, add_bytes: 0 [2024-09-11 16:00:46.301223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:46.359567] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14248, magic:0x78563412 [2024-09-11 16:00:46.359611] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:46.359619] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:46.401336] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:46.408479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:46.408516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:46.408523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:46.408532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:46.501388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:46.609746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:46.609787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:46.609793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:46.609800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:46.701508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:46.761332] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:46.761377] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14264 [2024-09-11 16:00:46.810044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:46.810086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:46.810093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:46.810100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:46.901632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:46.959838] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14264, magic:0x78563412 [2024-09-11 16:00:46.959878] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:46.959885] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:47.010353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:47.010397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:47.010405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:47.010414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:47.101779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:47.194635] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:47.210658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:47.210698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:47.210705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:47.210729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:47.266000] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041647265996, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:00:47.272751] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041647272749, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:00:47.301959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:47.362169] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:47.362213] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14278 [2024-09-11 16:00:47.402319] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:47.411075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:47.411116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:47.411124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:47.411133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:47.502134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:47.560579] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14278, magic:0x78563412 [2024-09-11 16:00:47.560622] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:47.560630] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:47.611434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:47.611479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:47.611487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:47.611496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:47.618484] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6974, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:00:47.702335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:47.818806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:47.818851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:47.818877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:47.818888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:47.902537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:47.962595] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:47.962639] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14280 [2024-09-11 16:00:48.019209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:48.019255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:48.019263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:48.019273] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:48.102722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:48.159826] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14280, magic:0x78563412 [2024-09-11 16:00:48.159868] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:48.159876] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:48.194763] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:48.219589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:48.219632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:48.219640] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:48.219651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:48.273628] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041648273624, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:00:48.280367] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041648280364, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:00:48.307275] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4351, replace_start_pos=6000000, replace_num=100000) [2024-09-11 16:00:48.307324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:48.403144] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:48.419984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:48.420027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:48.420034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:48.420043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:48.507411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:48.561748] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:48.561793] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14288 [2024-09-11 16:00:48.620338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:48.620383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:48.620391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:48.620401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:48.707535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:48.760173] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14288, magic:0x78563412 [2024-09-11 16:00:48.760214] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:48.760222] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:48.820642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:48.820686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:48.820693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:48.820718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:48.907716] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:49.021053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:49.021099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:49.021107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:49.021116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:49.107831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:49.162959] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:49.163005] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14296 [2024-09-11 16:00:49.194925] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:49.221424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:49.221471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:49.221479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:49.221489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:49.281236] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041649281232, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:00:49.287993] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041649287990, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:00:49.307944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:49.360717] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14296, magic:0x78563412 [2024-09-11 16:00:49.360778] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:49.360788] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:49.404193] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:49.421785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:49.421828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:49.421836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:49.421863] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:49.508054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:49.622163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:49.622211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:49.622225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:49.622235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:49.629801] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7552, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:00:49.708167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:49.762797] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:49.762837] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14304 [2024-09-11 16:00:49.830162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:49.830207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:49.830215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:49.830225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:49.908286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:49.960963] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14304, magic:0x78563412 [2024-09-11 16:00:49.961004] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:49.961027] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:50.030551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:50.030598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:50.030607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:50.030616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:50.108401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:50.195047] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:50.230850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:50.230895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:50.230919] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:50.230930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:50.288851] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041650288847, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:00:50.295692] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041650295687, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 16:00:50.308506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:50.363271] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:50.363318] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14310 [2024-09-11 16:00:50.405050] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:50.431236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:50.431282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:50.431290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:50.431300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:50.431518] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=80, refresh_score_time=62, wash_time=0) [2024-09-11 16:00:50.512801] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4177, replace_start_pos=6100000, replace_num=100000) [2024-09-11 16:00:50.512849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:50.561592] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14310, magic:0x78563412 [2024-09-11 16:00:50.561630] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:50.561638] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:50.631815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:50.631860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:50.631868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:50.631877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:50.712953] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:50.832228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:50.832274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:50.832282] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:50.832292] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:50.899751] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:50.899802] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:00:50.899881] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=67, max_check_version=68, global_version=69) [2024-09-11 16:00:50.901865] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1983 [2024-09-11 16:00:50.901934] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:50.901970] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:00:50.902009] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:00:50.902093] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:00:50.902201] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:00:50.902256] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:00:50.902267] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:00:50.902278] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:00:50.902315] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:00:50.902378] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:00:50.902397] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:00:50.913071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:50.963610] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:50.963649] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14314 [2024-09-11 16:00:51.032596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:51.032646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:51.032655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:51.032665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:51.113184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:51.162095] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14314, magic:0x78563412 [2024-09-11 16:00:51.162137] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:51.162145] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:51.195251] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:51.232988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:51.233032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:51.233040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:51.233066] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:51.296464] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041651296460, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:00:51.303217] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041651303213, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007526, add_bytes: 0 [2024-09-11 16:00:51.313297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:51.405821] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:51.433397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:51.433439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:51.433447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:51.433457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:51.513394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:51.563465] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:51.563504] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14322 [2024-09-11 16:00:51.633753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:51.633798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:51.633805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:51.633816] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:51.641248] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7419, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:00:51.713511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:51.762370] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14322, magic:0x78563412 [2024-09-11 16:00:51.762416] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:51.762424] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:51.841565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:51.841608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:51.841633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:51.841644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:51.913623] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:52.041962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:52.042006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:52.042014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:52.042024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:52.113745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:52.163976] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:52.164021] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14324 [2024-09-11 16:00:52.195382] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:52.242342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:52.242391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:52.242399] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:52.242409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:52.304074] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041652304069, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:00:52.310839] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041652310835, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:00:52.313868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:52.362778] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14324, magic:0x78563412 [2024-09-11 16:00:52.362819] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:52.362826] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:52.406891] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:52.442660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:52.442701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:52.442723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:52.442733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:52.514005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:52.643055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:52.643102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:52.643111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:52.643121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:52.717612] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3482, replace_start_pos=6200000, replace_num=100000) [2024-09-11 16:00:52.717650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:52.764381] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:52.764443] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14334 [2024-09-11 16:00:52.843345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:52.843391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:52.843398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:52.843407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:52.917746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:52.963204] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14334, magic:0x78563412 [2024-09-11 16:00:52.963268] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:52.963275] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:53.043660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:53.043704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:53.043712] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:53.043721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:53.117871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:53.195525] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:53.243966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:53.244011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:53.244018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:53.244028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:53.311692] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041653311688, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:00:53.318010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:53.318454] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041653318453, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:00:53.365149] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:53.365185] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14336 [2024-09-11 16:00:53.407734] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:53.444319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:53.444363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:53.444371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:53.444381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:53.518119] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:53.563707] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14336, magic:0x78563412 [2024-09-11 16:00:53.563750] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:53.563758] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:53.644680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:53.644726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:53.644734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:53.644743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:53.652031] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7274, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:00:53.718323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:53.852384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:53.852431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:53.852439] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:53.852449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:53.852641] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:00:53.918508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:53.966588] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:53.966631] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14348 [2024-09-11 16:00:54.052977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:54.053039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:54.053049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:54.053059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:54.118691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:54.164244] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14348, magic:0x78563412 [2024-09-11 16:00:54.164286] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:54.164294] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:54.195659] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:54.253366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:54.253413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:54.253421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:54.253431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:54.318895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:54.319368] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041654319365, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:00:54.326085] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726041654326080, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:00:54.408466] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:54.453735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:54.453782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:54.453790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:54.453800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:54.519036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:54.565729] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:54.565769] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14360 [2024-09-11 16:00:54.654102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:54.654159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:54.654175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:54.654185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:54.719155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:54.764433] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14360, magic:0x78563412 [2024-09-11 16:00:54.764475] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:54.764492] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=16][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:54.854406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:54.854453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:54.854462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:54.854470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:54.923640] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4366, replace_start_pos=6300000, replace_num=100000) [2024-09-11 16:00:54.923683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:55.054765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:55.054811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:55.054819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:55.054829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:55.123895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:55.166260] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:55.166309] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14362 [2024-09-11 16:00:55.195802] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:55.255074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:55.255118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:55.255127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:55.255137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:55.324102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:55.326982] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041655326979, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:00:55.333744] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041655333741, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 16:00:55.364949] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14362, magic:0x78563412 [2024-09-11 16:00:55.364989] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:55.364996] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:55.409339] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:55.455440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:55.455482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:55.455490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:55.455501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:55.524226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:55.655731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:55.655774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:55.655781] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:55.655790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:55.664320] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8496, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:00:55.724364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:55.766130] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:55.766174] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44812 [2024-09-11 16:00:55.864578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:55.864623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:55.864631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:55.864640] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:55.924511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:55.964349] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44812, magic:0x78563412 [2024-09-11 16:00:55.964390] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:55.964398] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:56.064870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:56.064922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:56.064930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:56.064939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:56.124630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:56.195986] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:56.265165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:56.265208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:56.265215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:56.265223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:56.324762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:56.334606] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041656334602, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:00:56.341326] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041656341323, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007582, add_bytes: 0 [2024-09-11 16:00:56.366457] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:56.366495] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44814 [2024-09-11 16:00:56.410260] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:56.465455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:56.465499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:56.465507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:56.465516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:56.524964] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:56.563876] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44814, magic:0x78563412 [2024-09-11 16:00:56.563931] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:56.563939] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:56.665739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:56.665780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:56.665787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:56.665795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:56.725100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:56.866056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:56.866102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:56.866109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:56.866119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:56.925252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:56.966495] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:56.966540] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44828 [2024-09-11 16:00:57.066343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:57.066385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:57.066394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:57.066403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:57.129807] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4416, replace_start_pos=6400000, replace_num=100000) [2024-09-11 16:00:57.129849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:57.164426] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44828, magic:0x78563412 [2024-09-11 16:00:57.164462] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:57.164468] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:57.196144] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:57.266715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:57.266779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:57.266788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:57.266799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:57.329957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:57.342221] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041657342217, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:00:57.349016] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041657349011, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:00:57.411179] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:57.467092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:57.467138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:57.467146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:57.467155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:57.530088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:57.567143] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:57.567189] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44842 [2024-09-11 16:00:57.667517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:57.667561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:57.667569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:57.667579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:57.675839] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8247, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:00:57.730217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:57.764988] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44842, magic:0x78563412 [2024-09-11 16:00:57.765032] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:57.765040] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:57.876166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:57.876212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:57.876220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:57.876230] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:57.930353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:00:58.076524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:58.076570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:58.076579] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:58.076588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:58.130536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:00:58.166817] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:58.166861] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44848 [2024-09-11 16:00:58.196373] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:58.276811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:58.276857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:58.276865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:58.276875] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:58.330735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:00:58.349768] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041658349764, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:00:58.356631] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041658356628, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:00:58.365341] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44848, magic:0x78563412 [2024-09-11 16:00:58.365370] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:58.365378] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:58.412213] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:58.477091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:58.477130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:58.477136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:58.477145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:58.530877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:00:58.677428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:58.677471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:58.677479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:58.677488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:58.731068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:00:58.767670] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:58.767714] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44850 [2024-09-11 16:00:58.877663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:58.877695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:58.877701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:58.877708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:58.931199] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:00:58.964681] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44850, magic:0x78563412 [2024-09-11 16:00:58.964718] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:58.964726] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:59.078041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:59.078084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:59.078093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:59.078102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:59.131338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:00:59.196563] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:00:59.278389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:59.278434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:59.278442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:59.278451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:59.334789] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3338, replace_start_pos=6500000, replace_num=100000) [2024-09-11 16:00:59.334824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:00:59.357390] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041659357386, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:00:59.364160] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041659364157, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007529, add_bytes: 0 [2024-09-11 16:00:59.365453] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:59.365496] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44864 [2024-09-11 16:00:59.413522] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:00:59.478737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:59.478779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:59.478788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:59.478797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:59.534970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:00:59.563881] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44864, magic:0x78563412 [2024-09-11 16:00:59.563925] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:00:59.563934] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:00:59.679106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:59.679161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:59.679170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:59.679179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:59.687688] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8495, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:00:59.735104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:00:59.887960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:00:59.887997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:00:59.888005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:00:59.888013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:00:59.935236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:00:59.966448] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:00:59.966476] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44872 [2024-09-11 16:01:00.088334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:00.088377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:00.088385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:00.088395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:00.135376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:00.164548] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44872, magic:0x78563412 [2024-09-11 16:01:00.164584] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:00.164592] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:00.196750] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:00.288686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:00.288730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:00.288739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:00.288748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:00.335480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:00.359052] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:01:00.364996] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041660364994, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:01:00.365010] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:01:00.369506] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:01:00.371757] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041660371756, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:01:00.371772] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=15] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:01:00.414966] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:00.489055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:00.489099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:00.489107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:00.489132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:00.535577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:00.566205] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:00.566244] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44878 [2024-09-11 16:01:00.689368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:00.689417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:00.689423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:00.689431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:00.735802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:00.764741] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44878, magic:0x78563412 [2024-09-11 16:01:00.764779] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:00.764786] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:00.889780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:00.889818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:00.889827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:00.889837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:00.916262] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:00.916323] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=59] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:00.916401] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=68, max_check_version=69, global_version=70) [2024-09-11 16:01:00.918361] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1958 [2024-09-11 16:01:00.918393] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:00.918428] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:01:00.918467] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:01:00.918551] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:00.918668] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:01:00.918723] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:01:00.918734] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:01:00.918745] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:01:00.918786] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:01:00.918847] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:01:00.918872] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:01:00.935935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:01.090143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:01.090188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:01.090197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:01.090206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:01.136054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:01.167165] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:01.167206] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44886 [2024-09-11 16:01:01.196928] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:01.290502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:01.290546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:01.290572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:01.290582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:01.336166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:01.365412] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44886, magic:0x78563412 [2024-09-11 16:01:01.365454] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:01.365462] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:01.372632] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726041661372630, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:01:01.379374] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726041661379372, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:01:01.416190] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:01.490884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:01.490948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:01.490957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:01.490967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:01.540634] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4349, replace_start_pos=6600000, replace_num=100000) [2024-09-11 16:01:01.540682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:01.691269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:01.691314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:01.691322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:01.691332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:01.699120] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7774, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:01:01.740771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:01.767730] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:01.767776] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44890 [2024-09-11 16:01:01.899356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:01.899398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:01.899404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:01.899412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:01.940892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:01.966065] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44890, magic:0x78563412 [2024-09-11 16:01:01.966102] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:01.966111] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:02.099706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:02.099751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:02.099759] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:02.099769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:02.141033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:02.197100] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:02.300021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:02.300063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:02.300070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:02.300080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:02.341147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:02.367942] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:02.367985] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44892 [2024-09-11 16:01:02.380301] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041662380297, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:01:02.387065] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726041662387061, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:01:02.417527] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:02.500344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:02.500391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:02.500399] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:02.500408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:02.541260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:02.566440] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44892, magic:0x78563412 [2024-09-11 16:01:02.566485] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:02.566493] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:02.700669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:02.700716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:02.700724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:02.700733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:02.741376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:02.901065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:02.901110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:02.901117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:02.901126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:02.941486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:02.968648] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:02.968690] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44908 [2024-09-11 16:01:03.101497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:03.101541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:03.101548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:03.101557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:03.141608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:03.167146] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44908, magic:0x78563412 [2024-09-11 16:01:03.167185] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:03.167192] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:03.197245] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:03.301861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:03.301920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:03.301930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:03.301940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:03.341722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:03.387855] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041663387850, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:01:03.394721] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041663394717, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007656, add_bytes: 0 [2024-09-11 16:01:03.418849] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:03.502519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:03.502556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:03.502564] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:03.502572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:03.541835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:03.569199] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:03.569237] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44914 [2024-09-11 16:01:03.702891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:03.702954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:03.702961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:03.702969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:03.717258] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=14276, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:01:03.746281] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4328, replace_start_pos=6700000, replace_num=100000) [2024-09-11 16:01:03.746331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:03.767611] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44914, magic:0x78563412 [2024-09-11 16:01:03.767653] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:03.767661] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:03.917531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:03.917575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:03.917582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:03.917592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:03.946414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:04.117831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:04.117880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:04.117887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:04.117895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:04.146651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:04.169146] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:04.169187] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44918 [2024-09-11 16:01:04.197370] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:04.318155] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:04.318197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:04.318203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:04.318211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:04.346836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:04.367948] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44918, magic:0x78563412 [2024-09-11 16:01:04.367988] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:04.367997] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:04.395545] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=80] PNIO [ratelimit] time: 1726041664395540, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:01:04.402310] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041664402305, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007588, add_bytes: 0 [2024-09-11 16:01:04.420000] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:04.518456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:04.518502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:04.518510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:04.518519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:04.546957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:04.718786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:04.718847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:04.718855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:04.718864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:04.747079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:04.769670] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:04.769715] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44930 [2024-09-11 16:01:04.919106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:04.919147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:04.919155] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:04.919164] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:04.947197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:04.968215] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44930, magic:0x78563412 [2024-09-11 16:01:04.968244] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:04.968250] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:05.119434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:05.119479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:05.119503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:05.119513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:05.147318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:05.197515] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:05.319731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:05.319767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:05.319772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:05.319780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:05.347438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:05.370472] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:05.370517] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44936 [2024-09-11 16:01:05.403157] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041665403153, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:01:05.409838] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=223] PNIO [ratelimit] time: 1726041665409833, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007528, add_bytes: 0 [2024-09-11 16:01:05.420922] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:05.520083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:05.520128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:05.520136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:05.520147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:05.547555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:05.568884] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44936, magic:0x78563412 [2024-09-11 16:01:05.568948] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=59] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:05.568956] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:05.720377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:05.720442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:05.720449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:05.720458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:05.728283] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7809, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:01:05.747676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:05.928618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:05.928661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:05.928668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:05.928676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:05.951921] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4129, replace_start_pos=6800000, replace_num=100000) [2024-09-11 16:01:05.951971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:05.970417] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:05.970459] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35442 [2024-09-11 16:01:06.129013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:06.129054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:06.129062] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:06.129071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:06.152051] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:06.168073] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35442, magic:0x78563412 [2024-09-11 16:01:06.168116] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:06.168125] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:06.197665] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:06.329326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:06.329372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:06.329380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:06.329389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:06.352259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:06.410705] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041666410700, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:01:06.417460] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041666417456, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:01:06.422253] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:06.529627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:06.529671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:06.529677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:06.529685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:06.552377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:06.571199] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:06.571246] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35452 [2024-09-11 16:01:06.730019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:06.730063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:06.730069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:06.730077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:06.752504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:06.768581] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35452, magic:0x78563412 [2024-09-11 16:01:06.768621] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:06.768629] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:06.930444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:06.930489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:06.930497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:06.930508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:06.952629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:07.130765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:07.130807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:07.130814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:07.130824] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:07.152832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:07.170577] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:07.170622] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35458 [2024-09-11 16:01:07.197868] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:07.331063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:07.331127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:07.331134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:07.331141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:07.352969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:07.369078] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35458, magic:0x78563412 [2024-09-11 16:01:07.369121] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:07.369129] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:07.418312] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041667418308, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:01:07.423455] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:07.425073] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041667425072, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:01:07.531363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:07.531408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:07.531415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:07.531422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:07.553166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:07.731741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:07.731791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:07.731800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:07.731810] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:07.740397] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8573, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:01:07.753283] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:07.770800] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:07.770837] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35470 [2024-09-11 16:01:07.940675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:07.940720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:07.940728] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:07.940737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:07.953395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:07.969293] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35470, magic:0x78563412 [2024-09-11 16:01:07.969330] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:07.969337] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:08.141004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:08.141043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:08.141050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:08.141057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:08.157293] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3773, replace_start_pos=6900000, replace_num=100000) [2024-09-11 16:01:08.157331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:08.198095] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:08.341339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:08.341386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:08.341397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:08.341434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:08.357414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:08.371500] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:08.371539] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35486 [2024-09-11 16:01:08.424781] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:08.425993] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041668425990, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:01:08.432756] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726041668432752, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:01:08.541785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:08.541831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:08.541839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:08.541849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:08.557593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:08.569916] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35486, magic:0x78563412 [2024-09-11 16:01:08.569958] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:08.569966] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:08.742066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:08.742107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:08.742113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:08.742121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:08.757725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:08.942393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:08.942441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:08.942450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:08.942460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:08.957868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:08.972051] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:08.972090] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35502 [2024-09-11 16:01:09.142710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:09.142754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:09.142761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:09.142769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:09.158003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:09.169181] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35502, magic:0x78563412 [2024-09-11 16:01:09.169221] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:09.169229] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:09.198299] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:09.343032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:09.343078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:09.343087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:09.343097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:09.358135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:09.426276] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:09.433546] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041669433542, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:01:09.440319] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041669440316, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:01:09.543335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:09.543380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:09.543386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:09.543411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:09.558280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:09.570956] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:09.570996] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35518 [2024-09-11 16:01:09.743650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:09.743694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:09.743701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:09.743708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:09.750341] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6622, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:01:09.758399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:09.769490] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35518, magic:0x78563412 [2024-09-11 16:01:09.769533] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:09.769540] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:09.950600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:09.950642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:09.950649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:09.950657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:09.958513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:10.150878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:10.150939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:10.150946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:10.150953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:10.158651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:10.171768] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:10.171807] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35524 [2024-09-11 16:01:10.198503] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:10.351230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:10.351271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:10.351279] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:10.351288] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:10.362780] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4014, replace_start_pos=7000000, replace_num=100000) [2024-09-11 16:01:10.362826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:10.370098] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35524, magic:0x78563412 [2024-09-11 16:01:10.370139] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:10.370147] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:10.427669] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:10.441182] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041670441178, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:01:10.447934] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041670447930, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:01:10.551525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:10.551573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:10.551581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:10.551611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:10.562916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:10.751934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:10.751976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:10.751984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:10.751993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:10.752209] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=77, refresh_score_time=63, wash_time=0) [2024-09-11 16:01:10.763024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:10.771716] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:10.771754] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35528 [2024-09-11 16:01:10.932625] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:10.932688] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=61] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:10.932774] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] update_check_range(min_check_version=69, max_check_version=70, global_version=71) [2024-09-11 16:01:10.934790] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2015 [2024-09-11 16:01:10.934850] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:10.934886] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:01:10.934938] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:01:10.935028] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:10.935136] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:01:10.935193] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:01:10.935204] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:01:10.935215] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:01:10.935251] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:01:10.935311] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:01:10.935334] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:01:10.952512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:10.952559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:10.952567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:10.952576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:10.963142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:10.970502] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35528, magic:0x78563412 [2024-09-11 16:01:10.970538] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:10.970547] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:11.152809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:11.152853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:11.152861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:11.152870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:11.163375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:11.198667] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:11.353096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:11.353154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:11.353162] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:11.353188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:11.363487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:11.371255] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:11.371299] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35534 [2024-09-11 16:01:11.428998] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:11.448849] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041671448845, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:01:11.455551] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041671455548, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:01:11.553418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:11.553460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:11.553468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:11.553477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:11.563613] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:11.569691] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35534, magic:0x78563412 [2024-09-11 16:01:11.569725] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:11.569731] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:11.753710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:11.753748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:11.753756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:11.753765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:11.760673] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6896, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:01:11.763715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:11.960947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:11.960983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:11.961007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:11.961016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:11.963816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:11.972080] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:11.972109] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35548 [2024-09-11 16:01:12.161266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:12.161304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:12.161311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:12.161320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:12.163929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:12.170275] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35548, magic:0x78563412 [2024-09-11 16:01:12.170317] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:12.170326] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:12.198788] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:12.361617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:12.361661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:12.361669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:12.361679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:12.364096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:12.430377] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:12.456392] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041672456388, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:01:12.463153] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041672463151, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:01:12.562029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:12.562071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:12.562096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:12.562105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:12.567848] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3642, replace_start_pos=7100000, replace_num=100000) [2024-09-11 16:01:12.567881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:12.572845] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:12.572877] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35562 [2024-09-11 16:01:12.762415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:12.762460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:12.762469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:12.762478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:12.768022] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:12.770831] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35562, magic:0x78563412 [2024-09-11 16:01:12.770864] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:12.770872] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:12.962792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:12.962837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:12.962844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:12.962852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:12.968143] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:13.163203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:13.163253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:13.163262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:13.163271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:13.168319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:13.173005] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:13.173043] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35566 [2024-09-11 16:01:13.198940] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:13.363536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:13.363581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:13.363588] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:13.363598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:13.368501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:13.371113] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35566, magic:0x78563412 [2024-09-11 16:01:13.371143] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:13.371150] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:13.431510] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:13.464005] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041673464001, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:01:13.470785] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726041673470782, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:01:13.563852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:13.563896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:13.563937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:13.563965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:13.568668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:13.764260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:13.764307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:13.764315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:13.764325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:13.768772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:13.772469] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8131, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:01:13.773030] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:13.773047] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35576 [2024-09-11 16:01:13.968881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:13.971411] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35576, magic:0x78563412 [2024-09-11 16:01:13.971450] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:13.971457] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:13.972714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:13.972742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:13.972749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:13.972757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:14.169013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:14.173037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:14.173070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:14.173078] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:14.173087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:14.199177] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:14.369137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:14.373343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:14.373386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:14.373394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:14.373403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:14.373985] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:14.374005] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35580 [2024-09-11 16:01:14.432750] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:14.471622] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041674471618, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:01:14.478382] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041674478381, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:01:14.569251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:14.572151] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35580, magic:0x78563412 [2024-09-11 16:01:14.572188] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:14.572199] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:14.573636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:14.573659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:14.573665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:14.573689] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:14.772939] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3582, replace_start_pos=7200000, replace_num=100000) [2024-09-11 16:01:14.772985] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:14.773960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:14.774845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=882][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:14.774858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:14.774868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:14.973065] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:14.973680] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:14.973713] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:35596 [2024-09-11 16:01:14.975095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:14.975119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:14.975127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:14.975136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:15.172364] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:35596, magic:0x78563412 [2024-09-11 16:01:15.172408] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:15.172416] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:15.173180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:15.175368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:15.175394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:15.175400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:15.175409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:15.199373] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:15.373316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:15.375644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:15.375680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:15.375688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:15.375697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:15.434009] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:15.479253] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041675479249, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:01:15.486003] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726041675486000, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:01:15.573427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:15.574106] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:15.574125] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41410 [2024-09-11 16:01:15.575965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:15.575995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:15.576002] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:15.576011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:15.772785] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41410, magic:0x78563412 [2024-09-11 16:01:15.772828] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:15.772835] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:15.773538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:15.776300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:15.776331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:15.776339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:15.776347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:15.784149] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7788, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:01:15.973639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:15.984471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:15.984517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:15.984526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:15.984535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:16.173759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:16.174450] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:16.174484] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41414 [2024-09-11 16:01:16.184891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:16.184956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:16.184964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:16.184973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:16.199577] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:16.373262] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41414, magic:0x78563412 [2024-09-11 16:01:16.373310] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:16.373317] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:16.373872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:16.385264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:16.385302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:16.385312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:16.385326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:16.435073] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:16.486921] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041676486917, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:01:16.493682] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041676493679, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:01:16.573991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:16.585563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:16.585606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:16.585614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:16.585624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:16.774113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:16.775069] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:16.775103] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41424 [2024-09-11 16:01:16.785942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:16.785985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:16.785993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:16.786002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:16.973698] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41424, magic:0x78563412 [2024-09-11 16:01:16.973742] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:16.973750] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:16.978020] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3779, replace_start_pos=7300000, replace_num=100000) [2024-09-11 16:01:16.978060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:16.986281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:16.986319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:16.986327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:16.986336] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:17.178232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:17.186577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:17.186619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:17.186627] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:17.186636] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:17.199732] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:17.374777] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:17.374817] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41426 [2024-09-11 16:01:17.378453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:17.386869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:17.386940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:17.386950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:17.386960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:17.436008] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:17.494477] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041677494474, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:01:17.501305] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041677501300, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:01:17.573167] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41426, magic:0x78563412 [2024-09-11 16:01:17.573211] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:17.573217] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:17.578648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:17.587190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:17.587234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:17.587243] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:17.587253] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:17.778770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:17.787497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:17.787535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:17.787545] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:17.787559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:17.795141] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7563, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:01:17.974821] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:17.974880] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41442 [2024-09-11 16:01:17.978894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:17.995393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:17.995436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:17.995443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:17.995452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:18.173591] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41442, magic:0x78563412 [2024-09-11 16:01:18.173635] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:18.173644] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:18.179032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:18.195700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:18.195746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:18.195754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:18.195763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:18.199917] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:18.379163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:18.396024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:18.396073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:18.396079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:18.396103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:18.437195] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=101] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:18.502087] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041678502084, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:01:18.508922] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041678508919, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:01:18.576158] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:18.576216] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41446 [2024-09-11 16:01:18.579293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:18.596411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:18.596457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:18.596465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:18.596475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:18.772993] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41446, magic:0x78563412 [2024-09-11 16:01:18.773037] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:18.773044] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:18.779404] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:18.796713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:18.796761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:18.796768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:18.796777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:18.979531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:18.997051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:18.997098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:18.997106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:18.997137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:19.175046] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:19.175090] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41450 [2024-09-11 16:01:19.183695] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4037, replace_start_pos=7400000, replace_num=100000) [2024-09-11 16:01:19.183735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:19.197390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:19.197435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:19.197442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:19.197452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:19.200105] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:19.373474] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41450, magic:0x78563412 [2024-09-11 16:01:19.373516] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:19.373523] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:19.383820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:19.397673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:19.397709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:19.397715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:19.397722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:19.438105] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:19.509769] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041679509763, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:01:19.516477] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041679516471, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:01:19.583937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:19.598003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:19.598048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:19.598054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:19.598061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:19.775179] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:19.775238] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41460 [2024-09-11 16:01:19.784054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:19.798353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:19.798385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:19.798391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:19.798400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:19.805172] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6758, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:01:19.973852] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41460, magic:0x78563412 [2024-09-11 16:01:19.973889] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:19.973896] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:19.984165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:20.005522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:20.005569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:20.005577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:20.005604] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:20.184351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:20.200217] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:20.206087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:20.206120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:20.206128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:20.206137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:20.375780] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:20.375824] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41476 [2024-09-11 16:01:20.384568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:20.406389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:20.406433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:20.406440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:20.406449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:20.438899] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:20.517333] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041680517329, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:01:20.524163] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041680524159, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:01:20.574132] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41476, magic:0x78563412 [2024-09-11 16:01:20.574169] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:20.574176] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:20.584686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:20.606748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:20.606791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:20.606799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:20.606823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:20.784818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:20.807045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:20.807086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:20.807093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:20.807101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:20.949248] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:20.949302] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:20.949385] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=70, max_check_version=71, global_version=72) [2024-09-11 16:01:20.951448] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2062 [2024-09-11 16:01:20.951490] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:20.951535] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:01:20.951596] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:01:20.951679] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:20.951786] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,677,680 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 190,528 used= 178,448 count= 22 avg_used= 8,111 block_cnt= 22 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,677,680 used= 76,264,220 count= 1,549 avg_used= 49,234 mod=SUMMARY [2024-09-11 16:01:20.951837] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:01:20.951852] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:01:20.951863] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:01:20.951912] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:01:20.951974] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:01:20.951995] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:01:20.976426] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:20.976471] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41484 [2024-09-11 16:01:20.985004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:21.007415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:21.007461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:21.007470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:21.007479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:21.174839] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41484, magic:0x78563412 [2024-09-11 16:01:21.174876] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:21.174883] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:21.185205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:21.200361] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:21.207745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:21.207780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:21.207790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:21.207800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:21.389296] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3950, replace_start_pos=7500000, replace_num=100000) [2024-09-11 16:01:21.389332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:21.408054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:21.408103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:21.408128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:21.408136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:21.439667] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:21.525017] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041681525013, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:01:21.531775] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041681531772, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:01:21.575809] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:21.575850] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41492 [2024-09-11 16:01:21.589518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:21.608370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:21.608417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:21.608425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:21.608433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:21.774337] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41492, magic:0x78563412 [2024-09-11 16:01:21.774375] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:21.774381] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:21.789720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:21.808738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:21.808790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:21.808797] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:21.808805] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:21.815497] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6679, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:01:21.989845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:22.015812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:22.015875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:22.015884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:22.015892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:22.176375] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:22.176409] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41500 [2024-09-11 16:01:22.189965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:22.200464] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:22.216143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:22.216180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:22.216186] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:22.216194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:22.374697] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41500, magic:0x78563412 [2024-09-11 16:01:22.374740] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:22.374748] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:22.390062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:22.416436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:22.416483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:22.416491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:22.416500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:22.532620] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041682532615, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:01:22.539382] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726041682539377, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:01:22.540502] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:22.590178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:22.616824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:22.616885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:22.616893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:22.616926] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:22.776188] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:22.776230] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41506 [2024-09-11 16:01:22.790307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:22.817141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:22.817183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:22.817190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:22.817198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:22.975012] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41506, magic:0x78563412 [2024-09-11 16:01:22.975052] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:22.975059] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:22.990480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:23.017498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:23.017548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:23.017557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:23.017567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:23.190667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:23.200568] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:23.217810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:23.217849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:23.217856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:23.217865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:23.378195] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:23.378237] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41516 [2024-09-11 16:01:23.390846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:23.418098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:23.418142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:23.418149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:23.418158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:23.540167] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041683540162, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:01:23.541327] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:23.546927] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041683546925, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:01:23.575372] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41516, magic:0x78563412 [2024-09-11 16:01:23.575401] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:23.575408] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:23.594374] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3346, replace_start_pos=7600000, replace_num=100000) [2024-09-11 16:01:23.594415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:23.618388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:23.618433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:23.618459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:23.618468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:23.794498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:23.818704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:23.818749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:23.818756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:23.818765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:23.825784] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7006, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:01:23.977712] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:23.977755] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41518 [2024-09-11 16:01:23.994631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:24.026059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:24.026107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:24.026115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:24.026124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:24.026306] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:01:24.174813] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41518, magic:0x78563412 [2024-09-11 16:01:24.174869] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:24.174877] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:24.194830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:24.200679] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:24.226534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:24.226580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:24.226588] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:24.226598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:24.394961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:24.426927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:24.426975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:24.426983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:24.426992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:24.542544] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:24.547885] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041684547881, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007719, add_bytes: 0 [2024-09-11 16:01:24.554543] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041684554540, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:01:24.577017] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:24.577052] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41532 [2024-09-11 16:01:24.595090] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:24.627225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:24.627264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:24.627272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:24.627281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:24.774261] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41532, magic:0x78563412 [2024-09-11 16:01:24.774318] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:24.774325] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:24.795203] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:24.827575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:24.827622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:24.827630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:24.827640] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:24.995344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:25.027866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:25.027932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:25.027939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:25.027947] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:25.175952] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:25.175995] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41538 [2024-09-11 16:01:25.195487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:25.200787] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:25.228244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:25.228285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:25.228312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:25.228321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:25.374502] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41538, magic:0x78563412 [2024-09-11 16:01:25.374540] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:25.374546] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:25.395656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:25.428564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:25.428612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:25.428620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:25.428629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:25.543635] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:25.555408] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041685555403, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007522, add_bytes: 0 [2024-09-11 16:01:25.562158] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041685562157, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:01:25.595771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:25.628873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:25.628938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:25.628946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:25.628955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:25.776374] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:25.776410] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37722 [2024-09-11 16:01:25.800286] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4367, replace_start_pos=7700000, replace_num=100000) [2024-09-11 16:01:25.800326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:25.829177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:25.829236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:25.829243] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:25.829250] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:25.836039] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6778, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:01:25.974997] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37722, magic:0x78563412 [2024-09-11 16:01:25.975034] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:25.975042] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:26.000430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:26.036372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:26.036419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:26.036427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:26.036437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:26.200662] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:26.200911] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:26.236746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:26.236787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:26.236793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:26.236801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:26.376949] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:26.376989] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37738 [2024-09-11 16:01:26.400857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:26.437056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:26.437103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:26.437110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:26.437118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:26.544636] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:26.563016] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041686563011, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:01:26.569776] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726041686569775, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:01:26.575546] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37738, magic:0x78563412 [2024-09-11 16:01:26.575565] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:26.575572] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:26.601030] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:26.637368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:26.637415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:26.637423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:26.637432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:26.801162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:26.837646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:26.837687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:26.837693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:26.837701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:26.979457] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:26.979503] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37748 [2024-09-11 16:01:27.001351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:27.038042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:27.038087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:27.038094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:27.038104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:27.176386] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37748, magic:0x78563412 [2024-09-11 16:01:27.176427] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:27.176435] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:27.201026] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:27.201466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:27.238335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:27.238376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:27.238382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:27.238390] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:27.401574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:27.438689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:27.438745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:27.438754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:27.438763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:27.545472] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:27.570702] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041687570698, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:01:27.577510] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726041687577506, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007731, add_bytes: 0 [2024-09-11 16:01:27.578774] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:27.578802] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37750 [2024-09-11 16:01:27.601691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:27.639031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:27.639072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:27.639080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:27.639091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:27.775697] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37750, magic:0x78563412 [2024-09-11 16:01:27.775739] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:27.775746] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:27.801806] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:27.839318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:27.839362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:27.839367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:27.839375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:27.846002] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6613, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:01:28.006234] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4306, replace_start_pos=7800000, replace_num=100000) [2024-09-11 16:01:28.006303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:28.046264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:28.046304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:28.046312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:28.046321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:28.177699] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:28.177745] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37756 [2024-09-11 16:01:28.201137] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:28.206391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:28.246533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:28.246577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:28.246583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:28.246590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:28.376173] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37756, magic:0x78563412 [2024-09-11 16:01:28.376215] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:28.376222] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:28.406513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:28.446837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:28.446880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:28.446926] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:28.446934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:28.546332] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:28.578317] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=69] PNIO [ratelimit] time: 1726041688578312, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:01:28.585029] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041688585025, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007519, add_bytes: 0 [2024-09-11 16:01:28.606643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:28.647181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:28.647227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:28.647235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:28.647244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:28.778135] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:28.778175] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37764 [2024-09-11 16:01:28.806773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:28.847530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:28.847574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:28.847581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:28.847590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:28.976651] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37764, magic:0x78563412 [2024-09-11 16:01:28.976697] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:28.976706] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:29.006930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:29.047819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:29.047868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:29.047895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:29.047928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:29.201251] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:29.207113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:29.248181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:29.248230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:29.248239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:29.248249] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:29.378491] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:29.378533] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37778 [2024-09-11 16:01:29.407222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:29.449070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:29.449112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:29.449119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:29.449126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:29.547498] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:29.577137] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37778, magic:0x78563412 [2024-09-11 16:01:29.577172] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:29.577181] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:29.585925] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041689585922, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:01:29.592703] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041689592698, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:01:29.607341] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:29.649366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:29.649427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:29.649434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:29.649443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:29.807456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:29.849703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:29.849757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:29.849771] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:29.849781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:29.856981] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7186, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:01:29.979243] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:29.979289] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37784 [2024-09-11 16:01:30.007582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:30.057222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:30.057265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:30.057271] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:30.057278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:30.176609] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37784, magic:0x78563412 [2024-09-11 16:01:30.176649] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:30.176673] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:30.201368] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:30.211120] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3403, replace_start_pos=7900000, replace_num=100000) [2024-09-11 16:01:30.211167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:30.257494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:30.257545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:30.257555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:30.257562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:30.411264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:30.457789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:30.457833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:30.457839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:30.457846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:30.548336] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:30.579068] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:30.579109] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37792 [2024-09-11 16:01:30.593550] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041690593545, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:01:30.600250] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041690600244, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:01:30.611406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:30.658069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:30.658113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:30.658119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:30.658127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:30.777260] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37792, magic:0x78563412 [2024-09-11 16:01:30.777299] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:30.777307] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:30.811495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:30.858385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:30.858434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:30.858442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:30.858450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:30.967220] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:30.967274] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:30.967359] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=71, max_check_version=72, global_version=73) [2024-09-11 16:01:30.969378] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2018 [2024-09-11 16:01:30.969416] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:30.969473] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:01:30.969511] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:01:30.969596] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:30.969703] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:01:30.969759] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:01:30.969770] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:01:30.969781] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:01:30.969817] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:01:30.969878] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:01:30.969899] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:01:31.011687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:31.058681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:31.058728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:31.058736] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:31.058745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:31.058985] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=81, refresh_score_time=63, wash_time=0) [2024-09-11 16:01:31.177957] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:31.178001] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37808 [2024-09-11 16:01:31.201514] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:31.211828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:31.259243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:31.259285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:31.259292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:31.259301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:31.376417] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37808, magic:0x78563412 [2024-09-11 16:01:31.376460] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:31.376468] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:31.411923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:31.459534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:31.459586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:31.459614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:31.459622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:31.549173] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:31.601162] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041691601158, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:01:31.607937] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041691607932, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:01:31.612138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:31.659843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:31.659886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:31.659892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:31.659899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:31.778236] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:31.778282] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37822 [2024-09-11 16:01:31.812339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:31.860254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:31.860300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:31.860308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:31.860317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:31.868896] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8565, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:01:31.976922] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37822, magic:0x78563412 [2024-09-11 16:01:31.976964] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:31.976972] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:32.012525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:32.069158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:32.069207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:32.069214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:32.069223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:32.201647] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:32.212733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:32.269454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:32.269497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:32.269503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:32.269511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:32.379149] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:32.379197] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37838 [2024-09-11 16:01:32.417310] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4382, replace_start_pos=8000000, replace_num=100000) [2024-09-11 16:01:32.417356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:32.469745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:32.469797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:32.469805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:32.469814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:32.549920] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:32.577573] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37838, magic:0x78563412 [2024-09-11 16:01:32.577615] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:32.577622] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:32.608721] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=71] PNIO [ratelimit] time: 1726041692608717, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:01:32.615538] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041692615534, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:01:32.617434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:32.670136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:32.670178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:32.670185] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:32.670194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:32.817539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:32.870433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:32.870483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:32.870490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:32.870497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:32.979743] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:32.979787] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37844 [2024-09-11 16:01:33.017661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:33.070715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:33.070769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:33.070776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:33.070784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:33.177974] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37844, magic:0x78563412 [2024-09-11 16:01:33.178034] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:33.178043] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:33.201778] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:33.217852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:33.271046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:33.271093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:33.271099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:33.271107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:33.417990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:33.471405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:33.471443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:33.471453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:33.471462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:33.550805] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:33.578493] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:33.578535] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37852 [2024-09-11 16:01:33.616325] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041693616321, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:01:33.618104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:33.623173] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726041693623170, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:01:33.671999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:33.672042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:33.672048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:33.672055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:33.777141] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37852, magic:0x78563412 [2024-09-11 16:01:33.777181] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:33.777189] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:33.818253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:33.872328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:33.872374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:33.872382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:33.872391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:33.880590] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8186, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:01:34.018367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:34.080928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:34.080971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:34.080978] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:34.080986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:34.178924] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:34.178970] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37854 [2024-09-11 16:01:34.201896] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:34.218549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:34.281211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:34.281255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:34.281262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:34.281270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:34.377496] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37854, magic:0x78563412 [2024-09-11 16:01:34.377533] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:34.377540] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:34.418764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:34.481509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:34.481559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:34.481568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:34.481578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:34.551845] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:34.623271] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4321, replace_start_pos=8100000, replace_num=100000) [2024-09-11 16:01:34.623317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:34.623940] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041694623937, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:01:34.630724] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041694630720, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:01:34.681826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:34.681872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:34.681880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:34.681897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:34.779241] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:34.779277] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37870 [2024-09-11 16:01:34.823404] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:34.882143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:34.882191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:34.882199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:34.882207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:34.977997] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37870, magic:0x78563412 [2024-09-11 16:01:34.978044] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:34.978053] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:35.023590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:35.082451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:35.082486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:35.082491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:35.082499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:35.202048] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:35.223776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:35.282737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:35.282785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:35.282794] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:35.282821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:35.380412] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:35.380459] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37872 [2024-09-11 16:01:35.423971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:35.483058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:35.483106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:35.483112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:35.483120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:35.552790] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=101] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:35.578485] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37872, magic:0x78563412 [2024-09-11 16:01:35.578524] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:35.578531] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:35.624094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:35.631569] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041695631565, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:01:35.638390] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041695638385, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:01:35.683345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:35.683389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:35.683395] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:35.683403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:35.824277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:35.883780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:35.883829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:35.883837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:35.883847] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:35.892979] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9101, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:01:35.980840] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:35.980883] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10490 [2024-09-11 16:01:36.024403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:36.093253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:36.093302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:36.093310] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:36.093319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:36.179121] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10490, magic:0x78563412 [2024-09-11 16:01:36.179163] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:36.179170] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:36.202188] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:36.224532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:36.293542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:36.293588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:36.293594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:36.293602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:36.424728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:36.493847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:36.493888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:36.493894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:36.493922] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:36.553636] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:36.585232] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:36.585276] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10506 [2024-09-11 16:01:36.624941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:36.639173] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041696639168, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:01:36.645955] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041696645952, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:01:36.694249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:36.694296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:36.694302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:36.694309] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:36.779252] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10506, magic:0x78563412 [2024-09-11 16:01:36.779293] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:36.779299] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:36.829537] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4418, replace_start_pos=8200000, replace_num=100000) [2024-09-11 16:01:36.829586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:36.894568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:36.894615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:36.894622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:36.894631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:37.029768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:37.094886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:37.094953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:37.094961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:37.094971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:37.181370] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:37.181414] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10514 [2024-09-11 16:01:37.202317] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:37.229965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:37.295205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:37.295248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:37.295254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:37.295262] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:37.379718] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10514, magic:0x78563412 [2024-09-11 16:01:37.379759] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:37.379766] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:37.430146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:37.495495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:37.495562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:37.495570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:37.495580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:37.554883] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:37.630263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:37.646791] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041697646787, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:01:37.653672] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041697653669, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007717, add_bytes: 0 [2024-09-11 16:01:37.695806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:37.695847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:37.695854] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:37.695862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:37.781614] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:37.781659] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10520 [2024-09-11 16:01:37.830494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:37.896097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:37.896140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:37.896146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:37.896153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:37.903507] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7341, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:01:37.980248] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10520, magic:0x78563412 [2024-09-11 16:01:37.980290] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:37.980299] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:38.030620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:38.103789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:38.103848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:38.103857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:38.103866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:38.202468] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=20] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:38.230756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:38.304105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:38.304143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:38.304151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:38.304160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:38.381991] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:38.382036] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10530 [2024-09-11 16:01:38.430957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:38.504498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:38.504551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:38.504562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:38.504575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:38.555703] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:38.580594] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10530, magic:0x78563412 [2024-09-11 16:01:38.580636] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:38.580644] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:38.631086] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:38.654470] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041698654466, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:01:38.661178] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041698661174, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007505, add_bytes: 0 [2024-09-11 16:01:38.704815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:38.704860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:38.704867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:38.704876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:38.831206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:38.905123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:38.905171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:38.905179] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:38.905188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:38.982512] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:38.982555] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10546 [2024-09-11 16:01:39.035591] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4263, replace_start_pos=8300000, replace_num=100000) [2024-09-11 16:01:39.035636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:39.105422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:39.105465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:39.105472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:39.105480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:39.181021] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10546, magic:0x78563412 [2024-09-11 16:01:39.181063] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:39.181074] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:39.202597] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:39.235737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:39.305800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:39.305844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:39.305853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:39.305863] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:39.435955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:39.506109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:39.506159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:39.506166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:39.506174] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:39.556713] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:39.582944] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:39.582990] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10556 [2024-09-11 16:01:39.636080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:39.662020] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041699662017, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:01:39.668792] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041699668789, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:01:39.706399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:39.706443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:39.706451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:39.706458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:39.781351] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10556, magic:0x78563412 [2024-09-11 16:01:39.781388] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:39.781397] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:39.836195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:39.906720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:39.906767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:39.906776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:39.906785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:39.915235] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8436, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:01:40.036324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:40.115500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:40.115550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:40.115558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:40.115568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:40.183590] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:40.183634] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10562 [2024-09-11 16:01:40.202705] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:40.236487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:40.315824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:40.315873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:40.315881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:40.315890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:40.382012] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10562, magic:0x78563412 [2024-09-11 16:01:40.382057] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:40.382066] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:40.436680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:40.516153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:40.516199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:40.516208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:40.516216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:40.557726] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:40.636870] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:40.669702] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041700669698, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:01:40.676471] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041700676468, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:01:40.716433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:40.716475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:40.716481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:40.716489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:40.783399] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:40.783442] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10570 [2024-09-11 16:01:40.837092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:40.916722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:40.916766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:40.916773] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:40.916782] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:40.982151] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10570, magic:0x78563412 [2024-09-11 16:01:40.982192] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:40.982199] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:40.986955] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:40.986991] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:40.987063] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=72, max_check_version=73, global_version=74) [2024-09-11 16:01:40.988970] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1907 [2024-09-11 16:01:40.989005] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:40.989035] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:01:40.989085] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:01:40.989160] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:40.989243] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:01:40.989286] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:01:40.989298] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:01:40.989307] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:01:40.989338] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:01:40.989386] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:01:40.989403] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:01:41.037312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:41.117024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:41.117088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:41.117094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:41.117101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:41.202923] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:41.241785] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4345, replace_start_pos=8400000, replace_num=100000) [2024-09-11 16:01:41.241834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:41.317347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:41.317395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:41.317403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:41.317413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:41.384087] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:41.384134] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10578 [2024-09-11 16:01:41.441979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:41.517655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:41.517700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:41.517708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:41.517717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:41.582638] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10578, magic:0x78563412 [2024-09-11 16:01:41.582699] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:41.582707] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:41.642111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:41.658522] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:41.677332] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041701677327, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:01:41.684033] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041701684031, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:01:41.718034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:41.718077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:41.718085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:41.718094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:41.842233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:41.918333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:41.918378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:41.918386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:41.918395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:41.925717] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7308, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:01:41.984433] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:41.984478] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10588 [2024-09-11 16:01:42.042346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:42.125997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:42.126040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:42.126046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:42.126053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:42.183077] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10588, magic:0x78563412 [2024-09-11 16:01:42.183111] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:42.183117] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:42.203058] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:42.242469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:42.326308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:42.326355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:42.326363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:42.326373] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:42.442686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:42.526613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:42.526659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:42.526666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:42.526676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:42.585358] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:42.585405] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10598 [2024-09-11 16:01:42.642811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:42.659256] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:42.684935] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726041702684932, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:01:42.691647] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041702691643, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:01:42.726963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:42.727002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:42.727010] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:42.727034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:42.782555] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10598, magic:0x78563412 [2024-09-11 16:01:42.782600] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:42.782608] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:42.842989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:42.927290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:42.927332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:42.927340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:42.927349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:43.043111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:43.127587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:43.127635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:43.127643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:43.127652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:43.184774] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:43.184823] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10606 [2024-09-11 16:01:43.203195] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:43.243232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:43.327929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:43.327975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:43.327983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:43.327991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:43.383004] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10606, magic:0x78563412 [2024-09-11 16:01:43.383046] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:43.383054] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:43.446702] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3340, replace_start_pos=8500000, replace_num=100000) [2024-09-11 16:01:43.446760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:43.528229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:43.528276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:43.528284] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:43.528293] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:43.646921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:43.659956] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:43.692558] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041703692555, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:01:43.699265] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041703699262, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:01:43.728528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:43.728593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:43.728601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:43.728610] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:43.785075] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:43.785119] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10616 [2024-09-11 16:01:43.847046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:43.928855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:43.928932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:43.928940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:43.928948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:43.937099] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8137, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:01:43.983433] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10616, magic:0x78563412 [2024-09-11 16:01:43.983475] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:43.983482] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:44.047163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:44.137356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:44.137397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:44.137404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:44.137411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:44.203344] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:44.247282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:44.337649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:44.337690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:44.337713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:44.337723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:44.385638] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:44.385681] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10620 [2024-09-11 16:01:44.447400] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:44.537986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:44.538035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:44.538044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:44.538054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:44.583878] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10620, magic:0x78563412 [2024-09-11 16:01:44.583940] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:44.583950] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:44.647571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:44.660787] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:44.700103] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041704700099, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:01:44.706949] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041704706947, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:01:44.738286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:44.738330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:44.738336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:44.738343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:44.847759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:44.938567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:44.938609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:44.938631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:44.938639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:44.985984] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:44.986027] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10636 [2024-09-11 16:01:45.047940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:45.138883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:45.138957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:45.138966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:45.138975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:45.184150] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10636, magic:0x78563412 [2024-09-11 16:01:45.184192] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:45.184200] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:45.203541] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:45.248067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:45.339212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:45.339252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:45.339260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:45.339269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:45.448186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:45.539510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:45.539559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:45.539566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:45.539576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:45.586188] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:45.586230] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19780 [2024-09-11 16:01:45.651915] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3592, replace_start_pos=8600000, replace_num=100000) [2024-09-11 16:01:45.651984] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:45.661967] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:45.707728] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041705707724, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:01:45.714499] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041705714495, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:01:45.739814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:45.739866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:45.739873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:45.739882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:45.784622] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19780, magic:0x78563412 [2024-09-11 16:01:45.784664] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:45.784671] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:45.852110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:45.940137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:45.940184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:45.940191] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:45.940200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:45.948445] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8206, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:01:46.052247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:46.148708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:46.148754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:46.148761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:46.148771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:46.186547] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:46.186595] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19786 [2024-09-11 16:01:46.203745] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:46.252448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:46.349045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:46.349091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:46.349099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:46.349108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:46.385013] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19786, magic:0x78563412 [2024-09-11 16:01:46.385058] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:46.385067] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:46.452630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:46.549388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:46.549430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:46.549436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:46.549444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:46.652766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:46.662891] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:46.715343] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041706715339, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:01:46.722166] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041706722162, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:01:46.749682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:46.749726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:46.749732] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:46.749739] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:46.786821] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:46.786865] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19796 [2024-09-11 16:01:46.852879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:46.950011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:46.950044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:46.950053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:46.950063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:46.985327] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19796, magic:0x78563412 [2024-09-11 16:01:46.985361] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:46.985369] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:47.053078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:47.150313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:47.150359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:47.150366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:47.150376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:47.203950] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:47.253219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:47.350634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:47.350679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:47.350687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:47.350695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:47.386836] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:47.386882] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19806 [2024-09-11 16:01:47.453336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:47.550972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:47.551023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:47.551033] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:47.551042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:47.584833] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19806, magic:0x78563412 [2024-09-11 16:01:47.584894] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:47.584934] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:47.653450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:47.663992] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:47.723044] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041707723040, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007701, add_bytes: 0 [2024-09-11 16:01:47.729727] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041707729722, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:01:47.751366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:47.751412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:47.751420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:47.751429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:47.858054] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4396, replace_start_pos=8700000, replace_num=100000) [2024-09-11 16:01:47.858108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:47.951745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:47.951788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:47.951796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:47.951806] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:47.960422] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8600, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:01:47.987167] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:47.987212] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19812 [2024-09-11 16:01:48.058263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:48.160702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:48.160750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:48.160758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:48.160799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:48.185189] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19812, magic:0x78563412 [2024-09-11 16:01:48.185230] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:48.185238] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:48.204141] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:48.258457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:48.361109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:48.361152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:48.361160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:48.361170] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:48.458642] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:48.561479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:48.561524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:48.561532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:48.561542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:48.587323] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:48.587362] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19826 [2024-09-11 16:01:48.658762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:48.664749] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:48.730575] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=71] PNIO [ratelimit] time: 1726041708730571, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007531, add_bytes: 0 [2024-09-11 16:01:48.737331] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041708737326, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:01:48.761878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:48.761944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:48.761970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:48.761979] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:48.785397] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19826, magic:0x78563412 [2024-09-11 16:01:48.785442] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:48.785449] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:48.858919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:48.962238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:48.962290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:48.962296] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:48.962305] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:49.059174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:49.162531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:49.162574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:49.162580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:49.162588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:49.186715] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:49.186761] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19828 [2024-09-11 16:01:49.204282] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:49.259381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:49.362828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:49.362871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:49.362877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:49.362885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:49.384970] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19828, magic:0x78563412 [2024-09-11 16:01:49.385012] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:49.385020] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:49.459645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:49.563124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:49.563168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:49.563175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:49.563183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:49.659834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:49.665957] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:49.738212] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726041709738206, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:01:49.744943] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041709744939, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:01:49.763417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:49.763466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:49.763474] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:49.763482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:49.786739] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:49.786771] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19840 [2024-09-11 16:01:49.859969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:49.963716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:49.963753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:49.963760] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:49.963768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:49.970337] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6555, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:01:49.985181] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19840, magic:0x78563412 [2024-09-11 16:01:49.985220] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:49.985229] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:50.064040] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3821, replace_start_pos=8800000, replace_num=100000) [2024-09-11 16:01:50.064087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:50.170609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:50.170654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:50.170660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:50.170668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:50.204440] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=23] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:50.264183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:50.370991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:50.371053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:50.371060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:50.371068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:50.386291] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:50.386337] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19850 [2024-09-11 16:01:50.464314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:50.571470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:50.571518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:50.571526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:50.571535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:50.584696] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19850, magic:0x78563412 [2024-09-11 16:01:50.584730] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:50.584738] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:50.664455] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:50.666854] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:50.745969] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041710745965, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007759, add_bytes: 0 [2024-09-11 16:01:50.752571] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041710752567, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:01:50.771771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:50.771820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:50.771829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:50.771838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:50.864581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:50.972084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:50.972129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:50.972152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:50.972159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:50.987103] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:50.987148] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19854 [2024-09-11 16:01:51.005394] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:51.005542] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=145] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:01:51.005644] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=36] update_check_range(min_check_version=73, max_check_version=74, global_version=75) [2024-09-11 16:01:51.007410] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1764 [2024-09-11 16:01:51.007453] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:51.007487] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:01:51.007548] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:01:51.007630] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:01:51.007714] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:01:51.007761] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:01:51.007775] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:01:51.007785] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:01:51.007818] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:01:51.007868] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:01:51.007887] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:01:51.064700] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:51.172410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:51.172449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:51.172456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:51.172465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:51.185172] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19854, magic:0x78563412 [2024-09-11 16:01:51.185205] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:51.185211] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:51.204616] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=96] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:51.264831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:51.372804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:51.372852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:51.372860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:51.372870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:51.373118] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=83, refresh_score_time=95, wash_time=0) [2024-09-11 16:01:51.465021] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:51.573361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:51.573403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:51.573410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:51.573417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:51.586960] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:51.587006] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19866 [2024-09-11 16:01:51.665216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:51.667848] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:51.753421] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041711753417, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007452, add_bytes: 0 [2024-09-11 16:01:51.760289] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041711760285, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007718, add_bytes: 0 [2024-09-11 16:01:51.773655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:51.773697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:51.773718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:51.773726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:51.785463] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19866, magic:0x78563412 [2024-09-11 16:01:51.785505] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:51.785512] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:51.865439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:51.973987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:51.974033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:51.974041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:51.974048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:51.980659] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6600, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:01:52.065558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:52.180944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:52.180982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:52.180988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:52.180996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:52.187145] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:52.187193] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19876 [2024-09-11 16:01:52.204730] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:52.270013] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4332, replace_start_pos=8900000, replace_num=100000) [2024-09-11 16:01:52.270053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:52.381248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:52.381294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:52.381302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:52.381311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:52.385827] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19876, magic:0x78563412 [2024-09-11 16:01:52.385861] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:52.385871] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:52.470198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:52.581551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:52.581600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:52.581606] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:52.581614] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:52.668863] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:52.670377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:52.761121] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041712761117, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 16:01:52.767796] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041712767791, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007506, add_bytes: 0 [2024-09-11 16:01:52.781874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:52.781933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:52.781940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:52.781948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:52.787889] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:52.787945] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19886 [2024-09-11 16:01:52.870554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:52.982226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:52.982277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:52.982285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:52.982294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:52.986240] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19886, magic:0x78563412 [2024-09-11 16:01:52.986268] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:52.986277] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:53.070688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:53.182594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:53.182642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:53.182649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:53.182656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:53.204918] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:53.270869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:53.382920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:53.382980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:53.382987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:53.382995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:53.388026] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:53.388071] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19890 [2024-09-11 16:01:53.471029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:53.583358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:53.583411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:53.583420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:53.583430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:53.586637] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19890, magic:0x78563412 [2024-09-11 16:01:53.586667] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:53.586674] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:53.669925] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=104] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:53.671148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:53.768676] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041713768672, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:01:53.775405] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041713775401, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:01:53.783674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:53.783712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:53.783719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:53.783728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:53.871307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:53.984064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:53.984110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:53.984134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:53.984144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:53.988977] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:53.989017] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19898 [2024-09-11 16:01:53.991166] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7008, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:01:54.071498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:54.187209] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19898, magic:0x78563412 [2024-09-11 16:01:54.187251] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:54.187258] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:54.191419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:54.191452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:54.191458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:54.191466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:54.191621] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:01:54.205044] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:54.271632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:54.391865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:54.391952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=85][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:54.391962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:54.391971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:54.476266] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4490, replace_start_pos=9000000, replace_num=100000) [2024-09-11 16:01:54.476319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:54.589238] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:54.589285] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19900 [2024-09-11 16:01:54.592213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:54.592248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:54.592254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:54.592261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:54.671063] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:54.676475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:54.776271] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041714776266, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:01:54.783052] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041714783046, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007645, add_bytes: 0 [2024-09-11 16:01:54.787544] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19900, magic:0x78563412 [2024-09-11 16:01:54.787576] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:54.787582] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:54.792483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:54.792513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:54.792519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:54.792527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:54.876594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:54.992793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:54.992838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:54.992846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:54.992855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:55.076844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:55.189534] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:55.189580] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:19910 [2024-09-11 16:01:55.193260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:55.193297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:55.193305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:55.193314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:55.205189] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:55.277024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:55.388090] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:19910, magic:0x78563412 [2024-09-11 16:01:55.388138] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:55.388146] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:55.393658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:55.393705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:55.393713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:55.393740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:55.477268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:55.594037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:55.594081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:55.594088] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:55.594097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:55.672212] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:55.677396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:55.783957] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041715783953, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:01:55.789319] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:55.789366] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54508 [2024-09-11 16:01:55.790661] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041715790658, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:01:55.794356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:55.794395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:55.794402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:55.794411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:55.877518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:55.986417] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54508, magic:0x78563412 [2024-09-11 16:01:55.986460] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:55.986469] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:55.994662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:55.994698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:55.994706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:55.994730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:56.003220] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8477, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:01:56.077638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:56.203493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:56.203542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:56.203548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:56.203556] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:56.205399] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:56.277817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:56.388249] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:56.388291] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54522 [2024-09-11 16:01:56.403883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:56.403950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:56.403959] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:56.403969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:56.477996] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:56.586925] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54522, magic:0x78563412 [2024-09-11 16:01:56.586968] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:56.586989] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:56.604345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:56.604386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:56.604394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:56.604403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:56.673297] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:56.681871] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3748, replace_start_pos=9100000, replace_num=100000) [2024-09-11 16:01:56.681921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:56.791505] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041716791500, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:01:56.798271] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041716798267, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:01:56.804634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:56.804678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:56.804686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:56.804693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:56.882063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:56.988550] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:56.988589] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54534 [2024-09-11 16:01:57.005001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:57.005038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:57.005045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:57.005052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:57.082274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:57.187028] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54534, magic:0x78563412 [2024-09-11 16:01:57.187086] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:57.187095] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:57.205363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:57.205411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:57.205419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:57.205428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:57.205579] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:57.282396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:57.405796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:57.405843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:57.405851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:57.405860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:57.482579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:57.588996] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:57.589039] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54550 [2024-09-11 16:01:57.606093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:57.606128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:57.606135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:57.606157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:57.674231] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:57.682718] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:57.787564] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54550, magic:0x78563412 [2024-09-11 16:01:57.787608] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:57.787632] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:57.799185] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041717799180, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:01:57.805882] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041717805878, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:01:57.806385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:57.806415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:57.806421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:57.806428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:57.882837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:01:58.006789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:58.006833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:58.006840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:58.006848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:58.013577] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6715, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:01:58.082974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:01:58.188720] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:58.188764] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54558 [2024-09-11 16:01:58.205696] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=30] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:58.213830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:58.213873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:58.213879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:58.213886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:58.283163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:01:58.387186] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54558, magic:0x78563412 [2024-09-11 16:01:58.387229] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:58.387237] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:58.414131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:58.414180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:58.414186] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:58.414194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:58.483378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:01:58.614439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:58.614483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:58.614490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:58.614500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:58.675153] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:58.683505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:01:58.789777] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:58.789824] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54568 [2024-09-11 16:01:58.806730] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041718806726, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:01:58.813568] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726041718813565, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:01:58.814739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:58.814764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:58.814793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:58.814800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:58.888118] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4430, replace_start_pos=9200000, replace_num=100000) [2024-09-11 16:01:58.888163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:01:58.987810] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54568, magic:0x78563412 [2024-09-11 16:01:58.987853] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:58.987861] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:59.015090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:59.015131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:59.015138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:59.015148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:59.088253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:01:59.205843] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:01:59.215474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:59.215514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:59.215522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:59.215531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:59.288383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:01:59.390093] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:59.390132] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54582 [2024-09-11 16:01:59.415783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:59.415826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:59.415832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:59.415839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:59.488518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:01:59.588234] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54582, magic:0x78563412 [2024-09-11 16:01:59.588275] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:01:59.588283] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:01:59.616147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:59.616186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:59.616194] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:59.616203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:59.676337] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:01:59.688646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:01:59.814363] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041719814359, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:01:59.816444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:01:59.816476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:01:59.816483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:01:59.816492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:01:59.821176] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041719821174, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:01:59.888761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:01:59.990173] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:01:59.990219] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54598 [2024-09-11 16:02:00.016749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:00.016796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:00.016804] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:00.016813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:00.024593] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7766, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:02:00.088882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:00.188433] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54598, magic:0x78563412 [2024-09-11 16:02:00.188472] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:00.188479] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:00.205972] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:00.224882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:00.224953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:00.224961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:00.224971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:00.289009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:00.425189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:00.425241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:00.425253] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:00.425261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:00.489153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:00.590801] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:00.590842] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54600 [2024-09-11 16:02:00.625552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:00.625593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:00.625601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:00.625609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:00.677525] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:00.689281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:00.789237] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54600, magic:0x78563412 [2024-09-11 16:02:00.789280] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:00.789288] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:00.816028] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:02:00.821976] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041720821971, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:02:00.822019] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:02:00.825850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:00.825882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:00.825890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:00.825899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:00.826397] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:02:00.828733] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041720828730, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:02:00.828766] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:02:00.889457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:01.020708] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:01.020761] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:01.020847] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=74, max_check_version=75, global_version=76) [2024-09-11 16:02:01.022847] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2000 [2024-09-11 16:02:01.022884] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:01.022936] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:02:01.022975] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:02:01.023098] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=36] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:01.023208] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,685,568 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 198,416 used= 186,136 count= 23 avg_used= 8,092 block_cnt= 23 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,685,568 used= 76,271,908 count= 1,550 avg_used= 49,207 mod=SUMMARY [2024-09-11 16:02:01.023267] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:02:01.023278] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:02:01.023293] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:02:01.023330] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:02:01.023390] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:02:01.023411] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:02:01.026173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:01.026203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:01.026211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:01.026220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:01.094075] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4425, replace_start_pos=9300000, replace_num=100000) [2024-09-11 16:02:01.094124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:01.190960] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:01.191006] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54604 [2024-09-11 16:02:01.206122] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:01.226438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:01.226477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:01.226483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:01.226490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:01.294324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:01.389343] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54604, magic:0x78563412 [2024-09-11 16:02:01.389387] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:01.389395] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:01.426726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:01.426770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:01.426778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:01.426786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:01.494452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:01.627062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:01.627104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:01.627125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:01.627133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:01.678435] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:01.694586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:01.791432] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:01.791492] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54610 [2024-09-11 16:02:01.827417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:01.827454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:01.827461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:01.827469] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:01.829649] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041721829647, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:02:01.836349] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041721836346, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:02:01.894707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:01.989789] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54610, magic:0x78563412 [2024-09-11 16:02:01.989819] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:01.989826] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:02.027766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:02.027804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:02.027810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:02.027819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:02.034452] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6621, clean_start_pos=0, clean_num=200000) [2024-09-11 16:02:02.094836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:02.206211] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=18] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:02.234849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:02.234892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:02.234899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:02.234930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:02.295019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:02.392757] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:02.392800] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54614 [2024-09-11 16:02:02.435242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:02.435282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:02.435290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:02.435301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:02.495147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:02.590026] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54614, magic:0x78563412 [2024-09-11 16:02:02.590073] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:02.590081] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:02.635543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:02.635588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:02.635595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:02.635605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:02.679373] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:02.695265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:02.835930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:02.835975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:02.836000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:02.836009] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:02.837192] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041722837190, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:02:02.843955] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041722843951, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:02:02.895438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:02.991710] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:02.991754] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54620 [2024-09-11 16:02:03.036273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:03.036310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:03.036317] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:03.036325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:03.095626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:03.190197] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54620, magic:0x78563412 [2024-09-11 16:02:03.190239] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:03.190248] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:03.206447] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:03.236637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:03.236702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:03.236715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:03.236746] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:03.303746] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=7974, replace_start_pos=9400000, replace_num=100000) [2024-09-11 16:02:03.303792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:03.437025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:03.437071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:03.437079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:03.437088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:03.503920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:03.592613] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:03.592657] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54634 [2024-09-11 16:02:03.637321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:03.637366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:03.637373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:03.637380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:03.680342] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:03.704084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:03.790595] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54634, magic:0x78563412 [2024-09-11 16:02:03.790638] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:03.790646] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:03.837633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:03.837685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:03.837693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:03.837702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:03.844827] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726041723844823, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:02:03.851640] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041723851636, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:02:03.904278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:04.037999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:04.038045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:04.038054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:04.038063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:04.044935] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6859, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:02:04.104405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:04.192509] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:04.192553] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54648 [2024-09-11 16:02:04.206584] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:04.245171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:04.245209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:04.245215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:04.245223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:04.304574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:04.391020] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54648, magic:0x78563412 [2024-09-11 16:02:04.391070] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:04.391078] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:04.445513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:04.445559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:04.445566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:04.445575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:04.504770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:04.645881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:04.645947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:04.645956] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:04.645966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:04.681634] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:04.704966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:04.793002] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:04.793035] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54658 [2024-09-11 16:02:04.846333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:04.846380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:04.846388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:04.846399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:04.852525] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041724852521, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007698, add_bytes: 0 [2024-09-11 16:02:04.859192] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041724859187, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:02:04.905140] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:04.990440] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54658, magic:0x78563412 [2024-09-11 16:02:04.990500] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:04.990509] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:05.046638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:05.046682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:05.046690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:05.046699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:05.105265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:05.206776] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:05.246975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:05.247022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:05.247030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:05.247039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:05.305397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:05.392943] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:05.392985] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54672 [2024-09-11 16:02:05.447355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:05.447409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:05.447424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:05.447434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:05.510438] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4846, replace_start_pos=9500000, replace_num=100000) [2024-09-11 16:02:05.510489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:05.591008] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54672, magic:0x78563412 [2024-09-11 16:02:05.591039] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:05.591046] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:05.647835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:05.647880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:05.647887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:05.647898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:05.682773] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:05.710602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:05.848235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:05.848282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:05.848290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:05.848300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:05.860039] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041725860035, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007514, add_bytes: 0 [2024-09-11 16:02:05.866875] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041725866872, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:02:05.910795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:05.992967] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:05.993014] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56118 [2024-09-11 16:02:06.048555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:06.048603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:06.048633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:06.048643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:06.057213] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8556, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:02:06.110940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:06.191485] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56118, magic:0x78563412 [2024-09-11 16:02:06.191525] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:06.191533] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:06.206925] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:06.257514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:06.257566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:06.257572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:06.257581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:06.311081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:06.457982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:06.458028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:06.458035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:06.458056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:06.511200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:06.594365] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:06.594408] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56128 [2024-09-11 16:02:06.658287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:06.658330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:06.658338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:06.658347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:06.683885] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:06.711350] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:06.791798] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56128, magic:0x78563412 [2024-09-11 16:02:06.791842] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:06.791849] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:06.858651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:06.858698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:06.858706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:06.858718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:06.867722] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041726867718, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:02:06.874488] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726041726874484, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:02:06.911493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:07.058987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:07.059034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:07.059041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:07.059050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:07.111614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:07.193927] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:07.193970] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56144 [2024-09-11 16:02:07.207053] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:07.259356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:07.259402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:07.259410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:07.259421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:07.311757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:07.392510] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56144, magic:0x78563412 [2024-09-11 16:02:07.392550] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:07.392557] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:07.459633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:07.459673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:07.459679] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:07.459687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:07.511869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:07.660053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:07.660097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:07.660105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:07.660133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:07.685035] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=111] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:07.715893] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3883, replace_start_pos=9600000, replace_num=100000) [2024-09-11 16:02:07.715948] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:07.794715] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:07.794760] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56158 [2024-09-11 16:02:07.860372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:07.860417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:07.860424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:07.860432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:07.875272] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041727875268, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:02:07.882115] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041727882112, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:02:07.916055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:07.992721] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56158, magic:0x78563412 [2024-09-11 16:02:07.992769] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:07.992776] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:08.060735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:08.060782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:08.060790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:08.060799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:08.069498] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8684, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:02:08.116191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:08.207165] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:08.269760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:08.269803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:08.269810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:08.269817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:08.316344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:08.394759] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:08.394806] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56172 [2024-09-11 16:02:08.470070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:08.470115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:08.470121] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:08.470129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:08.516459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:08.593222] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56172, magic:0x78563412 [2024-09-11 16:02:08.593263] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:08.593271] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:08.670345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:08.670385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:08.670392] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:08.670416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:08.685975] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:08.716573] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:08.870652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:08.870702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:08.870727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:08.870738] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:08.882976] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041728882970, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007702, add_bytes: 0 [2024-09-11 16:02:08.889663] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041728889659, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:02:08.916706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:08.995544] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:08.995588] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56180 [2024-09-11 16:02:09.070987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:09.071030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:09.071036] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:09.071043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:09.116828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:09.193588] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56180, magic:0x78563412 [2024-09-11 16:02:09.193627] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:09.193635] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:09.207398] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:09.271260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:09.271302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:09.271323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:09.271332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:09.316954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:09.471667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:09.471711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:09.471718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:09.471725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:09.517084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:09.594756] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:09.594800] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56192 [2024-09-11 16:02:09.671983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:09.672023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:09.672030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:09.672043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:09.687111] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:09.717216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:09.792832] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56192, magic:0x78563412 [2024-09-11 16:02:09.792864] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:09.792870] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:09.872292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:09.872332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:09.872340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:09.872360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:09.890507] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726041729890504, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 16:02:09.897328] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041729897325, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:02:09.921738] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4342, replace_start_pos=9700000, replace_num=100000) [2024-09-11 16:02:09.921786] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:10.072676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:10.072722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:10.072730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:10.072740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:10.080279] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7525, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:02:10.121872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:10.195204] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:10.195249] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56206 [2024-09-11 16:02:10.207522] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:10.280523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:10.280570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:10.280578] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:10.280587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:10.322003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:10.393308] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56206, magic:0x78563412 [2024-09-11 16:02:10.393351] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:10.393359] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:10.480821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:10.480873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:10.480886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:10.480894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:10.522212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:10.681158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:10.681213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:10.681221] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:10.681230] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:10.688242] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:10.722411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:10.795429] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:10.795475] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56210 [2024-09-11 16:02:10.881542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:10.881591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:10.881599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:10.881609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:10.898118] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041730898115, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:02:10.904875] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041730904874, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:02:10.922608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:10.993697] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56210, magic:0x78563412 [2024-09-11 16:02:10.993741] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:10.993749] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:11.037852] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:11.037927] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=73] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:11.038018] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] update_check_range(min_check_version=75, max_check_version=76, global_version=77) [2024-09-11 16:02:11.040051] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2032 [2024-09-11 16:02:11.040086] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:11.040121] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:02:11.040160] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:02:11.040261] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:11.040369] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:02:11.040420] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:02:11.040432] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:02:11.040449] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:02:11.040485] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:02:11.040546] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:02:11.040567] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:02:11.081837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:11.081881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:11.081887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:11.081895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:11.122761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:11.207736] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:11.282125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:11.282165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:11.282171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:11.282179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:11.322948] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:11.394313] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:11.394359] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56212 [2024-09-11 16:02:11.482414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:11.482459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:11.482465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:11.482473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:11.523075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:11.593128] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56212, magic:0x78563412 [2024-09-11 16:02:11.593171] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:11.593179] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:11.682701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:11.682747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:11.682755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:11.682764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:11.683019] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash time detail, (compute_wash_size_time=96, refresh_score_time=65, wash_time=0) [2024-09-11 16:02:11.689422] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:11.723196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:11.883244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:11.883291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:11.883315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:11.883324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:11.905755] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041731905751, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:02:11.912501] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726041731912497, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:02:11.923396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:11.992819] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:11.992859] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56222 [2024-09-11 16:02:12.083618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:12.083662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:12.083670] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:12.083680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:12.091915] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8222, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:02:12.127974] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4370, replace_start_pos=9800000, replace_num=100000) [2024-09-11 16:02:12.128025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:12.191616] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56222, magic:0x78563412 [2024-09-11 16:02:12.191660] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:12.191667] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:12.207882] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:12.292187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:12.292231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:12.292239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:12.292248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:12.328215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:12.492548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:12.492592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:12.492600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:12.492609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:12.528423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:12.593752] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:12.593798] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56234 [2024-09-11 16:02:12.690306] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:12.692925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:12.692962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:12.692969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:12.692978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:12.728562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:12.792155] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56234, magic:0x78563412 [2024-09-11 16:02:12.792197] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:12.792205] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:12.893273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:12.893318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:12.893365] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:12.893375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:12.913358] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041732913354, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:02:12.920188] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041732920184, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:02:12.928684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:13.093600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:13.093641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:13.093649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:13.093658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:13.128804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:13.193872] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:13.193936] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56246 [2024-09-11 16:02:13.208100] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:13.293914] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:13.293962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:13.293970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:13.293980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:13.329024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:13.392364] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56246, magic:0x78563412 [2024-09-11 16:02:13.392407] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:13.392414] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:13.494207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:13.494243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:13.494250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:13.494258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:13.529160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:13.691587] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:13.694487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:13.694521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:13.694528] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:13.694537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:13.729264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:13.796598] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:13.796642] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56260 [2024-09-11 16:02:13.894850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:13.894891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:13.894899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:13.894941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:13.921038] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041733921034, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:02:13.927802] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041733927798, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:02:13.929418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:13.992852] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56260, magic:0x78563412 [2024-09-11 16:02:13.992895] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:13.992932] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:14.095270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:14.095324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:14.095332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:14.095341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:14.102607] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7252, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:02:14.129539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:14.208229] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:14.302877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:14.302938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:14.302945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:14.302954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:14.333983] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4345, replace_start_pos=9900000, replace_num=100000) [2024-09-11 16:02:14.334026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:14.394952] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:14.394995] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56264 [2024-09-11 16:02:14.503192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:14.503239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:14.503247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:14.503256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:14.534110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:14.593224] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56264, magic:0x78563412 [2024-09-11 16:02:14.593258] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:14.593264] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:14.692467] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:14.703548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:14.703591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:14.703599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:14.703609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:14.734221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:14.903924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:14.903964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:14.903973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:14.903983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:14.928597] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041734928593, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:02:14.934358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:14.935365] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041734935362, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:02:14.994676] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:14.994721] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:56278 [2024-09-11 16:02:15.104229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:15.104272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:15.104279] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:15.104288] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:15.134478] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:15.192868] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:56278, magic:0x78563412 [2024-09-11 16:02:15.192934] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=59] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:15.192944] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:15.208509] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:15.304531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:15.304577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:15.304585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:15.304595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:15.334599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:15.504930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:15.504986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:15.505001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:15.505012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:15.534799] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:15.594866] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:15.594926] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9348 [2024-09-11 16:02:15.705323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:15.705362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:15.705371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:15.705380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:15.734986] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:15.793267] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9348, magic:0x78563412 [2024-09-11 16:02:15.793308] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:15.793316] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:15.793408] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:15.905622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:15.905664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:15.905673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:15.905684] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:15.935108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:15.936283] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041735936280, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:02:15.943025] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041735943021, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007659, add_bytes: 0 [2024-09-11 16:02:16.105937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:16.105983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:16.105991] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:16.106000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:16.113892] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7864, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:02:16.135228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:16.195074] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:16.195117] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9360 [2024-09-11 16:02:16.208658] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:16.314135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:16.314175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:16.314184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:16.314193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:16.335327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:16.393496] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9360, magic:0x78563412 [2024-09-11 16:02:16.393540] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:16.393548] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:16.514415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:16.514456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:16.514463] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:16.514472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:16.539756] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4328, replace_start_pos=10000000, replace_num=100000) [2024-09-11 16:02:16.539818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:16.714721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:16.714766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:16.714774] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:16.714783] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:16.739926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:16.794589] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:16.795800] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:16.795831] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9366 [2024-09-11 16:02:16.915022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:16.915068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:16.915077] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:16.915087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:16.940112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:16.943819] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041736943815, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007535, add_bytes: 0 [2024-09-11 16:02:16.950581] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041736950577, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:02:16.992999] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9366, magic:0x78563412 [2024-09-11 16:02:16.993038] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:16.993045] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:17.115339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:17.115379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:17.115386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:17.115395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:17.140227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:17.208793] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:17.315639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:17.315698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:17.315706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:17.315715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:17.340348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:17.395121] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:17.395164] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9376 [2024-09-11 16:02:17.515977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:17.516017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:17.516025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:17.516034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:17.540470] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:17.592251] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9376, magic:0x78563412 [2024-09-11 16:02:17.592281] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:17.592289] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:17.716255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:17.716291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:17.716331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:17.716340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:17.740572] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:17.795547] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:17.916580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:17.916646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:17.916654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:17.916663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:17.940687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:17.951560] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041737951556, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007741, add_bytes: 0 [2024-09-11 16:02:17.958210] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041737958206, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:02:17.993316] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:17.993362] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9380 [2024-09-11 16:02:18.116891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:18.116947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:18.116955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:18.116963] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:18.125468] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8491, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:02:18.140933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:18.191562] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9380, magic:0x78563412 [2024-09-11 16:02:18.191601] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:18.191608] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:18.208997] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:18.325746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:18.325792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:18.325798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:18.325807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:18.341067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:18.526045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:18.526090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:18.526098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:18.526107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:18.541181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:18.593741] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:18.593772] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9390 [2024-09-11 16:02:18.726336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:18.726377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:18.726383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:18.726392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:18.745676] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4404, replace_start_pos=10100000, replace_num=100000) [2024-09-11 16:02:18.745712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:18.792015] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9390, magic:0x78563412 [2024-09-11 16:02:18.792040] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:18.792047] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:18.796557] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:18.926555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:18.926611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:18.926617] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:18.926625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:18.945813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:18.959125] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041738959122, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:02:18.965826] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041738965822, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:02:19.126850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:19.126900] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:19.126928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:19.126937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:19.145931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:19.194088] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:19.194128] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9406 [2024-09-11 16:02:19.209153] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:19.327237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:19.327282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:19.327288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:19.327297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:19.346043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:19.392324] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9406, magic:0x78563412 [2024-09-11 16:02:19.392347] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:19.392354] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:19.527612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:19.527659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:19.527667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:19.527678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:19.546245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:19.727943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:19.727986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:19.727992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:19.727999] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:19.746390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:19.794467] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:19.794504] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9416 [2024-09-11 16:02:19.797374] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:19.928226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:19.928277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:19.928284] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:19.928292] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:19.946536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:19.966683] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041739966678, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:02:19.973426] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041739973423, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:02:19.992962] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9416, magic:0x78563412 [2024-09-11 16:02:19.993003] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:19.993010] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:20.128534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:20.128578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:20.128585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:20.128593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:20.135219] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6612, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:02:20.146691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:20.209282] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:20.335527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:20.335566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:20.335574] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:20.335583] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:20.346812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:20.395057] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:20.395100] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9426 [2024-09-11 16:02:20.535813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:20.535869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:20.535900] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:20.535931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:20.546924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:20.593593] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9426, magic:0x78563412 [2024-09-11 16:02:20.593626] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:20.593633] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:20.736167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:20.736213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:20.736221] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:20.736231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:20.747022] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:20.798373] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:20.936404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:20.936455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:20.936462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:20.936471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:20.951526] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4386, replace_start_pos=10200000, replace_num=100000) [2024-09-11 16:02:20.951575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:20.974286] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726041740974282, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:02:20.981107] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041740981103, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:02:20.996832] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:20.996932] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=95] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9428 [2024-09-11 16:02:21.053866] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:21.053933] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=65] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:21.054012] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=76, max_check_version=77, global_version=78) [2024-09-11 16:02:21.056003] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1988 [2024-09-11 16:02:21.056049] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:21.056084] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:02:21.056121] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:02:21.056219] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:21.056396] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:02:21.056493] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=56] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:02:21.056508] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:02:21.056521] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:02:21.056575] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:02:21.056639] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:02:21.056661] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:02:21.136689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:21.136733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:21.136739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:21.136746] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:21.151658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:21.194065] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9428, magic:0x78563412 [2024-09-11 16:02:21.194106] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:21.194113] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:21.209528] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:21.337018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:21.337062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:21.337069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:21.337078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:21.351846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:21.537392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:21.537444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:21.537453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:21.537464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:21.552076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:21.594070] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:21.594115] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9440 [2024-09-11 16:02:21.737693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:21.737738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:21.737745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:21.737754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:21.752200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:21.791159] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9440, magic:0x78563412 [2024-09-11 16:02:21.791208] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:21.791214] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:21.799244] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:21.938067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:21.938117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:21.938145] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:21.938156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:21.952326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:21.981966] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041741981961, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:02:21.988672] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041741988668, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 16:02:22.138387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:22.138438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:22.138444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:22.138452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:22.146200] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7734, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:02:22.152505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:22.193421] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:22.193470] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9452 [2024-09-11 16:02:22.209647] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:22.346480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:22.346525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:22.346533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:22.346542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:22.352685] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:22.391822] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9452, magic:0x78563412 [2024-09-11 16:02:22.391865] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:22.391873] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:22.546804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:22.546849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:22.546857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:22.546866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:22.552807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:22.747080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:22.747127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:22.747133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:22.747141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:22.752935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:22.793761] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:22.793808] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9462 [2024-09-11 16:02:22.800132] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:22.947469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:22.947515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:22.947522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:22.947531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:22.953057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:22.989585] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041742989581, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:02:22.992351] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9462, magic:0x78563412 [2024-09-11 16:02:22.992379] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:22.992386] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:22.996349] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041742996345, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:02:23.147764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:23.147806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:23.147814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:23.147824] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:23.157578] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4418, replace_start_pos=10300000, replace_num=100000) [2024-09-11 16:02:23.157622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:23.209786] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:23.348043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:23.348084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:23.348090] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:23.348097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:23.357707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:23.394175] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:23.394205] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9472 [2024-09-11 16:02:23.548322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:23.548363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:23.548370] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:23.548378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:23.557797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:23.592719] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9472, magic:0x78563412 [2024-09-11 16:02:23.592756] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:23.592764] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:23.748604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:23.748648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:23.748656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:23.748665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:23.757882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:23.801207] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:23.948925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:23.948966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:23.948973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:23.948982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:23.958056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:23.994301] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:23.994348] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9484 [2024-09-11 16:02:23.997200] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726041743997197, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:02:24.003890] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041744003886, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:02:24.149254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:24.149294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:24.149302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:24.149312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:24.156301] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6974, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:02:24.158170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:24.193030] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9484, magic:0x78563412 [2024-09-11 16:02:24.193072] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:24.193079] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:24.209917] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:24.356584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:24.356632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:24.356640] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:24.356649] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:24.356850] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:02:24.358260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:24.557084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:24.557129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:24.557153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:24.557163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:24.558353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:24.594209] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:24.594252] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9486 [2024-09-11 16:02:24.757474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:24.757519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:24.757527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:24.757536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:24.758441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:24.792601] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9486, magic:0x78563412 [2024-09-11 16:02:24.792642] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:24.792650] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:24.802186] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:24.957878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:24.957940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:24.957948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:24.957957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:24.958538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:25.004763] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041745004759, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:02:25.011581] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=76] PNIO [ratelimit] time: 1726041745011577, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:02:25.158181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:25.158229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:25.158253] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:25.158262] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:25.158639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:25.194420] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:25.194458] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:9488 [2024-09-11 16:02:25.210117] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:25.358507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:25.358548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:25.358557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:25.358566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:25.363070] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4311, replace_start_pos=10400000, replace_num=100000) [2024-09-11 16:02:25.363115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:25.393093] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:9488, magic:0x78563412 [2024-09-11 16:02:25.393130] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:25.393138] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:25.558815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:25.558871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:25.558885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:25.558941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:25.563200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:25.759263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:25.759304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:25.759312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:25.759321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:25.763330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:25.795403] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:25.795447] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30030 [2024-09-11 16:02:25.803191] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:25.959637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:25.959683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:25.959692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:25.959701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:25.963460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:25.993748] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30030, magic:0x78563412 [2024-09-11 16:02:25.993790] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:25.993798] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:26.012432] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041746012427, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:02:26.019191] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041746019188, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:02:26.159970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:26.160015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:26.160022] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:26.160031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:26.163605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:26.167410] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7348, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:02:26.210272] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:26.363758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:26.367648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:26.367684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:26.367691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:26.367700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:26.395836] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:26.395870] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30042 [2024-09-11 16:02:26.563924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:26.567947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:26.567976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:26.567984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:26.567995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:26.594075] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30042, magic:0x78563412 [2024-09-11 16:02:26.594124] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:26.594149] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:26.764063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:26.768330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:26.768369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:26.768377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:26.768386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:26.804183] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:26.964181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:26.968637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:26.968678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:26.968686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:26.968695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:26.996125] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:26.996160] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30046 [2024-09-11 16:02:27.019981] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041747019977, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:02:27.026753] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041747026750, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:02:27.164304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:27.168943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:27.168970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:27.168977] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:27.168986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:27.194650] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30046, magic:0x78563412 [2024-09-11 16:02:27.194690] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:27.194715] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:27.210487] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:27.364430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:27.369222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:27.369251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:27.369260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:27.369271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:27.568879] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4325, replace_start_pos=10500000, replace_num=100000) [2024-09-11 16:02:27.568936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:27.569517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:27.569551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:27.569558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:27.569567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:27.598860] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:27.598938] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=71] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30054 [2024-09-11 16:02:27.769023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:27.769860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:27.769922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:27.769938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:27.769967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:27.797128] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30054, magic:0x78563412 [2024-09-11 16:02:27.797166] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:27.797172] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:27.805267] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:27.969157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:27.970201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:27.970234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:27.970242] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:27.970251] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:28.027609] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041748027604, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:02:28.034374] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041748034370, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:02:28.169274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:28.170498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:28.170533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:28.170543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:28.170554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:28.181821] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=11251, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:02:28.199813] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:28.199862] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30060 [2024-09-11 16:02:28.210610] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:28.369392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:28.382180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:28.382245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:28.382255] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:28.382265] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:28.397979] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30060, magic:0x78563412 [2024-09-11 16:02:28.398030] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:28.398040] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:28.569519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:28.582574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:28.582618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:28.582627] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:28.582637] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:28.769647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:28.782873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:28.782928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:28.782937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:28.782946] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:28.799471] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:28.799503] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30068 [2024-09-11 16:02:28.806307] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:28.969785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:28.983246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:28.983294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:28.983303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:28.983330] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:28.998194] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30068, magic:0x78563412 [2024-09-11 16:02:28.998237] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:28.998247] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:29.035287] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726041749035283, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:02:29.042033] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041749042029, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007659, add_bytes: 0 [2024-09-11 16:02:29.169920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:29.183637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:29.183679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:29.183688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:29.183697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:29.210797] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:29.370045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:29.383953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:29.383998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:29.384005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:29.384014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:29.400177] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:29.400222] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30084 [2024-09-11 16:02:29.570231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:29.584253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:29.584294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:29.584301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:29.584309] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:29.598591] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30084, magic:0x78563412 [2024-09-11 16:02:29.598627] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:29.598634] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:29.773737] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3364, replace_start_pos=10600000, replace_num=100000) [2024-09-11 16:02:29.773783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:29.784542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:29.784576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:29.784585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:29.784595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:29.807177] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:29.973934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:29.984895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:29.984959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:29.984967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:29.984976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:30.000468] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:30.000511] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30092 [2024-09-11 16:02:30.042826] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041750042822, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:02:30.049604] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041750049600, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007571, add_bytes: 0 [2024-09-11 16:02:30.174067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:30.185216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:30.185252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:30.185260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:30.185269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:30.193314] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8033, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:02:30.199087] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30092, magic:0x78563412 [2024-09-11 16:02:30.199120] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:30.199128] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:30.210977] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:30.374249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:30.393674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:30.393719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:30.393728] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:30.393737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:30.574383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:30.594080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:30.594127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:30.594136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:30.594145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:30.601183] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:30.601223] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30102 [2024-09-11 16:02:30.774553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=81] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:30.794466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:30.794513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:30.794521] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:30.794530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:30.799679] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30102, magic:0x78563412 [2024-09-11 16:02:30.799714] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:30.799721] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:30.808603] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:30.974684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:30.994836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:30.994877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:30.994886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:30.994895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:31.050446] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041751050442, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:02:31.057224] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041751057221, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:02:31.071118] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:31.071187] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=68] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:31.071272] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=77, max_check_version=78, global_version=79) [2024-09-11 16:02:31.073342] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2068 [2024-09-11 16:02:31.073386] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:31.073422] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:02:31.073465] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:02:31.073548] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:31.073685] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:02:31.073742] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:02:31.073753] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:02:31.073764] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:02:31.073804] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:02:31.073864] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:02:31.073886] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:02:31.174870] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:31.195218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:31.195263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:31.195271] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:31.195281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:31.201648] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:31.201687] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30118 [2024-09-11 16:02:31.211118] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:31.375074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:31.395586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:31.395632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:31.395657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:31.395667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:31.400060] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30118, magic:0x78563412 [2024-09-11 16:02:31.400091] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:31.400100] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:31.575262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:31.596001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:31.596048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:31.596057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:31.596066] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:31.775457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:31.796366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:31.796415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:31.796424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:31.796434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:31.801545] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:31.801586] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30122 [2024-09-11 16:02:31.809875] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:31.978937] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3351, replace_start_pos=10700000, replace_num=100000) [2024-09-11 16:02:31.978986] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:31.996741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:31.996781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:31.996789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:31.996814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:31.997067] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=91, refresh_score_time=64, wash_time=0) [2024-09-11 16:02:31.999642] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30122, magic:0x78563412 [2024-09-11 16:02:31.999670] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:31.999676] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:32.058051] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041752058048, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:02:32.064892] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041752064887, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:02:32.179070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:32.197375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:32.197419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:32.197427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:32.197436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:32.206083] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8632, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:02:32.211230] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:32.379244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:32.401932] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:32.401980] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30126 [2024-09-11 16:02:32.406354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:32.406405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:32.406413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:32.406422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:32.579380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:32.600245] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30126, magic:0x78563412 [2024-09-11 16:02:32.600287] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:32.600295] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:32.606735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:32.606773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:32.606782] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:32.606794] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:32.779575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:32.807098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:32.807138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:32.807146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:32.807156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:32.810818] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:32.979720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:33.002241] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:33.002288] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30142 [2024-09-11 16:02:33.007451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:33.007486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:33.007495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:33.007522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:33.065672] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041753065669, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:02:33.072500] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726041753072497, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:02:33.179898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:33.200535] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30142, magic:0x78563412 [2024-09-11 16:02:33.200584] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:33.200595] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:33.207830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:33.207868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:33.207876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:33.207885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:33.211441] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:33.380040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:33.408193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:33.408235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:33.408244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:33.408255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:33.580174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:33.602620] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:33.602676] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30146 [2024-09-11 16:02:33.608559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:33.608595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:33.608603] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:33.608612] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:33.780388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:33.801106] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30146, magic:0x78563412 [2024-09-11 16:02:33.801149] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:33.801156] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:33.808869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:33.808931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:33.808940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:33.808951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:33.812001] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:33.980538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:34.009202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:34.009248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:34.009256] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:34.009266] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:34.073361] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041754073356, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:02:34.080133] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041754080128, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:02:34.184996] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4335, replace_start_pos=10800000, replace_num=100000) [2024-09-11 16:02:34.185056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:34.203010] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:34.203053] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30150 [2024-09-11 16:02:34.209506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:34.209545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:34.209553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:34.209562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:34.211555] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:34.218130] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8554, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:02:34.385207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:34.401361] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30150, magic:0x78563412 [2024-09-11 16:02:34.401397] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:34.401403] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:34.418454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:34.418496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:34.418503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:34.418513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:34.585333] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:34.618814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:34.618855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:34.618863] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:34.618872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:34.785460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:34.802442] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:34.802485] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30162 [2024-09-11 16:02:34.812759] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:34.819177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:34.819219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:34.819227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:34.819237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:34.985677] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:35.000845] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30162, magic:0x78563412 [2024-09-11 16:02:35.000890] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:35.000896] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:35.019579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:35.019623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:35.019631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:35.019640] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:35.080976] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041755080972, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:02:35.087667] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041755087663, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007535, add_bytes: 0 [2024-09-11 16:02:35.185872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:35.211682] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:35.219963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:35.220001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:35.220009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:35.220018] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:35.386111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=89] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:35.402504] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:35.402563] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:30166 [2024-09-11 16:02:35.420259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:35.420298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:35.420306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:35.420315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:35.586255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:35.601006] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:30166, magic:0x78563412 [2024-09-11 16:02:35.601044] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:35.601050] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:35.620565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:35.620611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:35.620620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:35.620649] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:35.786471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:35.813497] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:35.820884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:35.820938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:35.820962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:35.820972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:35.986619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:36.002813] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:36.002856] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52448 [2024-09-11 16:02:36.021271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:36.021311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:36.021318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:36.021328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:36.088529] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041756088525, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:02:36.095370] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041756095367, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007704, add_bytes: 0 [2024-09-11 16:02:36.186764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:36.201543] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52448, magic:0x78563412 [2024-09-11 16:02:36.201583] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:36.201589] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:36.211930] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:36.221626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:36.221669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:36.221694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:36.221706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:36.228673] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6953, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:02:36.391269] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4342, replace_start_pos=10900000, replace_num=100000) [2024-09-11 16:02:36.391317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:36.429044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:36.429090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:36.429098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:36.429108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:36.591418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:36.603761] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:36.603803] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52462 [2024-09-11 16:02:36.629354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:36.629399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:36.629406] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:36.629415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:36.791548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:36.801946] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52462, magic:0x78563412 [2024-09-11 16:02:36.801979] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:36.801986] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:36.814233] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:36.829717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:36.829757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:36.829793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:36.829804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:36.991711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:37.030095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:37.030140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:37.030148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:37.030157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:37.096203] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041757096199, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:02:37.102960] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041757102956, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007589, add_bytes: 0 [2024-09-11 16:02:37.191894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:37.203756] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:37.203798] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52472 [2024-09-11 16:02:37.212159] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:37.230394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:37.230436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:37.230445] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:37.230455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:37.392097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:37.402527] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52472, magic:0x78563412 [2024-09-11 16:02:37.402571] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:37.402580] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:37.430754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:37.430797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:37.430805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:37.430815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:37.592326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:37.631116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:37.631163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:37.631170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:37.631180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:37.792461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:37.804974] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:37.805021] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52482 [2024-09-11 16:02:37.814986] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:37.831375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:37.831419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:37.831426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:37.831434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:37.992649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:38.003111] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52482, magic:0x78563412 [2024-09-11 16:02:38.003150] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:38.003171] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:38.031643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:38.031687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:38.031694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:38.031701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:38.103822] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041758103818, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:02:38.110535] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041758110532, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007576, add_bytes: 0 [2024-09-11 16:02:38.192793] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:38.212341] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:38.231926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:38.231969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:38.231976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:38.231983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:38.239638] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7643, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:02:38.392920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:38.405381] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:38.405441] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52494 [2024-09-11 16:02:38.439930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:38.439992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:38.440000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:38.440008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:38.597061] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4010, replace_start_pos=11000000, replace_num=100000) [2024-09-11 16:02:38.597102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:38.602687] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52494, magic:0x78563412 [2024-09-11 16:02:38.602720] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:38.602727] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:38.640223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:38.640271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:38.640277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:38.640285] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:38.797207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:38.815835] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:38.840501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:38.840538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:38.840544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:38.840551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:38.997348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:39.004397] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:39.004439] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52508 [2024-09-11 16:02:39.040778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:39.040818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:39.040840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:39.040849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:39.111463] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041759111459, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2024-09-11 16:02:39.118235] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041759118232, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 16:02:39.197480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:39.202880] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52508, magic:0x78563412 [2024-09-11 16:02:39.202948] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=62] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:39.202955] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:39.212541] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:39.241130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:39.241201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:39.241213] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:39.241228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:39.397603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:39.441487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:39.441533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:39.441540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:39.441549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:39.597737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:39.605828] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:39.605873] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52522 [2024-09-11 16:02:39.641786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:39.641821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:39.641827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:39.641835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:39.797856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:39.803574] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52522, magic:0x78563412 [2024-09-11 16:02:39.803609] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:39.803616] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:39.816606] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=98] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:39.842069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:39.842118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:39.842125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:39.842135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:39.998054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:40.042374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:40.042423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:40.042430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:40.042439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:40.118999] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041760118996, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:02:40.125766] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041760125763, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007531, add_bytes: 0 [2024-09-11 16:02:40.198181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:40.204336] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:40.204393] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52524 [2024-09-11 16:02:40.212683] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:40.242678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:40.242730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:40.242737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:40.242747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:40.251293] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8524, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:02:40.398309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:40.402989] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52524, magic:0x78563412 [2024-09-11 16:02:40.403025] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:40.403030] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:40.451546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:40.451593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:40.451601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:40.451609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:40.598490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:40.651856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:40.651925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:40.651934] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:40.651943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:40.803050] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=82] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4378, replace_start_pos=11100000, replace_num=100000) [2024-09-11 16:02:40.803099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:40.804012] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:40.804044] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52536 [2024-09-11 16:02:40.817457] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:40.852167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:40.852211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:40.852219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:40.852228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:41.002152] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52536, magic:0x78563412 [2024-09-11 16:02:41.002195] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:41.002203] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:41.003196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:41.052457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:41.052524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:41.052533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:41.052541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:41.087987] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:41.088044] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:41.088145] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] update_check_range(min_check_version=78, max_check_version=79, global_version=80) [2024-09-11 16:02:41.090179] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2034 [2024-09-11 16:02:41.090214] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:41.090250] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:02:41.090288] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:02:41.090371] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:41.090493] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,685,568 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 198,416 used= 186,136 count= 23 avg_used= 8,092 block_cnt= 23 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,685,568 used= 76,271,908 count= 1,550 avg_used= 49,207 mod=SUMMARY [2024-09-11 16:02:41.090545] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:02:41.090557] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:02:41.090568] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:02:41.090604] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:02:41.090667] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:02:41.090689] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:02:41.126604] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041761126599, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:02:41.133437] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726041761133433, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:02:41.203335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:41.212898] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:41.252745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:41.252790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:41.252796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:41.252803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:41.403480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:41.403968] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:41.403998] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52542 [2024-09-11 16:02:41.453040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:41.453101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:41.453108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:41.453117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:41.602636] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52542, magic:0x78563412 [2024-09-11 16:02:41.602679] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:41.602686] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:41.603603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:41.653336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:41.653382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:41.653391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:41.653400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:41.803831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:41.818423] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:41.853624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:41.853665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:41.853672] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:41.853682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:42.003966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:42.005107] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:42.005140] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52548 [2024-09-11 16:02:42.053928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:42.053975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:42.053983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:42.054008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:42.134282] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041762134278, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:02:42.140980] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041762140977, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:02:42.203262] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52548, magic:0x78563412 [2024-09-11 16:02:42.203303] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:42.203311] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:42.204097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:42.213035] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:42.254234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:42.254278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:42.254286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:42.254295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:42.262835] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8527, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:02:42.404280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:42.463089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:42.463129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:42.463137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:42.463146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:42.604417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:42.606126] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:42.606151] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52562 [2024-09-11 16:02:42.663421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:42.663472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:42.663480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:42.663490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:42.803448] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52562, magic:0x78563412 [2024-09-11 16:02:42.803486] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:42.803492] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:42.804545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:42.819543] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:42.863735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:42.863780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:42.863788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:42.863797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:43.009015] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=11200000, replace_num=100000) [2024-09-11 16:02:43.009062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:43.064061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:43.064105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:43.064112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:43.064121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:43.141896] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041763141892, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:02:43.148602] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041763148598, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:02:43.205500] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:43.205547] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52564 [2024-09-11 16:02:43.209146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:43.213153] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:43.264426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:43.264473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:43.264481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:43.264491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:43.403933] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52564, magic:0x78563412 [2024-09-11 16:02:43.403971] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:43.403978] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:43.409261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:43.464759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:43.464816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:43.464840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:43.464851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:43.609378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:43.665083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:43.665125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:43.665131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:43.665139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:43.806199] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:43.806245] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52576 [2024-09-11 16:02:43.809577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:43.820674] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:43.865352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:43.865396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:43.865402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:43.865419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:44.004386] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52576, magic:0x78563412 [2024-09-11 16:02:44.004431] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:44.004438] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:44.009752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:44.065659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:44.065707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:44.065715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:44.065723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:44.149453] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=81] PNIO [ratelimit] time: 1726041764149449, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:02:44.156274] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041764156270, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:02:44.209930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:44.213326] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:44.265980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:44.266022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:44.266028] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:44.266036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:44.274324] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8274, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:02:44.406559] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:44.406599] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52592 [2024-09-11 16:02:44.410131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:44.474611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:44.474657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:44.474665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:44.474674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:44.604959] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52592, magic:0x78563412 [2024-09-11 16:02:44.605002] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:44.605009] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:44.610241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:44.674928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:44.674973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:44.675000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:44.675019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:44.810352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:44.821967] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:44.875271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:44.875314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:44.875324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:44.875335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:45.006716] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:45.006762] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:52600 [2024-09-11 16:02:45.010472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:45.075564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:45.075611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:45.075619] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:45.075628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:45.157128] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041765157123, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:02:45.163932] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041765163927, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:02:45.205128] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:52600, magic:0x78563412 [2024-09-11 16:02:45.205162] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:45.205168] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:45.213515] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:45.215046] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4451, replace_start_pos=11300000, replace_num=100000) [2024-09-11 16:02:45.215077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:45.275853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:45.275899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:45.275922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:45.275930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:45.415242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:45.476163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:45.476199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:45.476207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:45.476215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:45.607416] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:45.607457] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37560 [2024-09-11 16:02:45.615426] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:45.676522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:45.676567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:45.676574] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:45.676584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:45.804691] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37560, magic:0x78563412 [2024-09-11 16:02:45.804770] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=74] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:45.804779] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:45.815545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:45.822979] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:45.876830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:45.876876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:45.876925] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:45.876935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:46.015744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:46.077168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:46.077207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:46.077214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:46.077225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:46.164681] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041766164676, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:02:46.171441] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041766171439, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007512, add_bytes: 0 [2024-09-11 16:02:46.206169] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:46.206213] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37566 [2024-09-11 16:02:46.213676] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:46.215865] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:46.277479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:46.277526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:46.277534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:46.277543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:46.285459] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7902, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:02:46.404931] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37566, magic:0x78563412 [2024-09-11 16:02:46.404962] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:46.404969] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:46.416052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:46.485848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:46.485892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:46.485922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:46.485934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:46.616193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:46.686329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:46.686375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:46.686384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:46.686393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:46.807117] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:46.807158] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37574 [2024-09-11 16:02:46.816328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:46.824117] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:46.886697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:46.886741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:46.886749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:46.886757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:47.005357] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37574, magic:0x78563412 [2024-09-11 16:02:47.005389] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:47.005411] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:47.016460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:47.087031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:47.087075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:47.087081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:47.087090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:47.172361] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041767172356, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:02:47.179072] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041767179070, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:02:47.213799] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:47.216582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:47.287347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:47.287394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:47.287402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:47.287411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:47.408287] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:47.408328] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37586 [2024-09-11 16:02:47.421023] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4325, replace_start_pos=11400000, replace_num=100000) [2024-09-11 16:02:47.421069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:47.487713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:47.487756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:47.487764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:47.487773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:47.606034] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37586, magic:0x78563412 [2024-09-11 16:02:47.606082] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:47.606092] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:47.621245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:47.688050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:47.688097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:47.688105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:47.688114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:47.821379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:47.825132] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:47.888405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:47.888450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:47.888458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:47.888467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:48.008238] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:48.008283] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37590 [2024-09-11 16:02:48.021575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:48.088789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:48.088842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:48.088869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:48.088879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:48.179932] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041768179928, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 16:02:48.186670] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041768186666, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:02:48.206456] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37590, magic:0x78563412 [2024-09-11 16:02:48.206485] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:48.206492] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:48.213980] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:48.221717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:48.289186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:48.289235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:48.289243] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:48.289252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:48.297137] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7870, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:02:48.421890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:48.497485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:48.497532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:48.497540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:48.497565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:48.608031] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:48.608070] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37604 [2024-09-11 16:02:48.622052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:48.697866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:48.697930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:48.697939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:48.697950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:48.806711] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37604, magic:0x78563412 [2024-09-11 16:02:48.806749] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:48.806755] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:48.822259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:48.826223] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:48.898268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:48.898311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:48.898319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:48.898328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:49.022409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:49.098555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:49.098597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:49.098604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:49.098611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:49.187600] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041769187595, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:02:49.194359] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041769194355, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:02:49.209153] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:49.209200] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37612 [2024-09-11 16:02:49.214103] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:49.222618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:49.298941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:49.298988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:49.298996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:49.299006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:49.407397] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37612, magic:0x78563412 [2024-09-11 16:02:49.407438] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:49.407447] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:49.422740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:49.499249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:49.499295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:49.499303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:49.499312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:49.626631] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3776, replace_start_pos=11500000, replace_num=100000) [2024-09-11 16:02:49.626692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:49.699614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:49.699660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:49.699668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:49.699678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:49.809277] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:49.809313] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37626 [2024-09-11 16:02:49.826778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:49.827325] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:49.900005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:49.900057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:49.900066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:49.900076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:50.007846] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37626, magic:0x78563412 [2024-09-11 16:02:50.007889] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:50.007896] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:50.026926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:50.100374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:50.100416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:50.100424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:50.100434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:50.195160] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726041770195156, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:02:50.201990] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041770201985, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:02:50.214214] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:50.227044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:50.300671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:50.300718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:50.300726] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:50.300735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:50.308982] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8233, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:02:50.409951] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:50.409996] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37632 [2024-09-11 16:02:50.427160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:50.509266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:50.509312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:50.509320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:50.509328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:50.608250] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37632, magic:0x78563412 [2024-09-11 16:02:50.608287] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:50.608294] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:50.627283] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:50.709581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:50.709645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:50.709653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:50.709662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:50.827468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:50.828477] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:50.909896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:50.909944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:50.909951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:50.909961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:51.009964] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:51.010009] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37634 [2024-09-11 16:02:51.027618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:51.105045] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:51.105098] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:02:51.105177] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=79, max_check_version=80, global_version=81) [2024-09-11 16:02:51.107205] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2027 [2024-09-11 16:02:51.107238] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:51.107273] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:02:51.107329] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:02:51.107414] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:02:51.107521] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 8 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:02:51.107571] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:02:51.107588] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:02:51.107599] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:02:51.107636] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:02:51.107696] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:02:51.107719] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:02:51.110258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:51.110285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:51.110311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:51.110322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:51.202826] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041771202822, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:02:51.208393] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37634, magic:0x78563412 [2024-09-11 16:02:51.208430] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:51.208438] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:51.209520] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041771209518, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007533, add_bytes: 0 [2024-09-11 16:02:51.214380] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=88] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:51.227748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:51.310569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:51.310616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:51.310623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:51.310632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:51.427861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:51.510873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:51.510938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:51.510946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:51.510954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:51.610979] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:51.611025] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37642 [2024-09-11 16:02:51.628081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:51.711214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:51.711261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:51.711268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:51.711278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:51.808145] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37642, magic:0x78563412 [2024-09-11 16:02:51.808186] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:51.808192] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:51.830276] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=910] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:51.832284] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4063, replace_start_pos=11600000, replace_num=100000) [2024-09-11 16:02:51.832320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:51.911543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:51.911629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=85][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:51.911638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:51.911645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:52.032487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:52.111896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:52.111969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:52.111977] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:52.111986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:52.208637] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:52.208697] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37650 [2024-09-11 16:02:52.210442] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041772210439, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:02:52.214488] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:52.217139] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726041772217137, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:02:52.232631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:52.312230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:52.312274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:52.312282] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:52.312291] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:52.312505] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=78, refresh_score_time=63, wash_time=0) [2024-09-11 16:02:52.321043] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8527, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:02:52.407301] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37650, magic:0x78563412 [2024-09-11 16:02:52.407351] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:52.407362] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:52.432773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:52.521314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:52.521360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:52.521368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:52.521378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:52.632988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:52.721644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:52.721689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:52.721696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:52.721705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:52.809430] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:52.809470] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37652 [2024-09-11 16:02:52.831029] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:52.833110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:52.921970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:52.922017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:52.922024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:52.922033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:53.007754] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37652, magic:0x78563412 [2024-09-11 16:02:53.007796] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:53.007804] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:53.033236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:53.122259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:53.122303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:53.122309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:53.122316] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:53.214601] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:53.218013] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041773218009, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:02:53.224748] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726041773224743, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:02:53.233359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:53.322560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:53.322600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:53.322608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:53.322617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:53.408936] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:53.408980] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37660 [2024-09-11 16:02:53.433533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:53.522945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:53.522986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:53.522994] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:53.523004] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:53.607217] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37660, magic:0x78563412 [2024-09-11 16:02:53.607261] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:53.607269] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:53.633658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:53.723243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:53.723307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:53.723315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:53.723324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:53.832063] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:53.833783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:53.923545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:53.923585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:53.923591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:53.923599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:54.009776] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:54.009821] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37674 [2024-09-11 16:02:54.037197] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3285, replace_start_pos=11700000, replace_num=100000) [2024-09-11 16:02:54.037235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:54.123833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:54.123874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:54.123880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:54.123888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:54.207617] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37674, magic:0x78563412 [2024-09-11 16:02:54.207660] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:54.207668] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:54.214736] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:54.225611] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041774225607, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:02:54.232367] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041774232363, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:02:54.237418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:54.324102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:54.324146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:54.324152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:54.324160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:54.330846] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6675, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:02:54.437604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:54.531193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:54.531241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:54.531249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:54.531259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:54.531453] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:02:54.609474] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:54.609526] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37678 [2024-09-11 16:02:54.637796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:54.731687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:54.731735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:54.731742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:54.731774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:54.807725] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37678, magic:0x78563412 [2024-09-11 16:02:54.807761] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:54.807768] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:54.833073] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:54.837923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:54.932013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:54.932059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:54.932067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:54.932076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:55.038104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:55.132384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:55.132432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:55.132440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:55.132449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:55.209454] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:55.209490] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:37692 [2024-09-11 16:02:55.214856] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:55.233334] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041775233331, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007724, add_bytes: 0 [2024-09-11 16:02:55.238238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:55.240055] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726041775240053, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:02:55.332677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:55.332718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:55.332744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:55.332751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:55.408119] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:37692, magic:0x78563412 [2024-09-11 16:02:55.408166] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:55.408173] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:55.438416] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:55.533059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:55.533103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:55.533111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:55.533119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:55.638540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:55.733352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:55.733398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:55.733405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:55.733414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:55.813054] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:55.813098] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46454 [2024-09-11 16:02:55.834055] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:55.838668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:55.933635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:55.933679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:55.933685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:55.933693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:56.008826] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46454, magic:0x78563412 [2024-09-11 16:02:56.008870] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:56.008878] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:56.038854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:56.133960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:56.134003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:56.134009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:56.134022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:56.215014] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:56.240859] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041776240855, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007524, add_bytes: 0 [2024-09-11 16:02:56.243519] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4444, replace_start_pos=11800000, replace_num=100000) [2024-09-11 16:02:56.243557] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:56.247662] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041776247616, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:02:56.334270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:56.334308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:56.334314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:56.334322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:56.340957] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6625, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:02:56.411269] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:56.411305] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46460 [2024-09-11 16:02:56.443710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:56.541213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:56.541252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:56.541259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:56.541267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:56.609366] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46460, magic:0x78563412 [2024-09-11 16:02:56.609405] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:56.609412] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:56.643936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:56.741502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:56.741542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:56.741548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:56.741556] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:56.834966] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:56.844061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:56.941877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:56.941946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:56.941955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:56.941964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:57.011312] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:57.011356] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46474 [2024-09-11 16:02:57.044183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:57.142206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:57.142253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:57.142260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:57.142270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:57.209700] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46474, magic:0x78563412 [2024-09-11 16:02:57.209745] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:57.209752] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:57.215219] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:57.244306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:57.248522] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726041777248519, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:02:57.255291] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041777255287, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:02:57.342555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:57.342602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:57.342609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:57.342618] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:57.444427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:57.542871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:57.542952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:57.542962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:57.542972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:57.611349] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:57.611394] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46476 [2024-09-11 16:02:57.644549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:57.743276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:57.743318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:57.743326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:57.743336] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:57.810098] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46476, magic:0x78563412 [2024-09-11 16:02:57.810136] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:57.810144] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:57.836115] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:57.844661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:02:57.943611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:57.943654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:57.943660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:57.943669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:58.044781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:02:58.144056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:58.144106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:58.144114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:58.144144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:58.212506] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:58.212551] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46484 [2024-09-11 16:02:58.215331] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:58.244914] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:02:58.256138] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041778256135, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:02:58.262844] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041778262839, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:02:58.344451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:58.344491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:58.344499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:58.344509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:58.353078] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8556, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:02:58.410572] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46484, magic:0x78563412 [2024-09-11 16:02:58.410614] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:58.410621] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:58.449374] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=11900000, replace_num=100000) [2024-09-11 16:02:58.449426] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:02:58.553340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:58.553399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:58.553407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:58.553416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:58.649512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:02:58.753643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:58.753685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:58.753691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:58.753699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:58.812006] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:58.812045] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46494 [2024-09-11 16:02:58.837415] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:58.849627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:02:58.954042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:58.954090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:58.954100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:58.954109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:59.010778] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46494, magic:0x78563412 [2024-09-11 16:02:59.010829] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:59.010839] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:59.049757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:02:59.154349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:59.154388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:59.154395] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:59.154419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:59.215553] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:02:59.249885] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:02:59.263688] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041779263685, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:02:59.270454] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041779270449, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:02:59.354649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:59.354688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:59.354696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:59.354705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:59.417142] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:02:59.417205] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46510 [2024-09-11 16:02:59.450043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:02:59.555005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:59.555053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:59.555060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:59.555069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:59.611304] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46510, magic:0x78563412 [2024-09-11 16:02:59.611346] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:02:59.611370] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:02:59.650173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:02:59.755314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:59.755361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:59.755368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:59.755375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:02:59.838663] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:02:59.850296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:02:59.955613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:02:59.955662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:02:59.955671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:02:59.955680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:00.013715] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:00.013763] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46520 [2024-09-11 16:03:00.050419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:00.155925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:00.155969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:00.155976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:00.155983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:00.211840] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46520, magic:0x78563412 [2024-09-11 16:03:00.211869] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:00.211875] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:00.215727] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:00.250541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:00.265429] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:03:00.271370] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041780271367, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:03:00.271411] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:03:00.275810] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:03:00.278134] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041780278132, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:03:00.278166] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:03:00.356212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:00.356249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:00.356258] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:00.356268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:00.363108] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6826, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:03:00.450691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:00.563395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:00.563439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:00.563447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:00.563456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:00.614411] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:00.614471] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46528 [2024-09-11 16:03:00.654195] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3363, replace_start_pos=12000000, replace_num=100000) [2024-09-11 16:03:00.654248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:00.763754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:00.763792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:00.763799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:00.763807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:00.812119] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46528, magic:0x78563412 [2024-09-11 16:03:00.812157] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:00.812163] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:00.839544] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:00.854334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:00.964053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:00.964100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:00.964108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:00.964118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:01.054458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:01.123629] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:01.123686] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=55] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:01.123771] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] update_check_range(min_check_version=80, max_check_version=81, global_version=82) [2024-09-11 16:03:01.125829] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2056 [2024-09-11 16:03:01.125894] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:01.125944] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:03:01.125984] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:03:01.126069] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:01.126176] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:03:01.126234] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:03:01.126246] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:03:01.126257] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:03:01.126295] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:03:01.126355] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:03:01.126376] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:03:01.164352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:01.164394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:01.164400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:01.164408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:01.213956] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:01.213998] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46534 [2024-09-11 16:03:01.215873] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:01.254586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:01.278986] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041781278982, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:03:01.285757] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726041781285751, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:03:01.364660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:01.364704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:01.364712] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:01.364721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:01.412634] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46534, magic:0x78563412 [2024-09-11 16:03:01.412667] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:01.412688] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:01.454715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:01.565013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:01.565059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:01.565067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:01.565077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:01.654828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:01.765394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:01.765438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:01.765444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:01.765452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:01.816014] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:01.816056] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46542 [2024-09-11 16:03:01.840843] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:01.855237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:01.965716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:01.965760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:01.965767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:01.965777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:02.013088] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46542, magic:0x78563412 [2024-09-11 16:03:02.013136] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:02.013145] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:02.055354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:02.166033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:02.166083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:02.166089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:02.166097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:02.216004] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:02.255506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:02.286533] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041782286530, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:03:02.293369] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041782293366, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:03:02.366347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:02.366390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:02.366398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:02.366407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:02.373812] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7392, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:03:02.414238] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:02.414273] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46550 [2024-09-11 16:03:02.455620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:02.574064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:02.574106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:02.574113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:02.574140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:02.612398] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46550, magic:0x78563412 [2024-09-11 16:03:02.612441] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:02.612448] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:02.655737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:02.774362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:02.774407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:02.774414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:02.774423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:02.841682] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:02.859564] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3713, replace_start_pos=12100000, replace_num=100000) [2024-09-11 16:03:02.859611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:02.974632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:02.974670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:02.974676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:02.974683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:03.014626] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:03.014672] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46564 [2024-09-11 16:03:03.059696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:03.174967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:03.175012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:03.175021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:03.175030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:03.213081] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46564, magic:0x78563412 [2024-09-11 16:03:03.213121] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:03.213128] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:03.216201] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:03.259822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:03.294244] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041783294238, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007708, add_bytes: 0 [2024-09-11 16:03:03.300984] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041783300980, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:03:03.375271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:03.375307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:03.375313] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:03.375321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:03.459956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:03.575569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:03.575620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:03.575626] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:03.575634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:03.615366] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:03.615415] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46580 [2024-09-11 16:03:03.660089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:03.775857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:03.775897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:03.775922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:03.775929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:03.813459] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46580, magic:0x78563412 [2024-09-11 16:03:03.813492] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:03.813499] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:03.842630] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:03.860210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:03.976165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:03.976208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:03.976214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:03.976222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:04.060348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:04.176508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:04.176553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:04.176560] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:04.176568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:04.215327] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:04.215369] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46586 [2024-09-11 16:03:04.216307] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:04.260483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:04.301853] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041784301848, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:03:04.308608] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041784308603, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:03:04.376793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:04.376838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:04.376844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:04.376851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:04.384230] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7367, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:03:04.413853] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46586, magic:0x78563412 [2024-09-11 16:03:04.413885] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:04.413891] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:04.460633] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:04.584499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:04.584538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:04.584544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:04.584552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:04.660751] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:04.784790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:04.784823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:04.784841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:04.784849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:04.814564] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:04.814597] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46588 [2024-09-11 16:03:04.843641] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:04.860893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:04.985186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:04.985228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:04.985235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:04.985244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:05.013161] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46588, magic:0x78563412 [2024-09-11 16:03:05.013207] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:05.013214] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:05.065493] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4396, replace_start_pos=12200000, replace_num=100000) [2024-09-11 16:03:05.065541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:05.185487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:05.185534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:05.185542] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:05.185551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:05.216533] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:05.265622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:05.309480] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041785309476, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:03:05.316216] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041785316212, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:03:05.385850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:05.385898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:05.385932] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:05.385942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:05.415692] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:05.415738] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46592 [2024-09-11 16:03:05.465745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:05.586259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:05.586305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:05.586314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:05.586323] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:05.613937] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46592, magic:0x78563412 [2024-09-11 16:03:05.613978] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:05.613986] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:05.665871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:05.786615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:05.786659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:05.786666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:05.786689] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:05.845003] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:05.866001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:05.987018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:05.987071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:05.987101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:05.987110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:06.015635] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:06.015676] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18754 [2024-09-11 16:03:06.066142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:06.187350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:06.187398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:06.187405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:06.187414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:06.214143] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18754, magic:0x78563412 [2024-09-11 16:03:06.214189] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:06.214196] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:06.216684] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:06.266262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:06.317085] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041786317081, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:03:06.323760] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726041786323757, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:03:06.387642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:06.387685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:06.387692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:06.387715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:06.394826] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7099, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:03:06.466383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:06.595078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:06.595118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:06.595124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:06.595132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:06.616435] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:06.616475] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18768 [2024-09-11 16:03:06.666502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:06.795371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:06.795412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:06.795419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:06.795426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:06.813544] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18768, magic:0x78563412 [2024-09-11 16:03:06.813586] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:06.813595] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:06.846256] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:06.866614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:06.995685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:06.995734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:06.995741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:06.995750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:07.066790] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:07.196078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:07.196123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:07.196132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:07.196141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:07.215981] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:07.216027] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18778 [2024-09-11 16:03:07.216870] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:07.270697] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3771, replace_start_pos=12300000, replace_num=100000) [2024-09-11 16:03:07.270743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:07.324639] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041787324636, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:03:07.331450] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041787331446, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:03:07.396375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:07.396419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:07.396425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:07.396433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:07.413183] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18778, magic:0x78563412 [2024-09-11 16:03:07.413236] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:07.413242] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:07.470826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:07.596726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:07.596769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:07.596775] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:07.596784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:07.671016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:07.797226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:07.797272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:07.797280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:07.797289] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:07.814144] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:07.814184] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18780 [2024-09-11 16:03:07.847396] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:07.871201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:07.997503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:07.997547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:07.997553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:07.997561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:08.012555] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18780, magic:0x78563412 [2024-09-11 16:03:08.012594] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:08.012600] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:08.071339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:08.197797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:08.197843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:08.197851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:08.197860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:08.217018] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:08.271566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:08.332237] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041788332234, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:03:08.339073] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041788339070, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:03:08.398095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:08.398139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:08.398147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:08.398156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:08.406017] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7846, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:03:08.414243] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:08.414277] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18784 [2024-09-11 16:03:08.471702] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:08.606275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:08.606317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:08.606340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:08.606349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:08.612802] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18784, magic:0x78563412 [2024-09-11 16:03:08.612839] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:08.612847] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:08.671838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:08.806592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:08.806637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:08.806644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:08.806653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:08.848541] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=102] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:08.872038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:09.006873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:09.006934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:09.006941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:09.006950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:09.015285] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:09.015320] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18786 [2024-09-11 16:03:09.072249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:09.207167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:09.207209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:09.207215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:09.207223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:09.213562] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18786, magic:0x78563412 [2024-09-11 16:03:09.213599] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:09.213605] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:09.217231] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:09.272439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:09.339857] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041789339853, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:03:09.346680] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041789346677, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:03:09.407546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:09.407594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:09.407603] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:09.407618] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:09.476952] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4371, replace_start_pos=12400000, replace_num=100000) [2024-09-11 16:03:09.477003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:09.607875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:09.607950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:09.607959] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:09.607969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:09.615803] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:09.615863] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18800 [2024-09-11 16:03:09.677087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:09.808190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:09.808235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:09.808242] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:09.808250] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:09.813957] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18800, magic:0x78563412 [2024-09-11 16:03:09.814000] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:09.814006] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:09.849326] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:09.877264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:10.008491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:10.008536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:10.008544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:10.008553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:10.077518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:10.208793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:10.208837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:10.208845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:10.208854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:10.215495] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:10.215537] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18810 [2024-09-11 16:03:10.217398] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:10.277744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:10.347468] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041790347464, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:03:10.354229] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041790354225, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:03:10.409149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:10.409195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:10.409203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:10.409212] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:10.414085] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18810, magic:0x78563412 [2024-09-11 16:03:10.414130] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:10.414139] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:10.418008] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8779, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:03:10.477891] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:10.618298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:10.618340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:10.618349] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:10.618358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:10.678046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:10.814898] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:10.814973] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=69] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18812 [2024-09-11 16:03:10.818594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:10.818629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:10.818635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:10.818642] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:10.850454] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:10.878248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:11.013649] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18812, magic:0x78563412 [2024-09-11 16:03:11.013699] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:11.013713] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:11.018893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:11.018957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:11.018964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:11.018972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:11.078440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:11.140712] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:11.140760] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:11.140843] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=81, max_check_version=82, global_version=83) [2024-09-11 16:03:11.142856] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2012 [2024-09-11 16:03:11.142920] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:11.142958] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:03:11.143001] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:03:11.143085] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:11.143192] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:03:11.143246] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:03:11.143258] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:03:11.143269] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:03:11.143305] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:03:11.143365] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:03:11.143392] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:03:11.217619] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=84] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:11.219211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:11.219239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:11.219246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:11.219256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:11.278568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:11.355083] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041791355080, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:03:11.361930] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041791361927, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007702, add_bytes: 0 [2024-09-11 16:03:11.414641] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:11.414701] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18828 [2024-09-11 16:03:11.419496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:11.419529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:11.419536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:11.419545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:11.478766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:11.613072] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18828, magic:0x78563412 [2024-09-11 16:03:11.613113] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:11.613119] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:11.619817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:11.619849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:11.619855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:11.619862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:11.681775] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=2764, replace_start_pos=12500000, replace_num=100000) [2024-09-11 16:03:11.681819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:11.820179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:11.820228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:11.820235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:11.820245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:11.851525] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:11.881913] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:12.014994] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:12.015066] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=65] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18830 [2024-09-11 16:03:12.020491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:12.020537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:12.020544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:12.020553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:12.082094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:12.213481] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18830, magic:0x78563412 [2024-09-11 16:03:12.213523] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:12.213529] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:12.217799] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:12.220804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:12.220839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:12.220846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:12.220854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:12.282217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:12.362760] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041792362756, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:03:12.369545] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041792369541, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:03:12.421106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:12.421152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:12.421159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:12.421168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:12.429377] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8194, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:03:12.482352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:12.615847] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:12.615896] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18836 [2024-09-11 16:03:12.629648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:12.629691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:12.629699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:12.629726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:12.629982] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=95, refresh_score_time=78, wash_time=0) [2024-09-11 16:03:12.682553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:12.814294] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18836, magic:0x78563412 [2024-09-11 16:03:12.814329] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:12.814337] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:12.830356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:12.830404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:12.830412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:12.830422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:12.852697] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:12.882693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:13.030655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:13.030714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:13.030723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:13.030732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:13.082816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:13.216666] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:13.216709] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18846 [2024-09-11 16:03:13.218002] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:13.231020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:13.231058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:13.231066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:13.231089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:13.282936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:13.370378] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041793370374, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:03:13.377138] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041793377134, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:03:13.413726] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18846, magic:0x78563412 [2024-09-11 16:03:13.413768] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:13.413775] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:13.431335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:13.431382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:13.431390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:13.431399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:13.483118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:13.631668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:13.631714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:13.631722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:13.631731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:13.683254] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:13.816005] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:13.816060] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18854 [2024-09-11 16:03:13.832011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:13.832060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:13.832068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:13.832077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:13.853800] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:13.886712] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3336, replace_start_pos=0, replace_num=100000) [2024-09-11 16:03:13.886764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:14.014318] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18854, magic:0x78563412 [2024-09-11 16:03:14.014363] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:14.014371] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:14.032400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:14.032456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:14.032467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:14.032480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:14.086859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:14.218108] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:14.232804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:14.232843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:14.232849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:14.232857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:14.286991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:14.378000] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041794377994, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:03:14.384756] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041794384753, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:03:14.416753] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:14.416792] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18856 [2024-09-11 16:03:14.433105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:14.433148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:14.433156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:14.433165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:14.441757] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8578, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:03:14.487125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:14.614943] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18856, magic:0x78563412 [2024-09-11 16:03:14.614984] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:14.614993] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:14.642040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:14.642079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:14.642086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:14.642095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:14.687318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:14.842446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:14.842510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:14.842519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:14.842527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:14.854793] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:14.887501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:15.017194] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:15.017242] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:18864 [2024-09-11 16:03:15.042764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:15.042801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:15.042807] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:15.042815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:15.087649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:15.215455] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:18864, magic:0x78563412 [2024-09-11 16:03:15.215487] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:15.215493] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:15.218229] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:15.243057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:15.243099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:15.243105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:15.243112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:15.287837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:15.385615] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726041795385611, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:03:15.392306] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041795392302, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:03:15.443348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:15.443392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:15.443400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:15.443408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:15.488024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:15.617685] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:15.617722] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23692 [2024-09-11 16:03:15.643637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:15.643682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:15.643689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:15.643696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:15.688154] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:15.815997] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23692, magic:0x78563412 [2024-09-11 16:03:15.816037] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:15.816043] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:15.843950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:15.843995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:15.844003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:15.844012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:15.855937] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:15.888375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:16.044259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:16.044312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:16.044319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:16.044344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:16.092001] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3486, replace_start_pos=100000, replace_num=100000) [2024-09-11 16:03:16.092054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:16.218227] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:16.218287] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23706 [2024-09-11 16:03:16.218366] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:16.244556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:16.244596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:16.244602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:16.244609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:16.292145] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:16.393253] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041796393249, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 16:03:16.399934] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726041796399930, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:03:16.416454] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23706, magic:0x78563412 [2024-09-11 16:03:16.416483] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:16.416489] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:16.444924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:16.444971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:16.445005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:16.445015] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:16.453596] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8567, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:03:16.492341] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:16.653854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:16.653934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:16.653943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:16.653951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:16.692469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:16.818771] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:16.818811] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23718 [2024-09-11 16:03:16.854198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:16.854240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:16.854247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:16.854257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:16.856862] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:16.892591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:17.017028] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23718, magic:0x78563412 [2024-09-11 16:03:17.017070] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:17.017077] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:17.054487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:17.054532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:17.054540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:17.054565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:17.092735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:17.218465] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:17.254779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:17.254816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:17.254823] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:17.254830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:17.292937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:17.400791] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041797400786, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:03:17.407607] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041797407602, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:03:17.418931] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:17.418976] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23724 [2024-09-11 16:03:17.455066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:17.455113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:17.455120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:17.455129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:17.493084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:17.617192] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23724, magic:0x78563412 [2024-09-11 16:03:17.617258] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:17.617269] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:17.655368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:17.655424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:17.655431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:17.655441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:17.693309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:17.855687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:17.855737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:17.855743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:17.855751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:17.857662] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:17.893441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:18.018939] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:18.018980] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23730 [2024-09-11 16:03:18.056018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:18.056085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:18.056095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:18.056105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:18.093568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:18.217629] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23730, magic:0x78563412 [2024-09-11 16:03:18.217671] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:18.217679] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:18.218577] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:18.256426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:18.256473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:18.256493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:18.256507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:18.298148] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4390, replace_start_pos=200000, replace_num=100000) [2024-09-11 16:03:18.298198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:18.408393] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041798408389, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:03:18.415223] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041798415220, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:03:18.456762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:18.456831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:18.456842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:18.456851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:18.465367] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8501, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:03:18.498307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:18.619506] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:18.619552] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23734 [2024-09-11 16:03:18.665705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:18.665768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:18.665777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:18.665788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:18.698503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:18.817957] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23734, magic:0x78563412 [2024-09-11 16:03:18.817996] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:18.818003] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:18.858478] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:18.866057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:18.866099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:18.866106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:18.866115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:18.898698] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:19.066432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:19.066476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:19.066482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:19.066490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:19.098841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:19.218687] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:19.220109] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:19.220144] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23736 [2024-09-11 16:03:19.266730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:19.266775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:19.266783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:19.266808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:19.298966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:19.416008] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041799416004, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:03:19.418578] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23736, magic:0x78563412 [2024-09-11 16:03:19.418612] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:19.418618] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:19.422774] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041799422771, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:03:19.467053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:19.467095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:19.467101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:19.467108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:19.499152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:19.667357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:19.667404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:19.667412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:19.667421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:19.699286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:19.820029] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:19.820069] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23748 [2024-09-11 16:03:19.859212] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:19.867653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:19.867686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:19.867693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:19.867716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:19.899488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:20.018766] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23748, magic:0x78563412 [2024-09-11 16:03:20.018808] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:20.018815] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:20.067996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:20.068043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:20.068050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:20.068059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:20.099616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:20.218800] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:20.268287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:20.268327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:20.268334] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:20.268342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:20.299739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:20.420713] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:20.420755] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23750 [2024-09-11 16:03:20.423631] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041800423629, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:03:20.430383] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041800430380, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:03:20.468581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:20.468624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:20.468630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:20.468638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:20.475796] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7144, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:03:20.504199] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4333, replace_start_pos=300000, replace_num=100000) [2024-09-11 16:03:20.504246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:20.619404] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23750, magic:0x78563412 [2024-09-11 16:03:20.619438] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:20.619444] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:20.676058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:20.676104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:20.676111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:20.676120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:20.704404] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:20.860004] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:20.876445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:20.876489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:20.876497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:20.876507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:20.904626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=79] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:21.021582] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:21.021638] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23754 [2024-09-11 16:03:21.076848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:21.076900] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:21.076930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:21.076940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:21.104762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:21.155645] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:21.155699] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:21.155785] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=82, max_check_version=83, global_version=84) [2024-09-11 16:03:21.157804] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2019 [2024-09-11 16:03:21.157843] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:21.157879] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:03:21.157949] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:03:21.158036] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:21.158144] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,677,680 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 190,528 used= 178,448 count= 22 avg_used= 8,111 block_cnt= 22 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,677,680 used= 76,264,220 count= 1,549 avg_used= 49,234 mod=SUMMARY [2024-09-11 16:03:21.158199] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:03:21.158214] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:03:21.158226] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:03:21.158263] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:03:21.158323] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:03:21.158344] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:03:21.218943] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:21.219889] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23754, magic:0x78563412 [2024-09-11 16:03:21.219960] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=66] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:21.219969] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:21.277235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:21.277277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:21.277285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:21.277296] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:21.304921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:21.431253] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726041801431249, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:03:21.438024] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041801438019, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 16:03:21.477527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:21.477578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:21.477586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:21.477596] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:21.505123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:21.621950] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:21.621996] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23760 [2024-09-11 16:03:21.677804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:21.677844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:21.677867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:21.677874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:21.705252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:21.820372] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23760, magic:0x78563412 [2024-09-11 16:03:21.820414] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:21.820422] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:21.860763] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:21.878107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:21.878148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:21.878154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:21.878167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:21.905438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:22.078449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:22.078496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:22.078504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:22.078513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:22.105570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:22.219052] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:22.221812] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:22.221844] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23776 [2024-09-11 16:03:22.278761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:22.278810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:22.278817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:22.278825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:22.305694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:22.420606] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23776, magic:0x78563412 [2024-09-11 16:03:22.420649] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:22.420654] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:22.438936] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041802438931, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:03:22.445620] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041802445615, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:03:22.479071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:22.479110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:22.479117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:22.479124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:22.485787] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6651, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:03:22.505934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:22.686153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:22.686200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:22.686207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:22.686216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:22.710223] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4160, replace_start_pos=400000, replace_num=100000) [2024-09-11 16:03:22.710288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:22.823173] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:22.823218] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23780 [2024-09-11 16:03:22.861511] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:22.886456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:22.886516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:22.886524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:22.886534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:22.910377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:23.021308] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23780, magic:0x78563412 [2024-09-11 16:03:23.021350] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:23.021358] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:23.086753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:23.086795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:23.086801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:23.086808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:23.110561] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:23.219175] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:23.287067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:23.287109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:23.287116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:23.287124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:23.310703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:23.423457] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:23.423502] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23786 [2024-09-11 16:03:23.446470] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041803446465, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 16:03:23.453240] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041803453236, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:03:23.487348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:23.487391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:23.487398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:23.487406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:23.510898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:23.621670] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23786, magic:0x78563412 [2024-09-11 16:03:23.621710] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:23.621715] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:23.687701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:23.687739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:23.687746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:23.687754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:23.711051] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:23.862253] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:23.888037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:23.888079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:23.888087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:23.888096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:23.911230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:24.023813] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:24.023856] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23800 [2024-09-11 16:03:24.088344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:24.088388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:24.088396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:24.088406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:24.111366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:24.219290] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:24.222129] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23800, magic:0x78563412 [2024-09-11 16:03:24.222164] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:24.222171] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:24.288702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:24.288746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:24.288754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:24.288764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:24.311492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:24.454088] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041804454083, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:03:24.460847] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041804460846, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:03:24.489039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:24.489097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:24.489106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:24.489115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:24.497295] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8167, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:03:24.511723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:24.622732] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:24.622776] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23816 [2024-09-11 16:03:24.697588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:24.697631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:24.697637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:24.697645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:24.697945] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:03:24.711931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:24.821323] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23816, magic:0x78563412 [2024-09-11 16:03:24.821363] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:24.821370] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:24.863001] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:24.898189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:24.898225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:24.898231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:24.898239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:24.916507] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4396, replace_start_pos=500000, replace_num=100000) [2024-09-11 16:03:24.916565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:25.098475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:25.098520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:25.098528] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:25.098536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:25.116715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:25.219418] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:25.223691] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:25.223718] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:23830 [2024-09-11 16:03:25.298796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:25.298845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:25.298853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:25.298862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:25.316847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:25.421965] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:23830, magic:0x78563412 [2024-09-11 16:03:25.422006] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:25.422012] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:25.461703] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041805461698, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:03:25.468462] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726041805468461, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:03:25.499121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:25.499162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:25.499170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:25.499180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:25.516973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:25.699471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:25.699520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:25.699530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:25.699545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:25.717162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:25.823788] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:25.823827] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45448 [2024-09-11 16:03:25.863877] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:25.899793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:25.899842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:25.899849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:25.899858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:25.917346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:26.022380] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45448, magic:0x78563412 [2024-09-11 16:03:26.022422] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:26.022429] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:26.100163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:26.100208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:26.100231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:26.100240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:26.117468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:26.219559] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:26.300601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:26.300667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:26.300676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:26.300685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:26.317576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:26.424694] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:26.424737] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45452 [2024-09-11 16:03:26.469320] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726041806469315, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:03:26.476086] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726041806476083, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:03:26.501072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:26.501116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:26.501124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:26.501134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:26.508616] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7469, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:03:26.517686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:26.623048] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45452, magic:0x78563412 [2024-09-11 16:03:26.623091] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:26.623098] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:26.708991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:26.709054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:26.709065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:26.709079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:26.717800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:26.865022] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=113] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:26.909409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:26.909451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:26.909459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:26.909468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:26.917921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:27.023540] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:27.023582] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45462 [2024-09-11 16:03:27.109774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:27.109823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:27.109831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:27.109841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:27.122426] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4396, replace_start_pos=600000, replace_num=100000) [2024-09-11 16:03:27.122493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:27.219660] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:27.221176] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45462, magic:0x78563412 [2024-09-11 16:03:27.221202] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:27.221211] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:27.310075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:27.310119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:27.310126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:27.310136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:27.322575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:27.476933] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041807476930, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:03:27.483693] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041807483692, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:03:27.510383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:27.510420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:27.510429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:27.510438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:27.522684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:27.623556] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:27.623586] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45464 [2024-09-11 16:03:27.710785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:27.710830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:27.710836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:27.710844] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:27.722787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:27.821741] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45464, magic:0x78563412 [2024-09-11 16:03:27.821774] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:27.821780] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:27.865914] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:27.911150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:27.911198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:27.911206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:27.911215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:27.922887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:28.111452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:28.111498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:28.111505] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:28.111514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:28.123004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:28.219834] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:28.223656] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:28.223687] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45478 [2024-09-11 16:03:28.311727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:28.311785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:28.311791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:28.311798] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:28.323117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:28.422124] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45478, magic:0x78563412 [2024-09-11 16:03:28.422166] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:28.422174] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:28.484552] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726041808484547, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:03:28.491379] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726041808491375, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:03:28.512098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:28.512144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:28.512153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:28.512163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:28.520424] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8248, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:03:28.523229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:28.720743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:28.720784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:28.720790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:28.720816] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:28.723331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:28.823817] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:28.823862] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45490 [2024-09-11 16:03:28.866865] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:28.921172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:28.921216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:28.921223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:28.921231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:28.923435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:29.022551] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45490, magic:0x78563412 [2024-09-11 16:03:29.022593] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:29.022600] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:29.121531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:29.121578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:29.121586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:29.121596] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:29.123536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:29.220028] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:29.321805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:29.321845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:29.321851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:29.321859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:29.326972] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3337, replace_start_pos=700000, replace_num=100000) [2024-09-11 16:03:29.327018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:29.424085] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:29.424122] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45494 [2024-09-11 16:03:29.492188] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041809492183, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:03:29.498934] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041809498930, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:03:29.522091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:29.522134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:29.522141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:29.522148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:29.527098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:29.622253] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45494, magic:0x78563412 [2024-09-11 16:03:29.622289] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:29.622297] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:29.722384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:29.722426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:29.722433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:29.722443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:29.727201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:29.867735] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=93] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:29.922760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:29.922801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:29.922809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:29.922834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:29.927308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:30.024112] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:30.024151] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45504 [2024-09-11 16:03:30.123088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:30.123129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:30.123137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:30.123145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:30.127417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:30.220212] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:30.222594] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45504, magic:0x78563412 [2024-09-11 16:03:30.222619] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:30.222626] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:30.323440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:30.323486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:30.323494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:30.323505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:30.327526] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:30.499851] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041810499846, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:03:30.506552] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041810506547, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:03:30.523745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:30.523793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:30.523802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:30.523812] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:30.527651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:30.530831] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7006, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:03:30.623408] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:30.623448] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45506 [2024-09-11 16:03:30.727757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:30.731064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:30.731101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:30.731107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:30.731115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:30.822082] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45506, magic:0x78563412 [2024-09-11 16:03:30.822124] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:30.822131] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:30.868445] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:30.927864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:30.931343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:30.931378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:30.931386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:30.931396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:31.127990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:31.131648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:31.131686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:31.131693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:31.131703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:31.173296] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:31.173349] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:31.173429] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=83, max_check_version=84, global_version=85) [2024-09-11 16:03:31.175465] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2035 [2024-09-11 16:03:31.175506] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:31.175542] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:03:31.175597] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:03:31.175681] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:31.175789] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:03:31.175841] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:03:31.175860] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:03:31.175872] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:03:31.175924] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:03:31.176000] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:03:31.176023] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:03:31.220425] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:31.224385] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:31.224421] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45512 [2024-09-11 16:03:31.328111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:31.332034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:31.332068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:31.332076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:31.332085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:31.422751] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45512, magic:0x78563412 [2024-09-11 16:03:31.422789] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:31.422797] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:31.507409] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041811507405, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:03:31.514182] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=157] PNIO [ratelimit] time: 1726041811514177, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:03:31.532296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:31.532336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:31.532343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:31.532350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:31.532597] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=800000, replace_num=100000) [2024-09-11 16:03:31.532630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:31.732641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:31.732684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:31.732693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:31.732718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:31.732712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:31.823616] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:31.823661] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45514 [2024-09-11 16:03:31.869281] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:31.932863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:31.932962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:31.932991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:31.932998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:31.933005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:32.022162] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45514, magic:0x78563412 [2024-09-11 16:03:32.022201] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:32.022208] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:32.133024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=86] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:32.133227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:32.133257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:32.133263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:32.133271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:32.220607] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:32.333213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:32.333490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:32.333517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:32.333523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:32.333546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:32.424362] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:32.424404] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45518 [2024-09-11 16:03:32.515032] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041812515028, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:03:32.521774] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041812521770, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:03:32.533386] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:32.533746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:32.533774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:32.533780] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:32.533788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:32.540640] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6839, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:03:32.622737] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45518, magic:0x78563412 [2024-09-11 16:03:32.622774] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:32.622782] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:32.733496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:32.740935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:32.740974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:32.740982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:32.741012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:32.870218] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:32.933668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:32.941254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:32.941298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:32.941320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:32.941330] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:32.941544] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=92, refresh_score_time=63, wash_time=0) [2024-09-11 16:03:33.024874] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:33.024938] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45520 [2024-09-11 16:03:33.133862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:33.141793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:33.141838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:33.141846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:33.141856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:33.220806] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:33.223154] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45520, magic:0x78563412 [2024-09-11 16:03:33.223187] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:33.223196] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:33.334055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:33.342095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:33.342134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:33.342142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:33.342167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:33.522697] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041813522694, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:03:33.529400] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041813529396, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:03:33.534174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:33.542404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:33.542454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:33.542462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:33.542470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:33.624216] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:33.624263] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45522 [2024-09-11 16:03:33.738358] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4018, replace_start_pos=900000, replace_num=100000) [2024-09-11 16:03:33.738402] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:33.742774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:33.742810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:33.742816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:33.742823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:33.822451] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45522, magic:0x78563412 [2024-09-11 16:03:33.822486] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:33.822509] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:33.871139] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:33.938547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:33.943066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:33.943103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:33.943137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:33.943151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:34.138680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:34.143388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:34.143422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:34.143429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:34.143438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:34.220987] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:34.225126] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:34.225158] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45532 [2024-09-11 16:03:34.338864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:34.343663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:34.343699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:34.343706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:34.343715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:34.423126] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45532, magic:0x78563412 [2024-09-11 16:03:34.423159] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:34.423165] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:34.530264] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041814530260, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:03:34.537009] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041814537005, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:03:34.539074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:34.543971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:34.544006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:34.544013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:34.544022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:34.552597] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8562, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:03:34.739252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:34.752949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:34.752992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:34.753000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:34.753010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:34.823683] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:34.823723] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45546 [2024-09-11 16:03:34.871963] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:34.939439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:34.953306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:34.953350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:34.953358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:34.953367] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:35.022313] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45546, magic:0x78563412 [2024-09-11 16:03:35.022356] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:35.022379] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:35.139635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:35.153673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:35.153721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:35.153729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:35.153738] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:35.221183] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:35.339829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:35.354061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:35.354105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:35.354113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:35.354123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:35.425004] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:35.425050] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45548 [2024-09-11 16:03:35.537946] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041815537942, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:03:35.540024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:35.544716] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041815544713, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007708, add_bytes: 0 [2024-09-11 16:03:35.554369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:35.554410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:35.554436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:35.554445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:35.622842] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45548, magic:0x78563412 [2024-09-11 16:03:35.622881] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:35.622889] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:35.740200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:35.754676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:35.754722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:35.754730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:35.754740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:35.873002] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:35.944779] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4388, replace_start_pos=1000000, replace_num=100000) [2024-09-11 16:03:35.944829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:35.954995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:35.955037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:35.955044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:35.955051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:36.024733] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:36.024777] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25290 [2024-09-11 16:03:36.144991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:36.155285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:36.155331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:36.155339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:36.155366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:36.221349] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:36.223232] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25290, magic:0x78563412 [2024-09-11 16:03:36.223258] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:36.223265] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:36.345116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:36.355674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:36.355718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:36.355725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:36.355735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:36.545336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:36.545553] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041816545550, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:03:36.552249] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041816552247, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 16:03:36.556073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:36.556121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:36.556131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:36.556143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:36.564608] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8449, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:03:36.624396] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:36.624437] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25296 [2024-09-11 16:03:36.745516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:36.764976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:36.765023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:36.765030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:36.765039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:36.822711] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25296, magic:0x78563412 [2024-09-11 16:03:36.822755] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:36.822761] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:36.873876] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:36.945645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:36.965350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:36.965397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:36.965405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:36.965415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:37.145775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:37.165711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:37.165755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:37.165763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:37.165773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:37.221545] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:37.224893] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:37.224971] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=73] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25312 [2024-09-11 16:03:37.345924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:37.366077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:37.366122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:37.366131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:37.366141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:37.423142] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25312, magic:0x78563412 [2024-09-11 16:03:37.423187] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:37.423195] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:37.546110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:37.553094] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041817553091, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:03:37.559880] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041817559878, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:03:37.566452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:37.566496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:37.566504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:37.566514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:37.746317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:37.766827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:37.766890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:37.766899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:37.766928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:37.824784] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:37.824822] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25316 [2024-09-11 16:03:37.874948] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:37.946440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:37.967224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:37.967268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:37.967277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:37.967287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:38.023516] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25316, magic:0x78563412 [2024-09-11 16:03:38.023571] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:38.023577] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:38.150986] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4421, replace_start_pos=1100000, replace_num=100000) [2024-09-11 16:03:38.151037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:38.167582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:38.167622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:38.167629] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:38.167637] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:38.221729] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:38.351131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:38.367969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:38.368032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:38.368041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:38.368050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:38.424726] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:38.424771] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25326 [2024-09-11 16:03:38.551313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:38.560712] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041818560708, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:03:38.567477] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041818567474, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:03:38.568364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:38.568390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:38.568398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:38.568408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:38.576365] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7944, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:03:38.623031] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25326, magic:0x78563412 [2024-09-11 16:03:38.623072] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:38.623080] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:38.751497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:38.776692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:38.776760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:38.776769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:38.776779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:38.875718] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:38.951680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:38.977118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:38.977167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:38.977177] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:38.977187] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:39.024935] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:39.024980] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25332 [2024-09-11 16:03:39.151835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:39.177505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:39.177549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:39.177557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:39.177567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:39.221875] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:39.222472] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25332, magic:0x78563412 [2024-09-11 16:03:39.222501] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:39.222509] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:39.351978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:39.377967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:39.378011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:39.378019] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:39.378045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:39.552108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:39.568400] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041819568396, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:03:39.575157] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041819575153, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:03:39.578352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:39.578385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:39.578393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:39.578403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:39.624197] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:39.624250] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25346 [2024-09-11 16:03:39.752241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:39.778618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:39.778657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:39.778663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:39.778672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:39.822939] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25346, magic:0x78563412 [2024-09-11 16:03:39.822975] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:39.822996] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:39.876806] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:39.952367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:39.978920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:39.978964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:39.978970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:39.978993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:40.152494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:40.179212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:40.179278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:40.179287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:40.179295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:40.222012] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:40.225000] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:40.225026] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25356 [2024-09-11 16:03:40.357135] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4458, replace_start_pos=1200000, replace_num=100000) [2024-09-11 16:03:40.357183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:40.379608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:40.379655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:40.379664] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:40.379674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:40.423176] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25356, magic:0x78563412 [2024-09-11 16:03:40.423213] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:40.423219] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:40.557267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:40.576018] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041820576014, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:03:40.580000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:40.580038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:40.580046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:40.580055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:40.582708] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041820582703, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:03:40.588176] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8108, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:03:40.757395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:40.788427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:40.788473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:40.788480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:40.788489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:40.825277] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:40.825311] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25358 [2024-09-11 16:03:40.878159] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:40.957517] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:40.988812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:40.988855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:40.988862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:40.988871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:41.023757] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25358, magic:0x78563412 [2024-09-11 16:03:41.023817] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:41.023824] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:41.157647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:41.189106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:41.189153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:41.189162] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:41.189171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:41.191053] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:41.191087] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:41.191170] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=84, max_check_version=85, global_version=86) [2024-09-11 16:03:41.193204] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2033 [2024-09-11 16:03:41.193236] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:41.193273] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:03:41.193335] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:03:41.193419] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:41.193527] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:03:41.193577] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:03:41.193592] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:03:41.193603] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:03:41.193640] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:03:41.193700] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:03:41.193722] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:03:41.222215] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:41.357828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:41.389483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:41.389550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:41.389558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:41.389569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:41.425928] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:41.425971] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25364 [2024-09-11 16:03:41.558019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:41.583561] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041821583556, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:03:41.589874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:41.589931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:41.589939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:41.589949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:41.590385] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041821590383, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:03:41.624237] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25364, magic:0x78563412 [2024-09-11 16:03:41.624280] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:41.624288] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:41.758212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:41.790297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:41.790344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:41.790370] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:41.790381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:41.878922] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:41.958395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:41.990633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:41.990696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:41.990704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:41.990713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:42.026647] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:42.026691] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25376 [2024-09-11 16:03:42.158530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:42.191054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:42.191099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:42.191108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:42.191117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:42.222449] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:42.224820] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25376, magic:0x78563412 [2024-09-11 16:03:42.224855] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:42.224863] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:42.358651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:42.391357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:42.391403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:42.391410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:42.391419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:42.562916] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4080, replace_start_pos=1300000, replace_num=100000) [2024-09-11 16:03:42.562960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:42.591248] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041822591243, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:03:42.591745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:42.591777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:42.591785] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:42.591794] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:42.598009] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726041822598005, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:03:42.600337] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8529, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:03:42.626625] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:42.626662] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25384 [2024-09-11 16:03:42.763128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:42.800665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:42.800710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:42.800719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:42.800728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:42.825135] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25384, magic:0x78563412 [2024-09-11 16:03:42.825185] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:42.825193] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:42.879939] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:42.963329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:43.001079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:43.001141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:43.001149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:43.001159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:43.163458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:43.201416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:43.201461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:43.201468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:43.201477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:43.222647] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:43.227544] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:43.227583] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25388 [2024-09-11 16:03:43.363578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:43.401808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:43.401855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:43.401864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:43.401873] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:43.425598] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25388, magic:0x78563412 [2024-09-11 16:03:43.425637] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:43.425660] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:43.563706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:43.598863] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041823598859, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:03:43.602122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:43.602161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:43.602169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:43.602178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:43.605571] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041823605568, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:03:43.763829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:43.802432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:43.802482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:43.802490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:43.802500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:43.827506] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:43.827546] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25402 [2024-09-11 16:03:43.881183] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:43.963952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:44.002747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:44.002793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:44.002801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:44.002811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:44.025856] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25402, magic:0x78563412 [2024-09-11 16:03:44.025898] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:44.025949] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:44.164133] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:44.203071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:44.203118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:44.203127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:44.203136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:44.222839] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:44.364261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:44.403386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:44.403431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:44.403439] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:44.403449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:44.428008] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:44.428046] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25412 [2024-09-11 16:03:44.564489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:44.603692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:44.603735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:44.603742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:44.603752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:44.606475] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=74] PNIO [ratelimit] time: 1726041824606472, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:03:44.612256] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8473, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:03:44.613251] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041824613248, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:03:44.626511] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25412, magic:0x78563412 [2024-09-11 16:03:44.626555] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:44.626563] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:44.768870] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4191, replace_start_pos=1400000, replace_num=100000) [2024-09-11 16:03:44.768926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:44.812573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:44.812613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:44.812621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:44.812631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:44.882423] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:44.969075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:45.012879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:45.012954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:45.012966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:45.012979] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:45.028326] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:45.028371] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:25416 [2024-09-11 16:03:45.169268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:45.213326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:45.213373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:45.213404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:45.213415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:45.223003] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=86] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:45.226914] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:25416, magic:0x78563412 [2024-09-11 16:03:45.226941] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:45.226946] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:45.369392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:45.413721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:45.413768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:45.413777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:45.413786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:45.569571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:45.614039] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041825614035, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:03:45.614058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:45.614095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:45.614103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:45.614114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:45.620786] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041825620782, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 16:03:45.629043] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:45.629083] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38476 [2024-09-11 16:03:45.769694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:45.814439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:45.814487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:45.814495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:45.814505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:45.827207] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38476, magic:0x78563412 [2024-09-11 16:03:45.827247] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:45.827255] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:45.883363] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:45.969828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:46.014811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:46.014856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:46.014864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:46.014874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:46.169970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:46.215105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:46.215147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:46.215155] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:46.215164] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:46.223161] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:46.228428] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:46.228480] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38482 [2024-09-11 16:03:46.370100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:46.415504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:46.415555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:46.415569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:46.415579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:46.426818] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38482, magic:0x78563412 [2024-09-11 16:03:46.426857] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:46.426864] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:46.570287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:46.615889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:46.615958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:46.615966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:46.615976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:46.621653] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041826621649, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:03:46.624483] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8495, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:03:46.628415] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041826628411, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:03:46.770425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:46.824802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:46.824846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:46.824855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:46.824865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:46.829456] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:46.829497] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38488 [2024-09-11 16:03:46.884387] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:46.974760] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4194, replace_start_pos=1500000, replace_num=100000) [2024-09-11 16:03:46.974804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:47.025179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:47.025222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:47.025230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:47.025240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:47.027620] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38488, magic:0x78563412 [2024-09-11 16:03:47.027650] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:47.027658] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:47.174962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:47.223351] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:47.225563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:47.225594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:47.225602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:47.225612] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:47.375139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:47.425859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:47.425923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:47.425933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:47.425942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:47.429308] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:47.429334] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38492 [2024-09-11 16:03:47.575348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:47.626253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:47.626294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:47.626303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:47.626312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:47.627827] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38492, magic:0x78563412 [2024-09-11 16:03:47.627853] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:47.627859] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:47.629261] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041827629260, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:03:47.636041] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041827636039, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:03:47.775530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:47.826610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:47.826665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:47.826675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:47.826685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:47.885179] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:47.975716] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:48.026950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:48.026997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:48.027005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:48.027014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:48.029647] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:48.029673] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38504 [2024-09-11 16:03:48.175919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:48.223469] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:48.227323] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38504, magic:0x78563412 [2024-09-11 16:03:48.227357] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:48.227364] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:48.227358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:48.227403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:48.227411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:48.227420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:48.376106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:48.427657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:48.427699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:48.427706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:48.427731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:48.576314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:48.628064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:48.628108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:48.628116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:48.628127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:48.628438] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:48.628467] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38506 [2024-09-11 16:03:48.636422] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8282, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:03:48.636879] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726041828636876, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:03:48.643711] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041828643707, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:03:48.776437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:48.826673] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38506, magic:0x78563412 [2024-09-11 16:03:48.826709] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:48.826715] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:48.836798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:48.836841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:48.836849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:48.836877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:48.886226] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:48.976614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:49.037176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:49.037217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:49.037239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:49.037250] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:49.180984] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4189, replace_start_pos=1600000, replace_num=100000) [2024-09-11 16:03:49.181026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:49.223601] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:49.228493] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:49.228524] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38508 [2024-09-11 16:03:49.237486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:49.237513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:49.237520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:49.237529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:49.381170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:49.427112] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38508, magic:0x78563412 [2024-09-11 16:03:49.427146] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:49.427152] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:49.437825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:49.437868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:49.437876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:49.437935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:49.581309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:49.638338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:49.638382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:49.638389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:49.638399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:49.644574] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041829644570, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007694, add_bytes: 0 [2024-09-11 16:03:49.651323] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041829651319, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:03:49.781450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:49.829647] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:49.829693] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38516 [2024-09-11 16:03:49.838620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:49.838652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:49.838658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:49.838665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:49.887381] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:49.981588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:50.027861] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38516, magic:0x78563412 [2024-09-11 16:03:50.027920] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:50.027928] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:50.038897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:50.038960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:50.038966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:50.038995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:50.181781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:50.223790] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:50.239295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:50.239342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:50.239350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:50.239360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:50.381914] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:50.429957] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:50.429993] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38526 [2024-09-11 16:03:50.439591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:50.439636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:50.439647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:50.439661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:50.582029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:50.628318] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38526, magic:0x78563412 [2024-09-11 16:03:50.628354] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:50.628362] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:50.639894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:50.639945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:50.639951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:50.639960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:50.648481] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8507, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:03:50.652117] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041830652114, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:03:50.658953] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041830658948, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:03:50.782141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:50.848756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:50.848800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:50.848808] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:50.848818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:50.888273] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:50.982268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:51.030183] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:51.030228] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38534 [2024-09-11 16:03:51.049143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:51.049191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:51.049199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:51.049209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:51.182487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:51.208662] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:51.208717] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:03:51.208810] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] update_check_range(min_check_version=85, max_check_version=86, global_version=87) [2024-09-11 16:03:51.210882] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2071 [2024-09-11 16:03:51.210944] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:51.210986] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:03:51.211023] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:03:51.211109] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:03:51.211233] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:03:51.211285] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:03:51.211296] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:03:51.211307] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:03:51.211347] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:03:51.211424] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:03:51.211447] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:03:51.224006] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:51.228630] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38534, magic:0x78563412 [2024-09-11 16:03:51.228667] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:51.228675] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:51.249517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:51.249565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:51.249573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:51.249583] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:51.387059] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4374, replace_start_pos=1700000, replace_num=100000) [2024-09-11 16:03:51.387112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:51.449821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:51.449898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:51.449935] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:51.449966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:51.587268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:51.631162] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:51.631206] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38548 [2024-09-11 16:03:51.650215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:51.650262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:51.650269] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:51.650279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:51.659727] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041831659723, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:03:51.666485] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041831666480, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007532, add_bytes: 0 [2024-09-11 16:03:51.787452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:51.829309] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38548, magic:0x78563412 [2024-09-11 16:03:51.829358] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:51.829365] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:51.850600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:51.850645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:51.850671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:51.850682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:51.889660] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:51.987639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:52.051016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:52.051080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:52.051088] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:52.051098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:52.187755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:52.224122] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:52.231192] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:52.231239] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38552 [2024-09-11 16:03:52.251329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:52.251371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:52.251379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:52.251388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:52.387874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:52.429545] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38552, magic:0x78563412 [2024-09-11 16:03:52.429591] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:52.429599] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:52.451637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:52.451685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:52.451694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:52.451703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:52.588070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:52.652042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:52.652087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:52.652095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:52.652105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:52.660609] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8490, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:03:52.667360] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041832667357, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:03:52.674101] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041832674098, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:03:52.788206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:52.831330] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:52.831371] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38566 [2024-09-11 16:03:52.860957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:52.861003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:52.861011] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:52.861020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:52.890504] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:52.988322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:53.029831] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38566, magic:0x78563412 [2024-09-11 16:03:53.029870] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:53.029877] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:53.061258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:53.061305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:53.061312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:53.061338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:53.188433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:53.224244] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:53.261566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:53.261601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:53.261607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:53.261615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:53.261827] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=64, refresh_score_time=62, wash_time=0) [2024-09-11 16:03:53.388538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:53.432265] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:53.432303] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38570 [2024-09-11 16:03:53.462065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:53.462105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:53.462111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:53.462119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:53.592506] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3862, replace_start_pos=1800000, replace_num=100000) [2024-09-11 16:03:53.592547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:53.629280] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38570, magic:0x78563412 [2024-09-11 16:03:53.629323] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:53.629331] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:53.662455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:53.662502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:53.662511] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:53.662520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:53.674966] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041833674961, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:03:53.681742] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041833681737, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 16:03:53.792643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:53.862754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:53.862798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:53.862806] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:53.862815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:53.891347] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:53.992762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:54.031404] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:54.031441] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38586 [2024-09-11 16:03:54.063065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:54.063110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:54.063116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:54.063126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:54.192877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:54.224334] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=20] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:54.230059] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38586, magic:0x78563412 [2024-09-11 16:03:54.230094] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:54.230102] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:54.263355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:54.263398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:54.263405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:54.263413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:54.393014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:54.463647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:54.463691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:54.463707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:54.463721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:54.593151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:54.631878] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:54.631947] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=64] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38588 [2024-09-11 16:03:54.663967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:54.664001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:54.664009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:54.664035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:54.672522] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8473, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:03:54.682645] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041834682640, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:03:54.689392] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726041834689387, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007650, add_bytes: 0 [2024-09-11 16:03:54.793268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:54.830394] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38588, magic:0x78563412 [2024-09-11 16:03:54.830430] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:54.830437] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:54.872778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:54.872823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:54.872831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:54.872840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:54.873043] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:03:54.892183] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:54.993448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:55.073286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:55.073337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:55.073345] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:55.073355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:55.193631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:55.224531] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:55.232133] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:55.232170] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:38598 [2024-09-11 16:03:55.273657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:55.273706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:55.273714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:55.273724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:55.393869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:55.430774] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:38598, magic:0x78563412 [2024-09-11 16:03:55.430813] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:55.430820] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:55.473996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:55.474039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:55.474047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:55.474056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:55.594085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:55.674383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:55.674427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:55.674435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:55.674445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:55.690185] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041835690181, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:03:55.696947] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041835696945, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:03:55.798270] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4068, replace_start_pos=1900000, replace_num=100000) [2024-09-11 16:03:55.798318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:55.832761] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:55.832842] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=76] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44896 [2024-09-11 16:03:55.874762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:55.874806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:55.874814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:55.874823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:55.893141] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:55.998475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:56.031406] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44896, magic:0x78563412 [2024-09-11 16:03:56.031447] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:56.031454] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:56.075142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:56.075188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:56.075197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:56.075206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:56.198672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:56.224736] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:56.275446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:56.275491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:56.275499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:56.275526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:56.398866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:56.433415] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:56.433464] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44902 [2024-09-11 16:03:56.475826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:56.475884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:56.475893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:56.475921] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:56.599093] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:56.631836] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44902, magic:0x78563412 [2024-09-11 16:03:56.631877] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:56.631885] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:56.676154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:56.676191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:56.676199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:56.676207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:56.684831] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8609, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:03:56.697809] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041836697806, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:03:56.704634] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041836704631, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:03:56.799224] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:56.885106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:56.885147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:56.885154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:56.885163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:56.894096] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:56.999415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:57.034208] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:57.034250] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44910 [2024-09-11 16:03:57.085465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:57.085512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:57.085520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:57.085531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:57.199543] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:57.224936] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:57.232610] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44910, magic:0x78563412 [2024-09-11 16:03:57.232650] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:57.232658] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:57.285833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:57.285877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:57.285886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:57.285896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:57.399710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:57.486179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:57.486225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:57.486232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:57.486242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:57.599833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:57.634741] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:57.634779] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44918 [2024-09-11 16:03:57.686472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:57.686514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:57.686520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:57.686529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:57.705425] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726041837705422, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:03:57.712187] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041837712183, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:03:57.800014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:03:57.832059] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44918, magic:0x78563412 [2024-09-11 16:03:57.832106] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:57.832114] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:57.886750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:57.886791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:57.886797] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:57.886806] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:57.895080] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:58.003575] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3339, replace_start_pos=2000000, replace_num=100000) [2024-09-11 16:03:58.003620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:03:58.087034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:58.087070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:58.087077] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:58.087085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:58.203797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:03:58.225051] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:58.232928] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:58.232964] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44928 [2024-09-11 16:03:58.287323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:58.287365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:58.287371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:58.287380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:58.403941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:03:58.431278] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44928, magic:0x78563412 [2024-09-11 16:03:58.431317] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:58.431323] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:58.487600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:58.487641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:58.487648] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:58.487657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:58.604127] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:03:58.687879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:58.687935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:58.687946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:58.687955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:58.694969] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7002, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:03:58.713039] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041838713035, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:03:58.719861] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041838719857, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:03:58.804312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:03:58.833371] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:58.833416] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44942 [2024-09-11 16:03:58.895227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:58.895268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:58.895275] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:58.895283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:58.896011] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:03:59.004515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:03:59.031849] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44942, magic:0x78563412 [2024-09-11 16:03:59.031899] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:59.031963] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=63][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:59.095532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:59.095574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:59.095582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:59.095591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:59.204712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:03:59.225176] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:03:59.295824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:59.295862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:59.295869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:59.295878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:59.404920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:03:59.433086] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:03:59.433131] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44954 [2024-09-11 16:03:59.496110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:59.496156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:59.496163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:59.496172] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:59.605112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:03:59.631184] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44954, magic:0x78563412 [2024-09-11 16:03:59.631226] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:03:59.631235] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:03:59.696450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:59.696493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:59.696501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:59.696510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:59.720650] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041839720646, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:03:59.727531] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726041839727527, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:03:59.805236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:03:59.896752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:03:59.896795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:03:59.896804] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:03:59.896813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:03:59.897286] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:00.005366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:00.032225] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:00.032271] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44962 [2024-09-11 16:04:00.097118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:00.097162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:00.097170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:00.097180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:00.209826] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=2100000, replace_num=100000) [2024-09-11 16:04:00.209913] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=85] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:00.225291] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:00.230647] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44962, magic:0x78563412 [2024-09-11 16:04:00.230677] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:00.230683] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:00.297492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:00.297541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:00.297550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:00.297559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:00.410092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:00.497787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:00.497832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:00.497839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:00.497848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:00.610229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:00.633214] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:00.633254] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44976 [2024-09-11 16:04:00.698083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:00.698142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:00.698151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:00.698160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:00.706690] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8517, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:04:00.722414] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:04:00.728288] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041840728285, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 16:04:00.728322] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:04:00.732700] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:04:00.735042] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041840735040, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007513, add_bytes: 0 [2024-09-11 16:04:00.735074] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:04:00.810431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:00.831181] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44976, magic:0x78563412 [2024-09-11 16:04:00.831222] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:00.831230] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:00.898330] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:00.907055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:00.907102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:00.907110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:00.907120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:01.010622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:01.107446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:01.107494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:01.107503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:01.107532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:01.210818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:01.224530] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:01.224582] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:01.224665] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=86, max_check_version=87, global_version=88) [2024-09-11 16:04:01.225504] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:01.226707] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2042 [2024-09-11 16:04:01.226741] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:01.226777] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:04:01.226815] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:04:01.226931] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:01.227040] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,685,568 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 198,416 used= 186,136 count= 23 avg_used= 8,092 block_cnt= 23 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,685,568 used= 76,271,908 count= 1,550 avg_used= 49,207 mod=SUMMARY [2024-09-11 16:04:01.227096] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:04:01.227105] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:04:01.227119] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:04:01.227151] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:04:01.227199] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:04:01.227220] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:04:01.233172] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:01.233201] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44980 [2024-09-11 16:04:01.307839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:01.307887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:01.307895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:01.307924] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:01.411004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:01.431461] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44980, magic:0x78563412 [2024-09-11 16:04:01.431504] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:01.431512] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:01.508240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:01.508283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:01.508291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:01.508300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:01.611191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:01.708552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:01.708602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:01.708611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:01.708620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:01.735959] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=5] PNIO [ratelimit] time: 1726041841735956, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:04:01.742637] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041841742634, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:04:01.811387] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:01.833992] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:01.834037] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44990 [2024-09-11 16:04:01.899415] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:01.908955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:01.909001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:01.909009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:01.909019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:02.011513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:02.032073] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44990, magic:0x78563412 [2024-09-11 16:04:02.032116] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:02.032125] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:02.109263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:02.109307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:02.109315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:02.109325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:02.211636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:02.225674] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:02.309575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:02.309619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:02.309627] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:02.309636] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:02.416082] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4320, replace_start_pos=2200000, replace_num=100000) [2024-09-11 16:04:02.416133] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:02.434465] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:02.434507] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44994 [2024-09-11 16:04:02.509967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:02.510015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:02.510023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:02.510033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:02.616318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:02.632522] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44994, magic:0x78563412 [2024-09-11 16:04:02.632553] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:02.632560] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:02.710289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:02.710335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:02.710343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:02.710353] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:02.718895] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8528, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:04:02.743580] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041842743576, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:04:02.750265] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041842750261, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:04:02.816512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:02.900515] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:02.919174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:02.919217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:02.919225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:02.919235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:03.016700] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:03.034158] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:03.034222] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44996 [2024-09-11 16:04:03.119482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:03.119528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:03.119536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:03.119546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:03.216896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:03.225915] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:03.232751] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44996, magic:0x78563412 [2024-09-11 16:04:03.232800] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:03.232811] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:03.319785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:03.319832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:03.319839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:03.319848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:03.417107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:03.520147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:03.520192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:03.520200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:03.520210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:03.617239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:03.634559] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:03.634600] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45010 [2024-09-11 16:04:03.720487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:03.720531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:03.720539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:03.720548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:03.751183] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041843751179, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:04:03.757877] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041843757874, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:04:03.817363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:03.833128] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45010, magic:0x78563412 [2024-09-11 16:04:03.833164] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:03.833169] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:03.901821] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:03.920798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:03.920845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:03.920854] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:03.920864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:04.017487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:04.121112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:04.121156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:04.121164] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:04.121174] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:04.217616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:04.226117] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:04.233802] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:04.233842] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45022 [2024-09-11 16:04:04.321439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:04.321483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:04.321491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:04.321500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:04.417810] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:04.432440] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45022, magic:0x78563412 [2024-09-11 16:04:04.432478] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:04.432484] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:04.521746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:04.521789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:04.521797] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:04.521806] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:04.622139] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4193, replace_start_pos=2300000, replace_num=100000) [2024-09-11 16:04:04.622186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:04.722101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:04.722146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:04.722154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:04.722164] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:04.729225] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7048, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:04:04.758724] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041844758721, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:04:04.765494] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726041844765491, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:04:04.822351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:04.834921] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:04.834958] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45038 [2024-09-11 16:04:04.902768] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:04.929549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:04.929593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:04.929601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:04.929611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:05.022486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:05.033180] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45038, magic:0x78563412 [2024-09-11 16:04:05.033225] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:05.033233] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:05.129825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:05.129865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:05.129871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:05.129879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:05.222624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:05.226310] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:05.330150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:05.330190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:05.330196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:05.330203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:05.422808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:05.434978] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:05.435010] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45052 [2024-09-11 16:04:05.530435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:05.530484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:05.530491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:05.530499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:05.622949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:05.633277] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45052, magic:0x78563412 [2024-09-11 16:04:05.633305] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:05.633311] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:05.730718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:05.730773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:05.730779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:05.730787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:05.766413] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041845766410, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:04:05.773115] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041845773111, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:04:05.823086] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:05.903721] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:05.931048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:05.931091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:05.931099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:05.931109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:06.023213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:06.035734] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:06.035776] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17754 [2024-09-11 16:04:06.131329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:06.131373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:06.131379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:06.131386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:06.223353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:06.226455] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:06.233966] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17754, magic:0x78563412 [2024-09-11 16:04:06.233996] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:06.234004] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:06.331849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:06.331893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:06.331899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:06.331926] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:06.423482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:06.532138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:06.532177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:06.532183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:06.532191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:06.623593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:06.635703] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:06.635745] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17770 [2024-09-11 16:04:06.732410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:06.732462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:06.732491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:06.732500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:06.738889] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6375, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:04:06.774030] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041846774026, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:04:06.780738] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041846780734, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:04:06.827696] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3924, replace_start_pos=2400000, replace_num=100000) [2024-09-11 16:04:06.827741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:06.834254] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17770, magic:0x78563412 [2024-09-11 16:04:06.834293] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:06.834301] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:06.904784] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:06.939240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:06.939288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:06.939296] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:06.939307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:07.027830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:07.139619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:07.139666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:07.139674] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:07.139684] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:07.226575] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:07.227956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:07.236116] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:07.236161] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17774 [2024-09-11 16:04:07.339941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:07.339985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:07.339992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:07.340002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:07.428125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:07.434730] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17774, magic:0x78563412 [2024-09-11 16:04:07.434773] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:07.434779] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:07.540320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:07.540360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:07.540368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:07.540378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:07.628249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:07.740600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:07.740660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:07.740668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:07.740675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:07.781644] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726041847781639, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:04:07.788401] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041847788398, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:04:07.828377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:07.836640] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:07.836699] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17784 [2024-09-11 16:04:07.905769] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:07.941015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:07.941058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:07.941064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:07.941071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:08.028510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:08.035207] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17784, magic:0x78563412 [2024-09-11 16:04:08.035250] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:08.035258] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:08.141401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:08.141445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:08.141452] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:08.141460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:08.226703] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:08.228635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:08.341729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:08.341771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:08.341781] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:08.341792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:08.428769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:08.437220] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:08.437263] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17800 [2024-09-11 16:04:08.542064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:08.542118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:08.542124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:08.542132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:08.628898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:08.635612] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17800, magic:0x78563412 [2024-09-11 16:04:08.635644] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:08.635650] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:08.742399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:08.742448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:08.742457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:08.742467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:08.751885] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9402, clean_start_pos=0, clean_num=200000) [2024-09-11 16:04:08.789191] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041848789187, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:04:08.796011] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041848796009, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:04:08.829098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:08.952229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:08.952274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:08.952282] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:08.952310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:09.006804] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:09.033686] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4398, replace_start_pos=2500000, replace_num=100000) [2024-09-11 16:04:09.033734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:09.037676] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:09.037708] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17806 [2024-09-11 16:04:09.152652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:09.152701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:09.152709] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:09.152719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:09.226931] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:09.233947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:09.236074] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17806, magic:0x78563412 [2024-09-11 16:04:09.236108] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:09.236116] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:09.353007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:09.353053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:09.353061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:09.353070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:09.434167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:09.553366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:09.553412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:09.553420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:09.553446] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:09.634375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:09.638315] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:09.638345] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17820 [2024-09-11 16:04:09.753749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:09.753792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:09.753801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:09.753811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:09.796806] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041849796802, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:04:09.803565] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041849803563, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:04:09.834555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:09.836599] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17820, magic:0x78563412 [2024-09-11 16:04:09.836630] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:09.836637] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:09.954067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:09.954106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:09.954114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:09.954123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:10.007730] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:10.034688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:10.154384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:10.154428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:10.154436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:10.154462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:10.227135] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:10.234820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:10.238049] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:10.238078] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17832 [2024-09-11 16:04:10.354691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:10.354732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:10.354739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:10.354748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:10.434950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:10.436783] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17832, magic:0x78563412 [2024-09-11 16:04:10.436809] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:10.436817] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:10.555071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:10.555115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:10.555123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:10.555132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:10.635122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:10.755436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:10.755478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:10.755485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:10.755494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:10.764012] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8504, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:04:10.804427] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041850804422, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:04:10.811203] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041850811199, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:04:10.835341] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:10.837593] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:10.837631] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17840 [2024-09-11 16:04:10.964342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:10.964387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:10.964395] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:10.964405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:11.008923] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:11.035532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:11.036257] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17840, magic:0x78563412 [2024-09-11 16:04:11.036289] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:11.036295] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:11.164705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:11.164750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:11.164758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:11.164768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:11.227341] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:11.239469] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3742, replace_start_pos=2600000, replace_num=100000) [2024-09-11 16:04:11.239508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:11.241114] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:11.241144] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:11.241227] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=87, max_check_version=88, global_version=89) [2024-09-11 16:04:11.243288] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2059 [2024-09-11 16:04:11.243323] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:11.243359] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:04:11.243398] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:04:11.243497] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:11.243605] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:04:11.243657] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:04:11.243669] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:04:11.243683] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:04:11.243721] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:04:11.243781] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:04:11.243803] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:04:11.365033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:11.365082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:11.365089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:11.365099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:11.438637] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:11.438682] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17854 [2024-09-11 16:04:11.439654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:11.565396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:11.565442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:11.565450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:11.565459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:11.637012] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17854, magic:0x78563412 [2024-09-11 16:04:11.637056] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:11.637065] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:11.639788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:11.765686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:11.765741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:11.765756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:11.765770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:11.812038] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041851812035, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:04:11.818885] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041851818882, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:04:11.839934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:11.966017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:11.966063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:11.966071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:11.966096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:12.010327] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:12.038120] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:12.038162] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17860 [2024-09-11 16:04:12.040069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:12.166340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:12.166379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:12.166387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:12.166396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:12.227535] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:12.236452] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17860, magic:0x78563412 [2024-09-11 16:04:12.236496] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:12.236505] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:12.240221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:12.366643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:12.366689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:12.366697] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:12.366706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:12.440408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:12.566954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:12.567000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:12.567008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:12.567017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:12.638040] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:12.638077] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17870 [2024-09-11 16:04:12.640595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:12.767269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:12.767310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:12.767317] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:12.767326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:12.774494] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7155, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:04:12.819725] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041852819722, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:04:12.826446] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041852826442, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:04:12.835961] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17870, magic:0x78563412 [2024-09-11 16:04:12.836001] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:12.836009] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:12.840717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:12.974816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:12.974865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:12.974873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:12.974883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:13.011412] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:13.040900] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:13.175242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:13.175285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:13.175293] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:13.175319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:13.227735] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:13.237610] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:13.237651] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17876 [2024-09-11 16:04:13.241106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:13.375547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:13.375592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:13.375600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:13.375609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:13.436173] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17876, magic:0x78563412 [2024-09-11 16:04:13.436204] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:13.436212] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:13.445318] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4036, replace_start_pos=2700000, replace_num=100000) [2024-09-11 16:04:13.445355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:13.575840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:13.575896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:13.575926] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:13.575939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:13.576176] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash time detail, (compute_wash_size_time=133, refresh_score_time=63, wash_time=0) [2024-09-11 16:04:13.645445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:13.776415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:13.776456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:13.776463] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:13.776472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:13.827270] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041853827268, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:04:13.834039] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041853834036, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:04:13.838397] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:13.838428] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17884 [2024-09-11 16:04:13.845627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:13.976698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:13.976747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:13.976754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:13.976764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:14.012496] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:14.036750] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17884, magic:0x78563412 [2024-09-11 16:04:14.036782] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:14.036788] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:14.045810] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:14.177009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:14.177043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:14.177049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:14.177074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:14.227867] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:14.245993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:14.377305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:14.377346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:14.377354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:14.377364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:14.438701] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:14.438746] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17888 [2024-09-11 16:04:14.446177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:14.577596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:14.577640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:14.577647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:14.577656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:14.637143] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17888, magic:0x78563412 [2024-09-11 16:04:14.637170] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:14.637176] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:14.646361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:14.777897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:14.777973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:14.777982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:14.777991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:14.786175] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8172, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:04:14.834891] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726041854834886, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:04:14.841659] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041854841658, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:04:14.846498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:14.986463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:14.986510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:14.986518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:14.986527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:15.013442] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:15.038975] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:15.039021] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17892 [2024-09-11 16:04:15.046601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:15.186827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:15.186872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:15.186880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:15.186889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:15.228029] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=88] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:15.237461] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17892, magic:0x78563412 [2024-09-11 16:04:15.237500] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:15.237521] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:15.246700] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:15.387140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:15.387181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:15.387189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:15.387199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:15.446809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:15.587494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:15.587538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:15.587546] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:15.587556] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:15.639799] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:15.639844] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40072 [2024-09-11 16:04:15.651219] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4300, replace_start_pos=2800000, replace_num=100000) [2024-09-11 16:04:15.651260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:15.787791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:15.787838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:15.787846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:15.787855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:15.838187] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40072, magic:0x78563412 [2024-09-11 16:04:15.838226] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:15.838234] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:15.842503] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041855842502, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:04:15.849265] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726041855849262, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:04:15.851338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:15.988197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:15.988240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:15.988249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:15.988259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:16.014693] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:16.051438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:16.188484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:16.188531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:16.188538] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:16.188547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:16.228235] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:16.239057] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:16.239111] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40088 [2024-09-11 16:04:16.251564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:16.388844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:16.388889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:16.388897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:16.388943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:16.437270] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40088, magic:0x78563412 [2024-09-11 16:04:16.437315] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:16.437324] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:16.451799] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:16.589185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:16.589230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:16.589237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:16.589246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:16.651940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:16.789566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:16.789635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:16.789655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:16.789668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:16.798195] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8509, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:04:16.839084] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:16.839126] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40098 [2024-09-11 16:04:16.850193] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726041856850189, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:04:16.852133] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:16.856884] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041856856880, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:04:16.998462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:16.998507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:16.998515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:16.998525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:17.015896] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:17.037825] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40098, magic:0x78563412 [2024-09-11 16:04:17.037869] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:17.037877] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:17.052243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:17.198925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:17.198965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:17.198973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:17.198982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:17.228370] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:17.252375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:17.399284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:17.399332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:17.399340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:17.399350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:17.438950] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:17.438997] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40112 [2024-09-11 16:04:17.452585] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:17.599602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:17.599651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:17.599659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:17.599669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:17.637368] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40112, magic:0x78563412 [2024-09-11 16:04:17.637409] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:17.637416] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:17.652726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:17.799930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:17.799973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:17.799979] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:17.799987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:17.857318] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4385, replace_start_pos=2900000, replace_num=100000) [2024-09-11 16:04:17.857370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:17.857746] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726041857857743, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:04:17.864589] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041857864585, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007705, add_bytes: 0 [2024-09-11 16:04:18.000203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:18.000267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:18.000274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:18.000281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:18.017100] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:18.039131] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:18.039177] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40126 [2024-09-11 16:04:18.057526] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:18.200511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:18.200554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:18.200561] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:18.200569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:18.228571] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:18.237510] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40126, magic:0x78563412 [2024-09-11 16:04:18.237544] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:18.237552] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:18.257723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:18.400821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:18.400869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:18.400877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:18.400886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:18.457933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:18.601192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:18.601238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:18.601267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:18.601278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:18.639182] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:18.639225] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40136 [2024-09-11 16:04:18.658137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:18.801499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:18.801543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:18.801549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:18.801557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:18.808090] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6523, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:04:18.837960] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40136, magic:0x78563412 [2024-09-11 16:04:18.838013] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:18.838025] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:18.858278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:18.865349] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726041858865346, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:04:18.872180] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041858872178, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:04:19.008331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:19.008375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:19.008404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:19.008412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:19.018306] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:19.058465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:19.208646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:19.208707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:19.208714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:19.208721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:19.228702] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:19.244174] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:19.244216] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40142 [2024-09-11 16:04:19.258670] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:19.408994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:19.409039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:19.409046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:19.409055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:19.437471] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40142, magic:0x78563412 [2024-09-11 16:04:19.437512] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:19.437520] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:19.458805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:19.609373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:19.609444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:19.609453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:19.609463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:19.658988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:19.809744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:19.809801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:19.809807] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:19.809817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:19.840202] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:19.840248] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40154 [2024-09-11 16:04:19.859111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:19.873035] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041859873031, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:04:19.879797] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041859879792, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:04:20.010132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:20.010179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:20.010187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:20.010197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:20.019606] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:20.037819] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40154, magic:0x78563412 [2024-09-11 16:04:20.037864] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:20.037872] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:20.063600] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4362, replace_start_pos=3000000, replace_num=100000) [2024-09-11 16:04:20.063650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:20.210507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:20.210557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:20.210590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:20.210601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:20.228829] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:20.263734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:20.410838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:20.410881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:20.410889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:20.410898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:20.439661] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:20.439700] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40160 [2024-09-11 16:04:20.463860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:20.611280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:20.611331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:20.611339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:20.611348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:20.638316] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40160, magic:0x78563412 [2024-09-11 16:04:20.638351] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:20.638359] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:20.664018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:20.811565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:20.811613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:20.811620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:20.811628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:20.818106] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6465, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:04:20.864141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:20.880583] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041860880579, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:04:20.887354] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041860887351, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:04:21.018449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:21.018494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:21.018502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:21.018511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:21.020712] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:21.040194] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:21.040237] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40164 [2024-09-11 16:04:21.064263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:21.218758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:21.218805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:21.218812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:21.218821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:21.229061] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=90] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:21.238741] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40164, magic:0x78563412 [2024-09-11 16:04:21.238799] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:21.238808] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:21.257938] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:21.257990] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:21.258070] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=88, max_check_version=89, global_version=90) [2024-09-11 16:04:21.260116] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2045 [2024-09-11 16:04:21.260156] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:21.260193] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:04:21.260231] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:04:21.260336] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:21.260444] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,685,568 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 198,416 used= 186,136 count= 23 avg_used= 8,092 block_cnt= 23 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,685,568 used= 76,271,908 count= 1,550 avg_used= 49,207 mod=SUMMARY [2024-09-11 16:04:21.260499] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:04:21.260511] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:04:21.260525] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:04:21.260562] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:04:21.260622] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:04:21.260644] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:04:21.264384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:21.419126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:21.419168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:21.419175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:21.419184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:21.464479] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:21.619459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:21.619511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:21.619543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:21.619555] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:21.641155] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:21.641200] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40170 [2024-09-11 16:04:21.664611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:21.819792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:21.819852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:21.819867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:21.819876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:21.839169] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40170, magic:0x78563412 [2024-09-11 16:04:21.839214] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:21.839222] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:21.864750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:21.888207] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041861888203, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:04:21.894975] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041861894970, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:04:22.022037] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:22.022179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:22.022211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:22.022218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:22.022225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:22.064877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:22.222442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:22.222494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:22.222524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:22.222533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:22.229201] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:22.241021] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:22.241066] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40172 [2024-09-11 16:04:22.269131] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4130, replace_start_pos=3100000, replace_num=100000) [2024-09-11 16:04:22.269171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:22.422845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:22.422897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:22.422931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:22.422940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:22.439460] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40172, magic:0x78563412 [2024-09-11 16:04:22.439502] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:22.439509] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:22.469253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:22.623317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:22.623358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:22.623364] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:22.623394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:22.669354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:22.823625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:22.823675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:22.823681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:22.823689] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:22.830871] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7169, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:04:22.841361] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:22.841400] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40174 [2024-09-11 16:04:22.869468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:22.895821] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041862895817, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:04:22.902574] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041862902570, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:04:23.022798] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:23.031179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:23.031218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:23.031226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:23.031236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:23.039025] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40174, magic:0x78563412 [2024-09-11 16:04:23.039064] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:23.039071] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:23.069589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:23.229400] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:23.231473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:23.231527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:23.231534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:23.231543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:23.269692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:23.431776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:23.431822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:23.431830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:23.431839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:23.441051] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:23.441094] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40176 [2024-09-11 16:04:23.469821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:23.632060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:23.632103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:23.632110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:23.632117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:23.639369] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40176, magic:0x78563412 [2024-09-11 16:04:23.639411] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:23.639418] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:23.669950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:23.832349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:23.832390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:23.832397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:23.832411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:23.870075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:23.903534] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041863903529, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007712, add_bytes: 0 [2024-09-11 16:04:23.910193] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041863910189, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:04:24.023729] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:24.032653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:24.032693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:24.032701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:24.032710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:24.041558] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:24.041589] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40186 [2024-09-11 16:04:24.070202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:24.229576] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:24.233031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:24.233066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:24.233077] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:24.233086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:24.240076] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40186, magic:0x78563412 [2024-09-11 16:04:24.240119] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:24.240128] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:24.270329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:24.433312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:24.433349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:24.433356] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:24.433365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:24.474908] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4379, replace_start_pos=3200000, replace_num=100000) [2024-09-11 16:04:24.474958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:24.633609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:24.633654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:24.633662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:24.633671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:24.642299] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:24.642330] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40196 [2024-09-11 16:04:24.675127] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:24.833936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:24.833974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:24.833981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:24.833990] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:24.840451] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40196, magic:0x78563412 [2024-09-11 16:04:24.840489] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:24.840497] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:24.842389] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8368, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:04:24.875311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:24.911055] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041864911050, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007521, add_bytes: 0 [2024-09-11 16:04:24.917877] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041864917874, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:04:25.024676] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:25.042724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:25.042770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:25.042778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:25.042788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:25.043000] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:04:25.075435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:25.229714] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:25.241366] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:25.241410] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:40206 [2024-09-11 16:04:25.243306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:25.243340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:25.243346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:25.243355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:25.275625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:25.439968] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:40206, magic:0x78563412 [2024-09-11 16:04:25.440012] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:25.440022] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:25.443607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:25.443643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:25.443651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:25.443660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:25.475847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:25.643891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:25.643949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:25.643956] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:25.643965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:25.676034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:25.841611] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:25.841650] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54934 [2024-09-11 16:04:25.844287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:25.844322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:25.844331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:25.844340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:25.876224] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:25.918738] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041865918734, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:04:25.925424] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726041865925421, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:04:26.025577] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:26.039093] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54934, magic:0x78563412 [2024-09-11 16:04:26.039138] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:26.039146] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:26.044589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:26.044628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:26.044635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:26.044644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:26.076422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:26.229972] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:26.244895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:26.244956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:26.244963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:26.244972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:26.276618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:26.441628] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:26.441674] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54936 [2024-09-11 16:04:26.445203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:26.445239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:26.445247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:26.445273] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:26.476746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:26.639749] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54936, magic:0x78563412 [2024-09-11 16:04:26.639791] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:26.639799] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:26.645576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:26.645620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:26.645628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:26.645639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:26.681355] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4422, replace_start_pos=3300000, replace_num=100000) [2024-09-11 16:04:26.681396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:26.845877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:26.845957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:26.845976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:26.845989] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:26.853120] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7115, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:04:26.881491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:26.926348] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041866926344, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:04:26.933069] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041866933064, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007643, add_bytes: 0 [2024-09-11 16:04:27.026351] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:27.041725] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:27.041761] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54938 [2024-09-11 16:04:27.053452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:27.053521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:27.053530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:27.053541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:27.081687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:27.230107] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:27.240031] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54938, magic:0x78563412 [2024-09-11 16:04:27.240073] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:27.240080] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:27.253873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:27.253943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:27.253957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:27.253969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:27.281826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:27.454210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:27.454256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:27.454264] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:27.454274] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:27.482014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:27.641374] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:27.641416] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54940 [2024-09-11 16:04:27.654545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:27.654590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:27.654597] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:27.654607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:27.682213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:27.839712] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54940, magic:0x78563412 [2024-09-11 16:04:27.839753] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:27.839761] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:27.854839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:27.854883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:27.854891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:27.854916] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:27.882407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:27.933980] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041867933975, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:04:27.940672] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041867940669, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:04:28.027154] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:28.055247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:28.055294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:28.055302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:28.055312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:28.082535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:28.230281] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:28.241249] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:28.241287] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54944 [2024-09-11 16:04:28.255610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:28.255675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:28.255684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:28.255693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:28.282743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:28.439941] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54944, magic:0x78563412 [2024-09-11 16:04:28.439980] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:28.439986] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:28.456022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:28.456067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:28.456074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:28.456084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:28.482875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:28.656324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:28.656367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:28.656391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:28.656401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:28.683071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:28.842153] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:28.842198] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54952 [2024-09-11 16:04:28.856715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:28.856756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:28.856764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:28.856773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:28.864219] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7431, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:04:28.887583] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4320, replace_start_pos=3400000, replace_num=100000) [2024-09-11 16:04:28.887629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:28.941533] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041868941528, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:04:28.948278] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041868948274, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:04:29.028018] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:29.040434] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54952, magic:0x78563412 [2024-09-11 16:04:29.040469] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:29.040477] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:29.064484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:29.064529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:29.064537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:29.064546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:29.087780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:29.230473] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:29.264852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:29.264897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:29.264942] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:29.264957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:29.287997] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:29.442372] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:29.442416] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54956 [2024-09-11 16:04:29.465257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:29.465303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:29.465311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:29.465320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:29.488229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:29.641025] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54956, magic:0x78563412 [2024-09-11 16:04:29.641058] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:29.641064] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:29.665616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:29.665658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:29.665683] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:29.665693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:29.688366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:29.866022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:29.866068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:29.866076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:29.866086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:29.888558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:29.949145] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041869949141, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:04:29.955890] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041869955886, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:04:30.028815] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:30.042960] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:30.043005] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54964 [2024-09-11 16:04:30.066308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:30.066397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=89][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:30.066404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:30.066412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:30.088686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:30.230591] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:30.240361] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54964, magic:0x78563412 [2024-09-11 16:04:30.240398] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:30.240404] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:30.266641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:30.266686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:30.266710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:30.266719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:30.288822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:30.466973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:30.467016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:30.467024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:30.467034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:30.489018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:30.642002] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:30.642046] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54968 [2024-09-11 16:04:30.667336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:30.667382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:30.667389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:30.667399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:30.689162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:30.840683] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54968, magic:0x78563412 [2024-09-11 16:04:30.840719] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:30.840743] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:30.867631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:30.867674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:30.867682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:30.867691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:30.876272] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8567, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:04:30.889356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:30.956743] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041870956740, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:04:30.963501] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726041870963498, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:04:31.029644] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=106] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:31.076545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:31.076591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:31.076598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:31.076608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:31.093213] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3728, replace_start_pos=3500000, replace_num=100000) [2024-09-11 16:04:31.093250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:31.230797] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:31.242739] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:31.242799] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54978 [2024-09-11 16:04:31.274712] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:31.274764] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:31.274848] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=89, max_check_version=90, global_version=91) [2024-09-11 16:04:31.276878] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2030 [2024-09-11 16:04:31.276887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:31.276949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:31.276958] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:31.276957] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=60] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:31.276970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:31.277000] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:04:31.277040] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:04:31.277120] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:31.277222] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:04:31.277268] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:04:31.277278] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:04:31.277288] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:04:31.277328] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:04:31.277381] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:04:31.277401] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:04:31.293409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:31.441216] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54978, magic:0x78563412 [2024-09-11 16:04:31.441259] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:31.441268] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:31.477272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:31.477317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:31.477325] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:31.477335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:31.493600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:31.677635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:31.677682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:31.677690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:31.677700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:31.693746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:31.843638] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:31.843683] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54990 [2024-09-11 16:04:31.877959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:31.878016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:31.878032] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:31.878045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:31.893879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:31.964424] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041871964421, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:04:31.971140] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041871971137, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 16:04:32.030629] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:32.041725] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54990, magic:0x78563412 [2024-09-11 16:04:32.041764] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:32.041771] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:32.078355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:32.078400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:32.078408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:32.078417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:32.094105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:32.230982] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:32.278656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:32.278702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:32.278709] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:32.278718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:32.294309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:32.443717] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:32.443763] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54996 [2024-09-11 16:04:32.479046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:32.479107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:32.479115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:32.479126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:32.494546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:32.642037] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54996, magic:0x78563412 [2024-09-11 16:04:32.642075] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:32.642082] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:32.679445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:32.679492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:32.679501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:32.679528] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:32.694677] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:32.879832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:32.879879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:32.879887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:32.879897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:32.886816] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6881, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:04:32.894801] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:32.972003] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041872971998, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007577, add_bytes: 0 [2024-09-11 16:04:32.978739] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041872978735, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:04:33.031875] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:33.044312] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:33.044358] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55006 [2024-09-11 16:04:33.087150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:33.087197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:33.087205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:33.087215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:33.094930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:33.231146] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:33.242367] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55006, magic:0x78563412 [2024-09-11 16:04:33.242399] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:33.242406] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:33.287519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:33.287586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:33.287596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:33.287607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:33.299544] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4422, replace_start_pos=3600000, replace_num=100000) [2024-09-11 16:04:33.299597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:33.487958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:33.488006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:33.488014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:33.488025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:33.499753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:33.644399] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:33.644439] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55008 [2024-09-11 16:04:33.688336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:33.688381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:33.688389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:33.688399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:33.699945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:33.842924] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55008, magic:0x78563412 [2024-09-11 16:04:33.842983] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:33.842992] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:33.888700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:33.888746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:33.888755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:33.888765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:33.889005] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=82, refresh_score_time=64, wash_time=0) [2024-09-11 16:04:33.900127] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:33.979665] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041873979661, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:04:33.986429] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041873986426, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:04:34.033347] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=107] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:34.089270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:34.089317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:34.089325] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:34.089334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:34.100319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:34.231326] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:34.244727] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:34.244769] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55012 [2024-09-11 16:04:34.289665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:34.289712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:34.289720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:34.289730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:34.300454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:34.443076] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55012, magic:0x78563412 [2024-09-11 16:04:34.443117] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:34.443125] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:34.489998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:34.490046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:34.490053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:34.490063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:34.500644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:34.690296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:34.690340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:34.690351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:34.690364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:34.700777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:34.845792] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:34.845833] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55018 [2024-09-11 16:04:34.890607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:34.890650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:34.890657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:34.890686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:34.897749] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7049, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:04:34.900882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:34.987298] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041874987293, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:04:34.993990] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041874993986, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:04:35.034444] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:35.043766] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55018, magic:0x78563412 [2024-09-11 16:04:35.043809] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:35.043817] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:35.098000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:35.098042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:35.098049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:35.098056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:35.101049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:35.231523] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:35.298280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:35.298325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:35.298333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:35.298342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:35.301160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:35.446108] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:35.446146] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1264 [2024-09-11 16:04:35.498569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:35.498625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:35.498632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:35.498641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:35.505515] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4248, replace_start_pos=3700000, replace_num=100000) [2024-09-11 16:04:35.505554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:35.644024] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1264, magic:0x78563412 [2024-09-11 16:04:35.644060] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:35.644065] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:35.698870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:35.698935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:35.698943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:35.698953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:35.705696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:35.899183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:35.899226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:35.899233] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:35.899242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:35.905816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:35.994899] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041875994895, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:04:36.001591] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041876001588, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:04:36.035480] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:36.047097] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:36.047142] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1272 [2024-09-11 16:04:36.099493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:36.099538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:36.099545] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:36.099554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:36.106008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:36.231674] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:36.244477] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1272, magic:0x78563412 [2024-09-11 16:04:36.244515] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:36.244523] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:36.299798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:36.299844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:36.299851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:36.299860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:36.306202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:36.500076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:36.500121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:36.500127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:36.500134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:36.506413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:36.646519] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:36.646556] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1288 [2024-09-11 16:04:36.700389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:36.700437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:36.700445] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:36.700453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:36.706528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:36.844839] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1288, magic:0x78563412 [2024-09-11 16:04:36.844888] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:36.844895] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:36.900683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:36.900734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:36.900748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:36.900757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:36.906640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:36.907739] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6968, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:04:37.002517] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726041877002512, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:04:37.009224] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041877009220, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:04:37.036501] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:37.106831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:37.107996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:37.108023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:37.108051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:37.108060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:37.231804] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:37.247332] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:37.247379] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1292 [2024-09-11 16:04:37.306961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:37.308307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:37.308339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:37.308351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:37.308361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:37.445458] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1292, magic:0x78563412 [2024-09-11 16:04:37.445500] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:37.445508] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:37.507078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:37.508571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:37.508602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:37.508608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:37.508615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:37.708857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:37.708921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:37.708931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:37.708940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:37.711271] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4057, replace_start_pos=3800000, replace_num=100000) [2024-09-11 16:04:37.711307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:37.847278] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:37.847320] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1302 [2024-09-11 16:04:37.909173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:37.909217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:37.909225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:37.909234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:37.911453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:38.010126] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=69] PNIO [ratelimit] time: 1726041878010122, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:04:38.016923] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041878016921, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007701, add_bytes: 0 [2024-09-11 16:04:38.037643] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:38.045895] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1302, magic:0x78563412 [2024-09-11 16:04:38.045960] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:38.045967] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:38.109474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:38.109515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:38.109522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:38.109531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:38.111631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:38.231935] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:38.309770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:38.309813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:38.309821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:38.309830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:38.311821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:38.447874] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:38.447952] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=71] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1312 [2024-09-11 16:04:38.510060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:38.510108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:38.510116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:38.510127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:38.512003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:38.646211] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1312, magic:0x78563412 [2024-09-11 16:04:38.646253] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:38.646262] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:38.710355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:38.710418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:38.710426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:38.710435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:38.712204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:38.910663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:38.910705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:38.910713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:38.910722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:38.912320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:38.918789] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8053, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:04:39.017692] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041879017688, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:04:39.024520] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041879024516, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 16:04:39.038609] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:39.046660] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:39.046710] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1326 [2024-09-11 16:04:39.112491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:39.119030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:39.119071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:39.119080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:39.119089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:39.232133] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:39.245577] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1326, magic:0x78563412 [2024-09-11 16:04:39.245616] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:39.245624] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:39.312709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:39.319321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:39.319367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:39.319375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:39.319385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:39.512899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:39.519613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:39.519655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:39.519662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:39.519672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:39.649300] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:39.649339] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1328 [2024-09-11 16:04:39.713046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:39.719897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:39.719958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:39.719966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:39.719975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:39.845875] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1328, magic:0x78563412 [2024-09-11 16:04:39.845930] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:39.845939] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:39.917223] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4045, replace_start_pos=3900000, replace_num=100000) [2024-09-11 16:04:39.917265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:39.920221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:39.920247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:39.920254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:39.920262] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:40.025360] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041880025356, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:04:40.032130] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041880032126, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:04:40.039410] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:40.117364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:40.120461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:40.120526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:40.120533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:40.120540] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:40.232322] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:40.247641] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:40.247684] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1342 [2024-09-11 16:04:40.317504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:40.320764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:40.320792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:40.320800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:40.320825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:40.446302] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1342, magic:0x78563412 [2024-09-11 16:04:40.446340] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:40.446348] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:40.517637] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:40.521060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:40.521095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:40.521102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:40.521111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:40.717762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:40.721350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:40.721379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:40.721386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:40.721395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:40.848206] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:40.848249] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1348 [2024-09-11 16:04:40.917882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:40.921623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:40.921672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:40.921680] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:40.921689] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:40.930262] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8560, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:04:41.032924] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041881032920, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:04:41.039732] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041881039728, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:04:41.046192] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1348, magic:0x78563412 [2024-09-11 16:04:41.046222] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:41.046228] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:41.118016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:41.130513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:41.130558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:41.130566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:41.130574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:41.140300] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:41.232542] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:41.291039] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:41.291090] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:41.291168] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=90, max_check_version=91, global_version=92) [2024-09-11 16:04:41.293237] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2066 [2024-09-11 16:04:41.293303] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:41.293338] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:04:41.293376] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:04:41.293460] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:41.293567] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:04:41.293623] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:04:41.293635] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:04:41.293646] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:04:41.293682] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:04:41.293742] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:04:41.293765] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:04:41.318142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:41.330800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:41.330844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:41.330850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:41.330858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:41.448113] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:41.448156] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1360 [2024-09-11 16:04:41.518260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:41.531078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:41.531123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:41.531129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:41.531137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:41.646484] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1360, magic:0x78563412 [2024-09-11 16:04:41.646528] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:41.646536] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:41.718446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:41.731365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:41.731415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:41.731423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:41.731432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:41.918603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:41.931675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:41.931723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:41.931731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:41.931740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:42.040534] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041882040530, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:04:42.047294] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041882047291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:04:42.048450] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:42.048476] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1368 [2024-09-11 16:04:42.123137] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4345, replace_start_pos=4000000, replace_num=100000) [2024-09-11 16:04:42.123188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:42.131978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:42.132018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:42.132027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:42.132055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:42.141156] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:42.232683] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:42.246834] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1368, magic:0x78563412 [2024-09-11 16:04:42.246877] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:42.246931] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:42.323336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:42.332293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:42.332340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:42.332348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:42.332356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:42.523472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:42.532594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:42.532628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:42.532635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:42.532643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:42.648779] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:42.648821] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1370 [2024-09-11 16:04:42.723649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:42.732898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:42.732953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:42.732960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:42.732969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:42.847301] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1370, magic:0x78563412 [2024-09-11 16:04:42.847338] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:42.847346] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:42.923887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:42.933211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:42.933258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:42.933265] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:42.933274] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:42.940953] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7667, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:04:43.048205] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041883048201, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:04:43.054895] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041883054892, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:04:43.124035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:43.141255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:43.141320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:43.141330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:43.141339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:43.141952] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:43.232868] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:43.249519] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:43.249560] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1378 [2024-09-11 16:04:43.324222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:43.341696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:43.341732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:43.341738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:43.341757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:43.447826] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1378, magic:0x78563412 [2024-09-11 16:04:43.447867] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:43.447875] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:43.524364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:43.541993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:43.542030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:43.542036] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:43.542044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:43.724553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:43.742307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:43.742351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:43.742357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:43.742365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:43.849627] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:43.849675] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1392 [2024-09-11 16:04:43.924689] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:43.942638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:43.942692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:43.942700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:43.942709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:44.047956] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1392, magic:0x78563412 [2024-09-11 16:04:44.047992] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:44.048000] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:44.055816] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041884055813, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:04:44.062518] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041884062514, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:04:44.124805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:44.142713] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:44.142961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:44.142995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:44.143003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:44.143012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:44.233069] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:44.328290] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3359, replace_start_pos=4100000, replace_num=100000) [2024-09-11 16:04:44.328333] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:44.343254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:44.343298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:44.343306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:44.343315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:44.450524] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:44.450568] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1396 [2024-09-11 16:04:44.528420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:44.543570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:44.543615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:44.543623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:44.543632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:44.648689] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1396, magic:0x78563412 [2024-09-11 16:04:44.651743] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=3045] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:44.651763] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:44.728620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:44.743869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:44.743951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:44.743959] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:44.743968] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:44.928759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:44.944183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:44.944240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:44.944249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:44.944259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:44.950846] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6551, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:04:45.050820] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:45.050860] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:1402 [2024-09-11 16:04:45.063385] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041885063382, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007569, add_bytes: 0 [2024-09-11 16:04:45.070132] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041885070127, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:04:45.128973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:45.144062] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:45.151139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:45.151199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:45.151210] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:45.151223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:45.233205] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:45.249033] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:1402, magic:0x78563412 [2024-09-11 16:04:45.249075] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:45.249084] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:45.329149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:45.351445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:45.351491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:45.351497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:45.351504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:45.529280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:45.551743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:45.551799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:45.551840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:45.551854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:45.649966] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:45.650006] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17364 [2024-09-11 16:04:45.729459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:45.752095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:45.752131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:45.752138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:45.752147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:45.848213] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17364, magic:0x78563412 [2024-09-11 16:04:45.848247] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:45.848254] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:45.929646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:45.952378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:45.952429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:45.952439] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:45.952453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:46.070994] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041886070990, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:04:46.077747] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041886077742, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:04:46.129829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:46.145145] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:46.152687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:46.152727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:46.152764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:46.152774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:46.233406] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:46.250304] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:46.250343] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17370 [2024-09-11 16:04:46.330035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:46.353010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:46.353129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=118][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:46.353136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:46.353144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:46.448809] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17370, magic:0x78563412 [2024-09-11 16:04:46.448849] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:46.448857] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:46.534680] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4405, replace_start_pos=4200000, replace_num=100000) [2024-09-11 16:04:46.534728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:46.553388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:46.553429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:46.553437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:46.553467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:46.734814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:46.753674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:46.753705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:46.753711] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:46.753719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:46.849672] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:46.849718] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17376 [2024-09-11 16:04:46.934948] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:46.953967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:46.954015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:46.954023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:46.954032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:46.962497] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8450, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:04:47.048064] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17376, magic:0x78563412 [2024-09-11 16:04:47.048106] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:47.048114] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:47.078613] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726041887078609, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:04:47.085476] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041887085473, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007731, add_bytes: 0 [2024-09-11 16:04:47.135147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:47.146364] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:47.162746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:47.162792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:47.162821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:47.162829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:47.233541] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:47.335277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:47.363061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:47.363101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:47.363109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:47.363118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:47.450656] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:47.450701] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17382 [2024-09-11 16:04:47.535461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:47.563338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:47.563377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:47.563383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:47.563390] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:47.648633] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17382, magic:0x78563412 [2024-09-11 16:04:47.648675] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:47.648683] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:47.735665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:47.763623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:47.763669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:47.763677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:47.763686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:47.935842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:47.963961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:47.964006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:47.964012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:47.964020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:48.050728] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:48.050774] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17390 [2024-09-11 16:04:48.086216] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726041888086212, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:04:48.092979] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041888092977, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007504, add_bytes: 0 [2024-09-11 16:04:48.136024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:48.147296] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:48.164262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:48.164306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:48.164314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:48.164323] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:48.233668] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:48.249015] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17390, magic:0x78563412 [2024-09-11 16:04:48.249048] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:48.249055] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:48.336215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:48.364533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:48.364577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:48.364584] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:48.364592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:48.536417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:48.564807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:48.564851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:48.564857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:48.564865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:48.650726] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:48.650768] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17396 [2024-09-11 16:04:48.740422] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3869, replace_start_pos=4300000, replace_num=100000) [2024-09-11 16:04:48.740469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:48.765078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:48.765120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:48.765127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:48.765134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:48.849283] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17396, magic:0x78563412 [2024-09-11 16:04:48.849324] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:48.849332] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:48.940560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:48.965362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:48.965405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:48.965412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:48.965419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:48.973215] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7784, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:04:49.093845] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041889093841, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:04:49.100595] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726041889100593, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:04:49.140744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:49.148510] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:49.173486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:49.173531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:49.173538] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:49.173547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:49.233814] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:49.252177] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:49.252219] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17404 [2024-09-11 16:04:49.340936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:49.373769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:49.373808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:49.373830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:49.373839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:49.449706] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17404, magic:0x78563412 [2024-09-11 16:04:49.449747] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:49.449755] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:49.541131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:49.574112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:49.574154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:49.574161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:49.574168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:49.741263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:49.774399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:49.774442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:49.774449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:49.774459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:49.852339] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:49.852382] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17410 [2024-09-11 16:04:49.941397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:49.974686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:49.974744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:49.974752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:49.974761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:50.050416] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17410, magic:0x78563412 [2024-09-11 16:04:50.050457] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:50.050464] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:50.101446] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041890101442, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:04:50.108206] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726041890108205, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:04:50.141549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:50.149593] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:50.175019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:50.175058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:50.175066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:50.175075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:50.233950] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:50.341667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:50.375297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:50.375331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:50.375338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:50.375347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:50.451631] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:50.451673] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17424 [2024-09-11 16:04:50.541862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:50.575569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:50.575606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:50.575613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:50.575621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:50.649658] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17424, magic:0x78563412 [2024-09-11 16:04:50.649699] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:50.649707] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:50.742070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:50.775826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:50.775869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:50.775876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:50.775884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:50.946583] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4376, replace_start_pos=4400000, replace_num=100000) [2024-09-11 16:04:50.946628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:50.976117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:50.976166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:50.976174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:50.976207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:50.983340] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7120, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:04:51.051789] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:51.051836] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17438 [2024-09-11 16:04:51.109078] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041891109072, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:04:51.115836] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=10] PNIO [ratelimit] time: 1726041891115831, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:04:51.146787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:51.150666] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:51.183588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:51.183636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:51.183644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:51.183652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:51.234159] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:51.250100] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17438, magic:0x78563412 [2024-09-11 16:04:51.250139] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:51.250147] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:51.308809] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:51.308860] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:04:51.308959] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=91, max_check_version=92, global_version=93) [2024-09-11 16:04:51.311005] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2045 [2024-09-11 16:04:51.311064] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=44] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:51.311101] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:04:51.311139] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:04:51.311223] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:04:51.311331] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:04:51.311385] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:04:51.311397] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:04:51.311408] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:04:51.311444] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:04:51.311505] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:04:51.311525] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:04:51.346978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:51.383882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:51.383954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:51.383962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:51.383972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:51.547106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:51.584209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:51.584256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:51.584264] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:51.584273] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:51.651799] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:51.651844] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17442 [2024-09-11 16:04:51.747227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:51.784515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:51.784560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:51.784568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:51.784577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:51.850509] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17442, magic:0x78563412 [2024-09-11 16:04:51.850548] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:51.850557] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:51.947363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:51.984819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:51.984882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:51.984891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:51.986434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=1539] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:52.116687] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041892116683, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:04:52.123445] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041892123441, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:04:52.147548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:52.151920] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:52.186695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:52.186736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:52.186743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:52.186753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:52.234344] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:52.252252] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:52.252297] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17450 [2024-09-11 16:04:52.347677] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:52.387002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:52.387052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:52.387060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:52.387087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:52.450784] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17450, magic:0x78563412 [2024-09-11 16:04:52.450827] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:52.450835] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:52.547798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:52.587311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:52.587355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:52.587361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:52.587369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:52.747918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:52.787603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:52.787651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:52.787658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:52.787667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:52.853024] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:52.853065] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17456 [2024-09-11 16:04:52.948109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:52.987932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:52.987998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:52.988005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:52.988013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:52.995231] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7205, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:04:53.051217] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17456, magic:0x78563412 [2024-09-11 16:04:53.051258] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:53.051266] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:53.124297] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041893124294, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:04:53.131081] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041893131077, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:04:53.152625] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4395, replace_start_pos=4500000, replace_num=100000) [2024-09-11 16:04:53.152670] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:53.153020] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:53.198605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:53.198661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:53.198668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:53.198677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:53.234549] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:53.352760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:53.398896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:53.398955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:53.398962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:53.398971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:53.453714] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:53.453757] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17470 [2024-09-11 16:04:53.552894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:53.599214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:53.599261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:53.599269] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:53.599287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:53.651873] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17470, magic:0x78563412 [2024-09-11 16:04:53.651932] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:53.651941] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:53.753083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:53.799522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:53.799569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:53.799577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:53.799586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:53.953269] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:53.999829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:53.999873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:53.999881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:53.999920] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:54.053437] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:54.053481] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17476 [2024-09-11 16:04:54.131911] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041894131907, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:04:54.138698] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041894138694, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:04:54.153457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:54.153914] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:54.200140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:54.200192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:54.200199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:54.200207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:54.200384] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=82, refresh_score_time=59, wash_time=0) [2024-09-11 16:04:54.234733] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:54.252081] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17476, magic:0x78563412 [2024-09-11 16:04:54.252122] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:54.252130] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:54.353638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:54.400609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:54.400663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:54.400675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:54.400688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:54.553760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:54.600949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:54.601002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:54.601010] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:54.601019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:54.654569] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:54.654608] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17488 [2024-09-11 16:04:54.753885] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:54.801239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:54.801284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:54.801290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:54.801297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:54.852709] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17488, magic:0x78563412 [2024-09-11 16:04:54.852756] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:54.852763] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:54.954024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:55.001505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:55.001544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:55.001552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:55.001560] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:55.009676] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8086, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:04:55.139529] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041895139524, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:04:55.146294] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041895146291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:04:55.154222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:55.154720] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:55.209969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:55.210014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:55.210021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:55.210030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:55.210212] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:04:55.234884] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:55.254189] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:55.254234] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:17490 [2024-09-11 16:04:55.358863] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4456, replace_start_pos=4600000, replace_num=100000) [2024-09-11 16:04:55.358917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:55.410436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:55.410480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:55.410488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:55.410497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:55.452944] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:17490, magic:0x78563412 [2024-09-11 16:04:55.452984] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:55.452992] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:55.559061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:55.610714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:55.610759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:55.610765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:55.610773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:55.759263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:55.810999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:55.811041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:55.811048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:55.811055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:55.855084] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:55.855128] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22872 [2024-09-11 16:04:55.959450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:56.011287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:56.011334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:56.011343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:56.011352] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:56.053442] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22872, magic:0x78563412 [2024-09-11 16:04:56.053498] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:56.053505] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:56.147141] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041896147137, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:04:56.153917] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041896153916, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:04:56.155466] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:56.159634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:56.211587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:56.211631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:56.211639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:56.211648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:56.235105] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=84] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:56.359830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:56.411877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:56.411943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:56.411955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:56.411968] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:56.455093] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:56.455141] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22874 [2024-09-11 16:04:56.559949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:56.612200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:56.612245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:56.612252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:56.612261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:56.652760] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22874, magic:0x78563412 [2024-09-11 16:04:56.652813] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:56.652822] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:56.760075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:56.812480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:56.812524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:56.812530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:56.812538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:56.960261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:57.012767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:57.012817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:57.012824] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:57.012833] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:57.020263] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7416, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:04:57.054980] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:57.055022] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22882 [2024-09-11 16:04:57.154827] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041897154823, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:04:57.156227] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:57.160447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:57.161592] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726041897161589, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:04:57.220503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:57.220546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:57.220554] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:57.220562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:57.235297] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:57.252370] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22882, magic:0x78563412 [2024-09-11 16:04:57.252414] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:57.252421] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:57.360625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:57.420815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:57.420864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:57.420872] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:57.420881] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:57.565144] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4336, replace_start_pos=4700000, replace_num=100000) [2024-09-11 16:04:57.565196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:57.621104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:57.621149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:57.621157] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:57.621166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:57.654297] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:57.654339] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22892 [2024-09-11 16:04:57.765344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:04:57.821396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:57.821442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:57.821449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:57.821458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:57.852621] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22892, magic:0x78563412 [2024-09-11 16:04:57.852661] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:57.852669] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:57.965546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:04:58.021703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:58.021747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:58.021755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:58.021764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:58.156990] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:58.162376] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041898162373, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:04:58.165688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:04:58.169144] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041898169142, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:04:58.222014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:58.222070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:58.222081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:58.222094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:58.235420] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:58.254676] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:58.254720] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22894 [2024-09-11 16:04:58.365864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:04:58.422321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:58.422367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:58.422376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:58.422385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:58.453127] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22894, magic:0x78563412 [2024-09-11 16:04:58.453171] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:58.453179] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:58.566094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:04:58.622621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:58.622661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:58.622669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:58.622678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:58.766281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:04:58.822882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:58.822942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:58.822948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:58.822956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:58.855033] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:58.855077] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22910 [2024-09-11 16:04:58.966408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:04:59.023200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:59.023244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:59.023252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:59.023261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:59.030568] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7295, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:04:59.053426] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22910, magic:0x78563412 [2024-09-11 16:04:59.053462] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:59.053470] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:59.157840] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:04:59.166593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:04:59.170088] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041899170085, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007712, add_bytes: 0 [2024-09-11 16:04:59.176761] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726041899176758, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:04:59.230840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:59.230890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:59.230897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:59.230923] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:59.235551] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:04:59.366782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:04:59.431146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:59.431186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:59.431193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:59.431216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:59.454076] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:04:59.454120] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22916 [2024-09-11 16:04:59.566926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:04:59.631426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:59.631470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:59.631476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:59.631483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:59.652751] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22916, magic:0x78563412 [2024-09-11 16:04:59.652788] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:04:59.652797] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:04:59.771578] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4402, replace_start_pos=4800000, replace_num=100000) [2024-09-11 16:04:59.771625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:04:59.831723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:04:59.831772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:04:59.831779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:04:59.831790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:04:59.971713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:00.032062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:00.032106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:00.032112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:00.032120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:00.055409] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:00.055451] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22918 [2024-09-11 16:05:00.158830] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:00.171676] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:05:00.171831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:00.177609] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041900177607, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007522, add_bytes: 0 [2024-09-11 16:05:00.177645] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:05:00.182074] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:05:00.184371] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726041900184368, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:05:00.184393] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=21] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:05:00.232343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:00.232382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:00.232389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:00.232396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:00.235720] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:00.252377] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22918, magic:0x78563412 [2024-09-11 16:05:00.252418] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:00.252426] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:00.371971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:00.432630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:00.432675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:00.432683] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:00.432692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:00.572167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:00.632951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:00.632997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:00.633005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:00.633015] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:00.654255] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:00.654301] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22928 [2024-09-11 16:05:00.772298] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:00.833231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:00.833274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:00.833280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:00.833287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:00.852749] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22928, magic:0x78563412 [2024-09-11 16:05:00.852792] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:00.852815] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:00.972503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:01.033523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:01.033573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:01.033581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:01.033590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:01.042432] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8828, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:05:01.159659] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=111] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:01.172626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:01.185234] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041901185230, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:05:01.192000] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=5] PNIO [ratelimit] time: 1726041901191996, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:05:01.235956] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:01.242698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:01.242736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:01.242744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:01.242753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:01.254531] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:01.254568] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22932 [2024-09-11 16:05:01.326114] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:01.326173] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=58] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:01.326253] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=92, max_check_version=93, global_version=94) [2024-09-11 16:05:01.328349] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2095 [2024-09-11 16:05:01.328411] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:01.328447] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:05:01.328485] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:05:01.328569] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:01.328676] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:05:01.328728] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:05:01.328740] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:05:01.328751] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:05:01.328788] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:05:01.328852] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:05:01.328867] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:05:01.372765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:01.443002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:01.443042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:01.443050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:01.443060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:01.453047] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22932, magic:0x78563412 [2024-09-11 16:05:01.453086] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:01.453094] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:01.572918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:01.643295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:01.643349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:01.643357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:01.643367] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:01.773067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:01.843591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:01.843636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:01.843644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:01.843653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:01.854825] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:01.854860] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22936 [2024-09-11 16:05:01.976586] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3369, replace_start_pos=4900000, replace_num=100000) [2024-09-11 16:05:01.976632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:02.043885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:02.043956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:02.043967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:02.043980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:02.052611] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22936, magic:0x78563412 [2024-09-11 16:05:02.052652] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:02.052659] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:02.160457] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:02.176725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:02.192845] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041902192842, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:05:02.199602] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041902199601, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:05:02.236072] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:02.244207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:02.244264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:02.244272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:02.244280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:02.376926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:02.444534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:02.444578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:02.444585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:02.444592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:02.454333] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:02.454374] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22938 [2024-09-11 16:05:02.577062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:02.644795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:02.644831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:02.644838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:02.644845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:02.652816] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22938, magic:0x78563412 [2024-09-11 16:05:02.652852] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:02.652858] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:02.777200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:02.845061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:02.845104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:02.845125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:02.845133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:02.977337] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:03.045349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:03.045392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:03.045414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:03.045422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:03.052085] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6651, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:05:03.055341] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:03.055370] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22948 [2024-09-11 16:05:03.161809] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:03.177558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:03.200476] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041903200473, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:05:03.207239] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726041903207235, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:05:03.236216] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:03.252332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:03.252369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:03.252375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:03.252383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:03.253407] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22948, magic:0x78563412 [2024-09-11 16:05:03.253435] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:03.253442] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:03.377737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:03.452598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:03.452640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:03.452647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:03.452654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:03.577974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:03.652879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:03.652941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:03.652949] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:03.652958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:03.655730] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:03.655765] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22958 [2024-09-11 16:05:03.778164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:03.853246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:03.853293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:03.853301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:03.853310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:03.853825] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22958, magic:0x78563412 [2024-09-11 16:05:03.853856] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:03.853884] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:03.978361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:04.053544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:04.053580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:04.053588] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:04.053597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:04.163255] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:04.182959] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4400, replace_start_pos=5000000, replace_num=100000) [2024-09-11 16:05:04.183011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:04.208088] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041904208084, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:05:04.214847] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726041904214843, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:05:04.236343] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:04.253814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:04.253857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:04.253863] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:04.253870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:04.256011] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:04.256044] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22962 [2024-09-11 16:05:04.383164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:04.454079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:04.454088] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22962, magic:0x78563412 [2024-09-11 16:05:04.454116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:04.454132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:04.454135] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:04.454155] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:04.454154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:04.583358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:04.654436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:04.654488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:04.654496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:04.654507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:04.783547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:04.854748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:04.854793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:04.854800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:04.854809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:04.855012] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:04.855047] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:22964 [2024-09-11 16:05:04.983738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:05.053582] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:22964, magic:0x78563412 [2024-09-11 16:05:05.053626] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:05.053649] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:05.055055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:05.055090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:05.055097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:05.055106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:05.062233] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7112, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:05:05.164655] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:05.183927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:05.215765] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041905215761, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:05:05.222458] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041905222455, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:05:05.236547] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:05.262574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:05.262618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:05.262625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:05.262634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:05.384057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:05.456082] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:05.456123] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28850 [2024-09-11 16:05:05.463056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:05.463096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:05.463105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:05.463116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:05.584246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:05.654443] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28850, magic:0x78563412 [2024-09-11 16:05:05.654485] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:05.654493] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:05.663350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:05.663392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:05.663399] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:05.663408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:05.784447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:05.863647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:05.863693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:05.863700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:05.863709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:05.984630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:06.056886] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:06.056947] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28854 [2024-09-11 16:05:06.063969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:06.064008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:06.064015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:06.064025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:06.166027] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:06.184821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:06.223375] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041906223370, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:05:06.230136] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041906230131, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:05:06.236711] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:06.254854] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28854, magic:0x78563412 [2024-09-11 16:05:06.254890] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:06.254897] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:06.264288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:06.264330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:06.264337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:06.264345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:06.389407] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4391, replace_start_pos=5100000, replace_num=100000) [2024-09-11 16:05:06.389457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:06.464564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:06.464607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:06.464613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:06.464621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:06.589606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:06.655708] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:06.655743] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28858 [2024-09-11 16:05:06.664861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:06.664898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:06.664945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:06.664953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:06.789789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:06.854272] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28858, magic:0x78563412 [2024-09-11 16:05:06.854315] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:06.854323] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:06.865183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:06.865230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:06.865238] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:06.865247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:06.989919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:07.065489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:07.065542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:07.065550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:07.065560] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:07.073205] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7632, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:05:07.167273] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:07.190128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:07.230949] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726041907230944, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 16:05:07.236855] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:07.237704] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726041907237701, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:05:07.256426] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:07.256471] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28868 [2024-09-11 16:05:07.273457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:07.273498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:07.273505] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:07.273514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:07.390241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:07.454629] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28868, magic:0x78563412 [2024-09-11 16:05:07.454665] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:07.454673] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:07.473755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:07.473799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:07.473806] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:07.473815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:07.590362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:07.674082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:07.674130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:07.674141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:07.674150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:07.790471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:07.856859] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:07.856897] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28882 [2024-09-11 16:05:07.874463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:07.874501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:07.874508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:07.874517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:07.990607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:08.055026] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28882, magic:0x78563412 [2024-09-11 16:05:08.055054] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:08.055061] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:08.074773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:08.074811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:08.074818] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:08.074827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:08.168160] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:08.190736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:08.236983] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:08.238611] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041908238608, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:05:08.245310] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041908245306, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:05:08.275064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:08.275113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:08.275122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:08.275132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:08.390854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:08.456980] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:08.457009] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28894 [2024-09-11 16:05:08.475393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:08.475430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:08.475438] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:08.475447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:08.595068] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4085, replace_start_pos=5200000, replace_num=100000) [2024-09-11 16:05:08.595110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:08.655464] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28894, magic:0x78563412 [2024-09-11 16:05:08.655509] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:08.655517] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:08.675671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:08.675717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:08.675724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:08.675734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:08.795193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:08.876083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:08.876147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:08.876157] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:08.876166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:08.995315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:09.057484] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:09.057524] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28904 [2024-09-11 16:05:09.076412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:09.076449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:09.076456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:09.076464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:09.083369] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6893, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:05:09.169202] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:09.195428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:09.237133] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:09.246219] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041909246215, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:05:09.252950] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041909252946, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 16:05:09.255964] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28904, magic:0x78563412 [2024-09-11 16:05:09.255999] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:09.256007] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:09.283634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:09.283681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:09.283688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:09.283697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:09.395610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:09.483957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:09.484003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:09.484009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:09.484017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:09.595742] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:09.657547] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:09.657590] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28918 [2024-09-11 16:05:09.684256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:09.684292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:09.684299] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:09.684307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:09.795866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:09.856438] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28918, magic:0x78563412 [2024-09-11 16:05:09.856492] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:09.856503] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:09.884531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:09.884576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:09.884599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:09.884608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:09.996023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:10.084838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:10.084884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:10.084892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:10.084916] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:10.169984] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:10.196162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:10.237274] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:10.253843] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041910253839, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:05:10.260540] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041910260535, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007589, add_bytes: 0 [2024-09-11 16:05:10.261107] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:10.261140] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28932 [2024-09-11 16:05:10.285162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:10.285207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:10.285215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:10.285224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:10.396360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:10.456043] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28932, magic:0x78563412 [2024-09-11 16:05:10.456080] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:10.456089] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:10.485446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:10.485490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:10.485514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:10.485522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:10.596483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:10.685749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:10.685797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:10.685805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:10.685814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:10.801045] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4391, replace_start_pos=5300000, replace_num=100000) [2024-09-11 16:05:10.801094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:10.856646] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:10.856691] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28944 [2024-09-11 16:05:10.886081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:10.886131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:10.886138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:10.886146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:11.001247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:11.055177] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28944, magic:0x78563412 [2024-09-11 16:05:11.055240] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:11.055249] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:11.086372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:11.086418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:11.086425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:11.086434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:11.093687] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7240, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:05:11.170870] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:11.201427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:11.237442] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:11.261454] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041911261451, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:05:11.268153] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041911268149, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:05:11.293954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:11.293998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:11.294005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:11.294014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:11.342015] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:11.342063] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:11.342138] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=93, max_check_version=94, global_version=95) [2024-09-11 16:05:11.343837] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1699 [2024-09-11 16:05:11.343891] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:11.343934] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:05:11.343968] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:05:11.344042] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:11.344125] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:05:11.344175] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:05:11.344184] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:05:11.344193] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:05:11.344224] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:05:11.344272] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:05:11.344289] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:05:11.401546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:11.457292] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:11.457340] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28952 [2024-09-11 16:05:11.494244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:11.494288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:11.494295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:11.494303] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:11.601726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:11.655764] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28952, magic:0x78563412 [2024-09-11 16:05:11.655806] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:11.655813] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:11.694513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:11.694556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:11.694562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:11.694569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:11.801928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:11.894799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:11.894856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:11.894864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:11.894873] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:12.002115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:12.057464] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:12.057510] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28958 [2024-09-11 16:05:12.095099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:12.095158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:12.095166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:12.095177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:12.171666] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:12.202250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:12.237575] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:12.256127] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28958, magic:0x78563412 [2024-09-11 16:05:12.256168] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:12.256177] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:12.269003] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041912268998, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:05:12.275868] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041912275865, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007716, add_bytes: 0 [2024-09-11 16:05:12.295462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:12.295510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:12.295518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:12.295527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:12.402435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:12.495849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:12.495890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:12.495898] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:12.495925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:12.602635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:12.658568] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:12.658614] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28970 [2024-09-11 16:05:12.696230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:12.696276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:12.696285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:12.696295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:12.802766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:12.856733] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28970, magic:0x78563412 [2024-09-11 16:05:12.856776] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:12.856784] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:12.896607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:12.896662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:12.896671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:12.896703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:13.007314] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4368, replace_start_pos=5400000, replace_num=100000) [2024-09-11 16:05:13.007362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:13.097042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:13.097088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:13.097097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:13.097106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:13.105157] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8037, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:05:13.172473] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:13.207510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:13.237723] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:13.258813] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:13.258865] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28974 [2024-09-11 16:05:13.276618] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041913276614, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:05:13.283398] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041913283394, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007529, add_bytes: 0 [2024-09-11 16:05:13.305529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:13.305573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:13.305581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:13.305590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:13.407694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:13.457154] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28974, magic:0x78563412 [2024-09-11 16:05:13.457196] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:13.457205] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:13.505926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:13.505973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:13.505981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:13.505991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:13.607882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:13.706305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:13.706347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:13.706355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:13.706365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:13.808085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:13.858223] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:13.858268] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28984 [2024-09-11 16:05:13.906671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:13.906717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:13.906725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:13.906734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:14.008266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:14.056396] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28984, magic:0x78563412 [2024-09-11 16:05:14.056450] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:14.056458] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:14.107071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:14.107119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:14.107127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:14.107137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:14.173254] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:14.208456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:14.237924] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:14.284230] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041914284226, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:05:14.291058] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041914291055, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 16:05:14.307454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:14.307497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:14.307504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:14.307513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:14.408586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:14.459333] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:14.459378] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:28992 [2024-09-11 16:05:14.507817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:14.507865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:14.507873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:14.507883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:14.508120] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=83, refresh_score_time=85, wash_time=0) [2024-09-11 16:05:14.608725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:14.656859] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:28992, magic:0x78563412 [2024-09-11 16:05:14.656932] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:14.656952] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:14.708424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:14.708469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:14.708477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:14.708487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:14.808873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:14.908792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:14.908838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:14.908846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:14.908855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:15.009060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:15.058561] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:15.058605] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29004 [2024-09-11 16:05:15.109163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:15.109206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:15.109214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:15.109244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:15.117485] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8225, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:05:15.174036] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:15.213654] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4416, replace_start_pos=5500000, replace_num=100000) [2024-09-11 16:05:15.213725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:15.238168] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:15.257163] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29004, magic:0x78563412 [2024-09-11 16:05:15.257206] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:15.257214] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:15.291852] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041915291847, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:05:15.298615] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041915298611, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:05:15.317759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:15.317805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:15.317813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:15.317821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:15.413882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:15.518073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:15.518120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:15.518128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:15.518137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:15.614033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:15.659157] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:15.659202] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8162 [2024-09-11 16:05:15.718366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:15.718401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:15.718409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:15.718418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:15.814144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:15.857657] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8162, magic:0x78563412 [2024-09-11 16:05:15.857686] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:15.857692] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:15.918661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:15.918707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:15.918715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:15.918724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:16.014319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:16.119021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:16.119065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:16.119073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:16.119082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:16.174872] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:16.214530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:16.238368] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:16.258601] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:16.258637] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8166 [2024-09-11 16:05:16.299459] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726041916299455, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:05:16.306232] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041916306230, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:05:16.319398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:16.319426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:16.319434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:16.319442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:16.414724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:16.457036] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8166, magic:0x78563412 [2024-09-11 16:05:16.457072] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:16.457080] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:16.519639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:16.519670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:16.519676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:16.519683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:16.614829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:16.719990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:16.720029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:16.720037] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:16.720047] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:16.814987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:16.859035] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:16.859103] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8174 [2024-09-11 16:05:16.920345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:16.920384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:16.920393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:16.920404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:17.015163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:17.056442] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8174, magic:0x78563412 [2024-09-11 16:05:17.056474] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:17.056482] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:17.120844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:17.120947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=101][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:17.120967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:17.120988] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:17.128188] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7177, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:05:17.175625] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:17.215384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:17.238529] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:17.307142] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041917307139, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:05:17.313913] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726041917313899, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:05:17.328486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:17.328519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:17.328541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:17.328550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:17.419711] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4183, replace_start_pos=5600000, replace_num=100000) [2024-09-11 16:05:17.419751] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:17.458668] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:17.458709] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8188 [2024-09-11 16:05:17.528780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:17.528814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:17.528822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:17.528831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:17.619841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:17.656929] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8188, magic:0x78563412 [2024-09-11 16:05:17.656966] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:17.656974] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:17.729067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:17.729113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:17.729120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:17.729129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:17.819956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:17.929375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:17.929419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:17.929427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:17.929436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:18.020137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:18.058967] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:18.059005] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8200 [2024-09-11 16:05:18.129722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:18.129761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:18.129769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:18.129778] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:18.176402] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:18.220329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:18.238755] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:18.257550] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8200, magic:0x78563412 [2024-09-11 16:05:18.257581] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:18.257589] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:18.314803] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041918314798, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007659, add_bytes: 0 [2024-09-11 16:05:18.321540] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041918321538, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 16:05:18.330028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:18.330055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:18.330062] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:18.330071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:18.420448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:18.530389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:18.530433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:18.530441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:18.530450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:18.620555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:18.659431] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:18.659464] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8212 [2024-09-11 16:05:18.730674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:18.730714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:18.730722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:18.730731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:18.820671] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:18.857929] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8212, magic:0x78563412 [2024-09-11 16:05:18.857953] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:18.857960] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:18.930974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:18.931004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:18.931026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:18.931034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:19.020824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:19.131218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:19.131258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:19.131266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:19.131274] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:19.139474] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8187, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:05:19.177555] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:19.221008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:19.238897] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:19.259094] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:19.259132] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8228 [2024-09-11 16:05:19.322331] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041919322328, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 16:05:19.329089] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041919329084, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:05:19.339719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:19.339758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:19.339766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:19.339775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:19.421191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:19.457838] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8228, magic:0x78563412 [2024-09-11 16:05:19.457874] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:19.457882] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:19.540028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:19.540073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:19.540080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:19.540089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:19.625714] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4332, replace_start_pos=5700000, replace_num=100000) [2024-09-11 16:05:19.625763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:19.740322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:19.740367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:19.740375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:19.740384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:19.825925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:19.858691] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:19.858733] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8244 [2024-09-11 16:05:19.940620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:19.940656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:19.940664] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:19.940672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:20.026109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:20.057206] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8244, magic:0x78563412 [2024-09-11 16:05:20.057239] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:20.057246] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:20.140954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:20.140994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:20.141002] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:20.141011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:20.178407] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:20.226292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:20.239042] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:20.329942] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041920329937, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:05:20.336703] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041920336700, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:05:20.341241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:20.341280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:20.341288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:20.341298] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:20.426469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:20.458742] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:20.458777] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8252 [2024-09-11 16:05:20.541522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:20.541556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:20.541562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:20.541570] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:20.626649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:20.657699] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8252, magic:0x78563412 [2024-09-11 16:05:20.657732] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:20.657739] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:20.741811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:20.741841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:20.741846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:20.741855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:20.826956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:20.942076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:20.942126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:20.942133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:20.942142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:21.027075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:21.060247] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:21.060287] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8258 [2024-09-11 16:05:21.142368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:21.142414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:21.142439] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:21.142449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:21.150957] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8493, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:05:21.179189] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:21.227316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:21.239247] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:21.258583] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8258, magic:0x78563412 [2024-09-11 16:05:21.258619] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:21.258627] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:21.337547] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041921337543, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:05:21.344308] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041921344307, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:05:21.351225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:21.351260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:21.351268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:21.351277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:21.358062] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:21.358100] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:21.358169] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=94, max_check_version=95, global_version=96) [2024-09-11 16:05:21.359965] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1795 [2024-09-11 16:05:21.360021] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=44] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:21.360054] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:05:21.360086] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:05:21.360159] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:21.360243] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:05:21.360287] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:05:21.360297] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:05:21.360305] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:05:21.360336] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:05:21.360384] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:05:21.360401] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:05:21.427472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:21.551583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:21.551622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:21.551630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:21.551639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:21.627662] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:21.660653] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:21.660698] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8262 [2024-09-11 16:05:21.751879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:21.751943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:21.751950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:21.751960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:21.832102] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4314, replace_start_pos=5800000, replace_num=100000) [2024-09-11 16:05:21.832149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:21.859317] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8262, magic:0x78563412 [2024-09-11 16:05:21.859358] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:21.859365] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:21.952200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:21.952242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:21.952249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:21.952259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:22.032250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:22.152576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:22.152622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:22.152630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:22.152638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:22.180477] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:22.232436] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:22.239426] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:22.261004] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:22.261049] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8272 [2024-09-11 16:05:22.345159] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041922345155, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:05:22.351928] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726041922351926, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:05:22.352954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:22.352983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:22.352990] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:22.353000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:22.432632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:22.458552] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8272, magic:0x78563412 [2024-09-11 16:05:22.458591] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:22.458616] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:22.553230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:22.553273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:22.553281] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:22.553290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:22.632813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:22.753588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:22.753631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:22.753639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:22.753649] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:22.832941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:22.860403] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:22.860444] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8274 [2024-09-11 16:05:22.953879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:22.953943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:22.953951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:22.953960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:23.033071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:23.059127] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8274, magic:0x78563412 [2024-09-11 16:05:23.059172] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:23.059180] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:23.154261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:23.154308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:23.154316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:23.154325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:23.162599] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8260, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:05:23.181560] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:23.233273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:23.239610] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:23.352777] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041923352773, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:05:23.359535] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041923359532, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:05:23.362976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:23.363009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:23.363017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:23.363025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:23.433464] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:23.461157] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:23.461200] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8284 [2024-09-11 16:05:23.563321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:23.563363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:23.563371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:23.563381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:23.633655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:23.659427] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8284, magic:0x78563412 [2024-09-11 16:05:23.659469] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:23.659476] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:23.763634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:23.763680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:23.763687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:23.763696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:23.833841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:23.964017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:23.964059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:23.964066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:23.964077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:24.038418] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4386, replace_start_pos=5900000, replace_num=100000) [2024-09-11 16:05:24.038465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:24.061520] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:24.061564] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8298 [2024-09-11 16:05:24.164388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:24.164435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:24.164443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:24.164452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:24.182522] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:24.238560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:24.239722] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:24.260041] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8298, magic:0x78563412 [2024-09-11 16:05:24.260081] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:24.260089] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:24.360398] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041924360394, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:05:24.364746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:24.364780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:24.364788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:24.364797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:24.367167] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041924367166, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:05:24.438694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:24.565096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:24.565144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:24.565152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:24.565161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:24.638888] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:24.662366] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:24.662411] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8306 [2024-09-11 16:05:24.765458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:24.765504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:24.765512] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:24.765522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:24.839042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=79] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:24.860716] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8306, magic:0x78563412 [2024-09-11 16:05:24.860758] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:24.860765] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:24.965761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:24.965806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:24.965814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:24.965823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:25.039243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:25.166044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:25.166089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:25.166096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:25.166103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:25.172660] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6543, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:05:25.183601] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:25.239382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:25.239833] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:25.262430] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:25.262475] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:8318 [2024-09-11 16:05:25.368008] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041925368005, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:05:25.372960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:25.372992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:25.372998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:25.373007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:25.373167] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:05:25.374831] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726041925374829, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:05:25.439525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:25.461051] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:8318, magic:0x78563412 [2024-09-11 16:05:25.461085] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:25.461091] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:25.573486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:25.573532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:25.573539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:25.573548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:25.639651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:25.773784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:25.773833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:25.773857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:25.773866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:25.839826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:25.862046] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:25.862090] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14018 [2024-09-11 16:05:25.974101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:25.974145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:25.974153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:25.974163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:26.040009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:26.060507] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14018, magic:0x78563412 [2024-09-11 16:05:26.060549] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:26.060556] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:26.174398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:26.174441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:26.174449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:26.174458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:26.184616] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:26.239941] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=18] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:26.244531] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4396, replace_start_pos=6000000, replace_num=100000) [2024-09-11 16:05:26.244575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:26.374688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:26.374731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:26.374755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:26.374764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:26.375623] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041926375621, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:05:26.382382] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726041926382380, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:05:26.444725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:26.462995] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:26.463038] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14024 [2024-09-11 16:05:26.575020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:26.575062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:26.575070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:26.575079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:26.644934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:26.661342] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14024, magic:0x78563412 [2024-09-11 16:05:26.661384] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:26.661392] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:26.775326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:26.775381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:26.775390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:26.775420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:26.845061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:26.975738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:26.975785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:26.975793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:26.975803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:27.045249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:27.062028] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:27.062073] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14028 [2024-09-11 16:05:27.176046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:27.176086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:27.176092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:27.176099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:27.182632] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6519, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:05:27.185577] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:27.240084] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:27.245377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:27.260555] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14028, magic:0x78563412 [2024-09-11 16:05:27.260597] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:27.260605] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:27.382877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:27.382939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:27.382946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:27.382970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:27.383240] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041927383239, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:05:27.390015] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726041927390013, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:05:27.445492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:27.583208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:27.583259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:27.583265] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:27.583273] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:27.645674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:27.662971] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:27.663016] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14034 [2024-09-11 16:05:27.783495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:27.783538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:27.783546] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:27.783555] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:27.845860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:27.861184] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14034, magic:0x78563412 [2024-09-11 16:05:27.861223] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:27.861245] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:27.983854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:27.983899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:27.983934] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:27.983944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:28.046024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:28.184163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:28.184199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:28.184205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:28.184213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:28.186480] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:28.240220] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:28.246213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:28.266517] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:28.266562] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14038 [2024-09-11 16:05:28.384503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:28.384547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:28.384555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:28.384565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:28.390863] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726041928390860, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:05:28.397718] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041928397715, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007702, add_bytes: 0 [2024-09-11 16:05:28.450734] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4337, replace_start_pos=6100000, replace_num=100000) [2024-09-11 16:05:28.450783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:28.461451] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14038, magic:0x78563412 [2024-09-11 16:05:28.461486] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:28.461492] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:28.584766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:28.584812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:28.584818] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:28.584825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:28.650988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:28.785054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:28.785098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:28.785105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:28.785113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:28.851127] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:28.863452] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:28.863481] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14044 [2024-09-11 16:05:28.985398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:28.985442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:28.985450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:28.985459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:29.051252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:29.061892] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14044, magic:0x78563412 [2024-09-11 16:05:29.061943] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:29.061950] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:29.185696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:29.185730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:29.185736] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:29.185744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:29.187424] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:29.192341] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6586, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:05:29.240373] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:29.251433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:29.392653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:29.392695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:29.392704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:29.392713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:29.398467] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726041929398465, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:05:29.405313] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041929405310, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 16:05:29.451616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:29.464371] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:29.464414] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14058 [2024-09-11 16:05:29.592981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:29.593025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:29.593050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:29.593059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:29.651815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:29.662698] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14058, magic:0x78563412 [2024-09-11 16:05:29.662741] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:29.662749] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:29.793271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:29.793313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:29.793323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:29.793331] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:29.852012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:29.993531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:29.993577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:29.993583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:29.993591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:30.052193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:30.063324] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:30.063381] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14074 [2024-09-11 16:05:30.188187] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:30.193834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:30.193874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:30.193881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:30.193890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:30.240500] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:30.252322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:30.261884] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14074, magic:0x78563412 [2024-09-11 16:05:30.261934] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:30.261942] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:30.394214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:30.394257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:30.394266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:30.394275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:30.406097] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041930406092, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:05:30.412849] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041930412847, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:05:30.452453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:30.594527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:30.594570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:30.594576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:30.594584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:30.656921] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4338, replace_start_pos=6200000, replace_num=100000) [2024-09-11 16:05:30.656991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:30.663858] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:30.663897] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14086 [2024-09-11 16:05:30.794830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:30.794870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:30.794878] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:30.794888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:30.857141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:30.862560] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14086, magic:0x78563412 [2024-09-11 16:05:30.862595] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:30.862602] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:30.995238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:30.995284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:30.995292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:30.995302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:31.057368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:31.188998] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:31.195592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:31.195629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:31.195638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:31.195647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:31.203516] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7856, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:05:31.240646] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:31.257559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:31.264658] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:31.264696] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14094 [2024-09-11 16:05:31.374627] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:31.374678] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:31.374764] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=95, max_check_version=96, global_version=97) [2024-09-11 16:05:31.376801] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2035 [2024-09-11 16:05:31.376844] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:31.376881] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:05:31.376933] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:05:31.377038] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:31.377157] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:05:31.377227] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:05:31.377238] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:05:31.377253] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:05:31.377289] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:05:31.377349] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:05:31.377370] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:05:31.403829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:31.403877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:31.403885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:31.403895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:31.413710] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041931413706, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:05:31.420471] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726041931420469, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:05:31.457746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:31.462926] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14094, magic:0x78563412 [2024-09-11 16:05:31.462956] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:31.462964] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:31.604213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:31.604260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:31.604269] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:31.604278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:31.657942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:31.804509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:31.804550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:31.804558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:31.804567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:31.858126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:31.863814] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:31.863853] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14108 [2024-09-11 16:05:32.004814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:32.004853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:32.004861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:32.004886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:32.058250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:32.062501] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14108, magic:0x78563412 [2024-09-11 16:05:32.062533] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:32.062541] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:32.189930] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:32.205116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:32.205161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:32.205169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:32.205178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:32.240782] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:32.258432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:32.405413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:32.405463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:32.405471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:32.405480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:32.421322] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041932421318, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:05:32.428089] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041932428086, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:05:32.458671] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:32.464626] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:32.464665] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14122 [2024-09-11 16:05:32.605706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:32.605749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:32.605755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:32.605778] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:32.658857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:32.663002] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14122, magic:0x78563412 [2024-09-11 16:05:32.663032] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:32.663039] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:32.806106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:32.806161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:32.806170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:32.806179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:32.863438] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4447, replace_start_pos=6300000, replace_num=100000) [2024-09-11 16:05:32.863486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:33.006469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:33.006506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:33.006514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:33.006525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:33.063586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:33.068075] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:33.068121] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14128 [2024-09-11 16:05:33.190792] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:33.206816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:33.206860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:33.206868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:33.206878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:33.214459] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7527, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:05:33.240984] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:33.263448] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14128, magic:0x78563412 [2024-09-11 16:05:33.263483] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:33.263491] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:33.263732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:33.414781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:33.414825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:33.414833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:33.414842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:33.428947] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726041933428943, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:05:33.435703] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041933435700, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:05:33.463919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:33.615141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:33.615182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:33.615190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:33.615200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:33.664056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:33.665147] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:33.665182] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14134 [2024-09-11 16:05:33.815521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:33.815572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:33.815580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:33.815589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:33.863708] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14134, magic:0x78563412 [2024-09-11 16:05:33.863749] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:33.863757] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:33.864262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:34.015971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:34.016016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:34.016026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:34.016040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:34.064368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:34.191695] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:34.216271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:34.216312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:34.216319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:34.216328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:34.241106] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:34.264542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:34.265752] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:34.265784] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14144 [2024-09-11 16:05:34.416561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:34.416607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:34.416615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:34.416624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:34.436576] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041934436572, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:05:34.443330] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041934443326, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:05:34.464345] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14144, magic:0x78563412 [2024-09-11 16:05:34.464388] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:34.464396] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:34.464704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=87] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:34.616945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:34.616999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:34.617007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:34.617016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:34.664805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:34.817321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:34.817365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:34.817391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:34.817402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:34.817620] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=98, refresh_score_time=63, wash_time=0) [2024-09-11 16:05:34.864985] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:34.866429] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:34.866458] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14158 [2024-09-11 16:05:35.017938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:35.017982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:35.017989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:35.017998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:35.064666] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14158, magic:0x78563412 [2024-09-11 16:05:35.064708] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:35.064717] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:35.069472] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4365, replace_start_pos=6400000, replace_num=100000) [2024-09-11 16:05:35.069508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:35.192593] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:35.218293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:35.218331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:35.218339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:35.218349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:35.225860] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7497, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:05:35.241310] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:35.269594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:35.426177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:35.426219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:35.426228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:35.426237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:35.444180] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041935444177, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:05:35.450943] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041935450939, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:05:35.466739] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:35.466782] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45374 [2024-09-11 16:05:35.469806] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:35.626485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:35.626528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:35.626535] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:35.626545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:35.665180] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45374, magic:0x78563412 [2024-09-11 16:05:35.665218] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:35.665225] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:35.669928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:35.826776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:35.826833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:35.826842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:35.826852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:35.870042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:36.027094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:36.027138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:36.027145] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:36.027155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:36.067568] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:36.067615] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45382 [2024-09-11 16:05:36.070223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:36.193329] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:36.227459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:36.227497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:36.227505] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:36.227514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:36.241534] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:36.265847] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45382, magic:0x78563412 [2024-09-11 16:05:36.265888] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:36.265895] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:36.270342] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:36.427806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:36.427848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:36.427878] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:36.427889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:36.451790] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041936451785, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:05:36.458618] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041936458613, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:05:36.470472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:36.628207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:36.628249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:36.628257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:36.628268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:36.667707] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:36.667741] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45394 [2024-09-11 16:05:36.671271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:36.828497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:36.828537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:36.828544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:36.828554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:36.865106] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45394, magic:0x78563412 [2024-09-11 16:05:36.865137] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:36.865159] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:36.871356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:37.028888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:37.028952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:37.028960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:37.028970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:37.071452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:37.194250] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:37.229213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:37.229252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:37.229260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:37.229269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:37.237030] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7747, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:05:37.241738] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:37.267874] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:37.267934] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45404 [2024-09-11 16:05:37.275855] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4286, replace_start_pos=6500000, replace_num=100000) [2024-09-11 16:05:37.275890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:37.437347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:37.437406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:37.437436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:37.437447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:37.459417] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041937459413, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:05:37.465623] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45404, magic:0x78563412 [2024-09-11 16:05:37.465664] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:37.465672] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:37.466162] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041937466159, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:05:37.475994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:37.637741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:37.637785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:37.637793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:37.637802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:37.676167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:37.838098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:37.838142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:37.838151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:37.838160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:37.867555] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:37.867602] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45418 [2024-09-11 16:05:37.876289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:38.038460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:38.038530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:38.038538] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:38.038548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:38.065944] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45418, magic:0x78563412 [2024-09-11 16:05:38.065985] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:38.065992] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:38.076401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:38.195203] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:38.238870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:38.238935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:38.238944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:38.238954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:38.241918] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:38.276579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:38.439276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:38.439320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:38.439328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:38.439338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:38.467030] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726041938467027, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:05:38.468607] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:38.468642] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45432 [2024-09-11 16:05:38.473774] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041938473771, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:05:38.476787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:38.639651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:38.639714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:38.639723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:38.639733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:38.666749] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45432, magic:0x78563412 [2024-09-11 16:05:38.666790] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:38.666798] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:38.676956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:38.840057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:38.840101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:38.840110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:38.840120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:38.877148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:39.040422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:39.040469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:39.040477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:39.040487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:39.068440] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:39.068483] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45436 [2024-09-11 16:05:39.077271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:39.196363] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:39.240778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:39.240821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:39.240829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:39.240855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:39.242050] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:39.249122] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8253, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:05:39.267006] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45436, magic:0x78563412 [2024-09-11 16:05:39.267043] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:39.267049] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:39.277433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:39.449443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:39.449483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:39.449491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:39.449500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:39.474698] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041939474693, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:05:39.481394] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726041939481390, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:05:39.481913] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4310, replace_start_pos=6600000, replace_num=100000) [2024-09-11 16:05:39.481949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:39.649798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:39.649843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:39.649851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:39.649885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:39.668957] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:39.669001] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45444 [2024-09-11 16:05:39.682100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:39.850193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:39.850235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:39.850243] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:39.850252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:39.867405] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45444, magic:0x78563412 [2024-09-11 16:05:39.867446] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:39.867455] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:39.882283] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:40.050487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:40.050530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:40.050538] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:40.050547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:40.082464] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:40.197381] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:40.242214] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:40.250842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:40.250886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:40.250893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:40.250928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:40.269826] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:40.269873] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45446 [2024-09-11 16:05:40.282699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:40.451252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:40.451294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:40.451302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:40.451311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:40.468268] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45446, magic:0x78563412 [2024-09-11 16:05:40.468306] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:40.468313] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:40.482253] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041940482249, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:05:40.482831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:40.489007] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041940489004, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:05:40.651545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:40.651584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:40.651591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:40.651600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:40.683019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:40.851846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:40.851889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:40.851897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:40.851932] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:40.870277] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:40.870320] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45462 [2024-09-11 16:05:40.883228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:41.052165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:41.052210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:41.052218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:41.052228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:41.068544] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45462, magic:0x78563412 [2024-09-11 16:05:41.068580] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:41.068587] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:41.083365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:41.198298] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:41.242425] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:41.252573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:41.252614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:41.252621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:41.252629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:41.259220] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6580, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:05:41.283485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:41.390784] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:41.390835] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:41.390944] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=96, max_check_version=97, global_version=98) [2024-09-11 16:05:41.392971] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2027 [2024-09-11 16:05:41.393008] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:41.393042] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:05:41.393080] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:05:41.393164] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:41.393287] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:05:41.393338] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:05:41.393350] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:05:41.393361] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:05:41.393418] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:05:41.393478] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:05:41.393501] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:05:41.459528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:41.459570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:41.459578] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:41.459588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:41.470302] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:41.470343] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45478 [2024-09-11 16:05:41.483682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:41.489931] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041941489927, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:05:41.496633] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041941496628, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:05:41.659883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:41.659949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:41.659958] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:41.659968] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:41.669055] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45478, magic:0x78563412 [2024-09-11 16:05:41.669097] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:41.669104] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:41.688214] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4343, replace_start_pos=6700000, replace_num=100000) [2024-09-11 16:05:41.688262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:41.860262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:41.860307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:41.860315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:41.860324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:41.888411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:42.060560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:42.060604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:42.060612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:42.060622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:42.070825] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:42.070870] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45490 [2024-09-11 16:05:42.088531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:42.199419] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:42.242608] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:42.260875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:42.260956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:42.260966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:42.260976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:42.269769] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45490, magic:0x78563412 [2024-09-11 16:05:42.269802] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:42.269810] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:42.288696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:42.461285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:42.461343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:42.461358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:42.461368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:42.488877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:42.497546] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041942497542, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:05:42.504243] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1726041942504240, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:05:42.661605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:42.661646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:42.661654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:42.661663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:42.672176] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:42.672216] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45494 [2024-09-11 16:05:42.689100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:42.861998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:42.862042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:42.862050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:42.862060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:42.870347] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45494, magic:0x78563412 [2024-09-11 16:05:42.870389] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:42.870396] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:42.889290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:43.062360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:43.062405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:43.062412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:43.062423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:43.089425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:43.200328] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:43.242745] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:43.262724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:43.262766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:43.262774] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:43.262784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:43.270301] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7503, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:05:43.272785] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:43.272809] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45506 [2024-09-11 16:05:43.289550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:43.470648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:43.470694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:43.470702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:43.470711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:43.471183] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45506, magic:0x78563412 [2024-09-11 16:05:43.471214] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:43.471222] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:43.489736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:43.505091] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041943505087, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:05:43.511877] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041943511873, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:05:43.671052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:43.671097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:43.671105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:43.671115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:43.689948] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:43.871414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:43.871451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:43.871459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:43.871468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:43.873204] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:43.873231] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45514 [2024-09-11 16:05:43.894616] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4454, replace_start_pos=6800000, replace_num=100000) [2024-09-11 16:05:43.894663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:44.071719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:44.071779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:44.071781] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45514, magic:0x78563412 [2024-09-11 16:05:44.071788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:44.071812] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:44.071812] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:44.071819] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:44.094763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:44.201298] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:44.242864] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:44.272102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:44.272143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:44.272151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:44.272160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:44.294884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:44.472392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:44.472436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:44.472444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:44.472454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:44.474435] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:44.474465] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45530 [2024-09-11 16:05:44.495034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:44.512785] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041944512781, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007694, add_bytes: 0 [2024-09-11 16:05:44.519540] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041944519536, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:05:44.672656] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45530, magic:0x78563412 [2024-09-11 16:05:44.672701] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:44.672708] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:44.672790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:44.672821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:44.672828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:44.672838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:44.695150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:44.873072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:44.873132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:44.873140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:44.873168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:44.895277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:45.073399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:45.073512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=113][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:45.073519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:45.073527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:45.074791] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:45.074824] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45542 [2024-09-11 16:05:45.095392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:45.202193] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:45.243074] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:45.273213] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45542, magic:0x78563412 [2024-09-11 16:05:45.273253] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:45.273261] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:45.273745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:45.273777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:45.273784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:45.273793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:45.281703] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7897, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:05:45.295510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:45.481949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:45.482005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:45.482012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:45.482019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:45.495682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:45.520400] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041945520396, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:05:45.527106] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041945527102, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:05:45.675341] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:45.675383] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43968 [2024-09-11 16:05:45.682243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:45.682279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:45.682286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:45.682295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:45.695797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:45.873714] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43968, magic:0x78563412 [2024-09-11 16:05:45.873752] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:45.873760] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:45.882592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:45.882637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:45.882645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:45.882676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:45.895929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:46.082933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:46.082979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:46.082987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:46.082996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:46.100445] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4393, replace_start_pos=6900000, replace_num=100000) [2024-09-11 16:05:46.100495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:46.202929] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:46.243217] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:46.275377] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:46.275422] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43974 [2024-09-11 16:05:46.283290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:46.283326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:46.283334] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:46.283344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:46.300585] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:46.473125] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43974, magic:0x78563412 [2024-09-11 16:05:46.473167] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:46.473175] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:46.483568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:46.483602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:46.483609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:46.483634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:46.500700] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:46.527963] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041946527958, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:05:46.534771] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041946534767, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:05:46.683846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:46.683874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:46.683880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:46.683888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:46.700897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:46.884199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:46.884240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:46.884248] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:46.884257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:46.890223] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:46.890260] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43982 [2024-09-11 16:05:46.901025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:47.073338] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43982, magic:0x78563412 [2024-09-11 16:05:47.073395] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:47.073402] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:47.084483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:47.084517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:47.084523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:47.084532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:47.101140] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:47.243402] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:47.284762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:47.284805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:47.284814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:47.284823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:47.293333] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8496, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:05:47.301302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:47.303759] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:47.475129] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:47.475190] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43990 [2024-09-11 16:05:47.493600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:47.493634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:47.493641] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:47.493649] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:47.501418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:47.535574] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041947535569, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:05:47.542339] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041947542336, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007569, add_bytes: 0 [2024-09-11 16:05:47.673795] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43990, magic:0x78563412 [2024-09-11 16:05:47.673837] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:47.673845] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:47.693874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:47.693932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:47.693943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:47.693952] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:47.701533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:47.894174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:47.894211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:47.894217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:47.894226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:47.901614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:48.075537] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:48.075572] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44002 [2024-09-11 16:05:48.094455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:48.094486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:48.094492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:48.094518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:48.101709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:48.243516] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:48.274230] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44002, magic:0x78563412 [2024-09-11 16:05:48.274259] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:48.274267] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:48.294742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:48.294772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:48.294779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:48.294787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:48.304587] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:48.306131] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4302, replace_start_pos=7000000, replace_num=100000) [2024-09-11 16:05:48.306156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:48.495037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:48.495081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:48.495088] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:48.495097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:48.506232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:48.543197] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041948543193, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:05:48.549951] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726041948549948, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:05:48.676474] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:48.676515] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44004 [2024-09-11 16:05:48.695318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:48.695367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:48.695373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:48.695382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:48.706354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:48.874742] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44004, magic:0x78563412 [2024-09-11 16:05:48.874775] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:48.874781] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:48.895622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:48.895653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:48.895660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:48.895668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:48.906472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:49.096008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:49.096050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:49.096057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:49.096066] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:49.106652] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:49.243709] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:49.274770] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:49.274815] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44010 [2024-09-11 16:05:49.296301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:49.296346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:49.296353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:49.296363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:49.304253] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7877, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:05:49.305679] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:49.306872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:49.473024] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44010, magic:0x78563412 [2024-09-11 16:05:49.473064] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:49.473072] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:49.504506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:49.504548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:49.504555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:49.504564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:49.506994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:49.550812] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041949550807, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:05:49.557576] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041949557572, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:05:49.704798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:49.704840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:49.704848] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:49.704857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:49.707104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:49.874835] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:49.874880] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44022 [2024-09-11 16:05:49.905099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:49.905133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:49.905140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:49.905149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:49.907272] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:50.073582] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44022, magic:0x78563412 [2024-09-11 16:05:50.073619] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:50.073627] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:50.105399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:50.105443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:50.105451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:50.105460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:50.107377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:50.243949] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:50.305788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:50.305854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:50.305863] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:50.305872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:50.306829] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:50.307478] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:50.475692] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:50.475735] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44038 [2024-09-11 16:05:50.506099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:50.506133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:50.506140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:50.506149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:50.511953] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4372, replace_start_pos=7100000, replace_num=100000) [2024-09-11 16:05:50.511989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:50.558496] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041950558492, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:05:50.565255] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041950565252, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:05:50.674032] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44038, magic:0x78563412 [2024-09-11 16:05:50.674070] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:50.674077] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:50.706385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:50.706424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:50.706432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:50.706441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:50.712067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:50.906674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:50.906719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:50.906727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:50.906736] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:50.912256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:51.076185] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:51.076230] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44052 [2024-09-11 16:05:51.107041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:51.107089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:51.107096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:51.107106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:51.112363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:51.244092] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:51.274517] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44052, magic:0x78563412 [2024-09-11 16:05:51.274547] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:51.274553] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:51.307447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:51.307484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:51.307492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:51.307526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:51.307935] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:51.312473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:51.315273] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7734, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:05:51.407436] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:51.407484] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:05:51.407554] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] update_check_range(min_check_version=97, max_check_version=98, global_version=99) [2024-09-11 16:05:51.409303] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1748 [2024-09-11 16:05:51.409339] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:51.409370] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:05:51.409403] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:05:51.409477] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:05:51.409594] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:05:51.409639] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:05:51.409648] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:05:51.409657] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:05:51.409691] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:05:51.409739] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:05:51.409760] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:05:51.512588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:51.515516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:51.515543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:51.515551] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:51.515560] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:51.566038] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041951566034, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:05:51.572857] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041951572853, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:05:51.676152] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:51.676197] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44056 [2024-09-11 16:05:51.712703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:51.715802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:51.715837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:51.715846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:51.715857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:51.874809] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44056, magic:0x78563412 [2024-09-11 16:05:51.874853] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:51.874861] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:51.912838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:51.916081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:51.916112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:51.916119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:51.916128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:52.113018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:52.116426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:52.116461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:52.116469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:52.116479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:52.244206] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:52.277338] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:52.277370] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44058 [2024-09-11 16:05:52.309216] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:52.313212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:52.316800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:52.316855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:52.316864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:52.316874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:52.475369] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44058, magic:0x78563412 [2024-09-11 16:05:52.475417] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:52.475431] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:52.513325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:52.517171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:52.517207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:52.517215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:52.517224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:52.573717] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041952573713, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:05:52.580403] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041952580400, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:05:52.716926] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3410, replace_start_pos=7200000, replace_num=100000) [2024-09-11 16:05:52.716971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:52.717452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:52.717485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:52.717493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:52.717517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:52.878691] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:52.878734] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44074 [2024-09-11 16:05:52.917061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:52.917746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:52.917780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:52.917788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:52.917797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:53.075578] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44074, magic:0x78563412 [2024-09-11 16:05:53.075620] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:53.075627] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:53.117189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:53.118060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:53.118088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:53.118096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:53.118105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:53.244350] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:53.310526] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:53.317295] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:53.318333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:53.318361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:53.318368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:53.318378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:53.325679] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7273, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:05:53.479084] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:53.479129] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44088 [2024-09-11 16:05:53.517492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:53.526057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:53.526101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:53.526109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:53.526119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:53.581332] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041953581329, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:05:53.588096] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726041953588093, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:05:53.676152] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44088, magic:0x78563412 [2024-09-11 16:05:53.676193] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:53.676200] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:53.717611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:53.726420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:53.726459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:53.726467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:53.726477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:53.917722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:53.926730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:53.926769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:53.926777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:53.926786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:54.078243] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:54.078279] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44090 [2024-09-11 16:05:54.117928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:54.127037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:54.127078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:54.127084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:54.127093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:54.244523] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:54.276696] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44090, magic:0x78563412 [2024-09-11 16:05:54.276736] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:54.276744] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:54.311549] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:54.318106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:54.327317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:54.327358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:54.327366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:54.327374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:54.518284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:54.527681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:54.527727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:54.527735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:54.527744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:54.588881] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041954588877, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:05:54.595648] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726041954595644, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:05:54.678987] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:54.679028] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44094 [2024-09-11 16:05:54.718492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:54.727998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:54.728043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:54.728051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:54.728060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:54.877220] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44094, magic:0x78563412 [2024-09-11 16:05:54.877264] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:54.877271] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:54.923047] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4424, replace_start_pos=7300000, replace_num=100000) [2024-09-11 16:05:54.923087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:54.928289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:54.928318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:54.928325] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:54.928334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:55.123262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:55.128565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:55.128606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:55.128613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:55.128623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:55.128836] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=76, refresh_score_time=63, wash_time=0) [2024-09-11 16:05:55.244712] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:55.278188] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:55.278233] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44108 [2024-09-11 16:05:55.312392] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:55.323385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:55.329063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:55.329104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:55.329112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:55.329122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:55.336879] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7743, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:05:55.476289] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44108, magic:0x78563412 [2024-09-11 16:05:55.476331] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:55.476339] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:55.523497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:55.537150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:55.537194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:55.537202] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:55.537211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:55.537394] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:05:55.596500] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726041955596496, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:05:55.603333] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041955603330, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:05:55.723635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:55.737614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:55.737649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:55.737656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:55.737664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:55.878133] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:55.878172] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4862 [2024-09-11 16:05:55.923763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:55.937890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:55.937950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:55.937978] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:55.937987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:56.076663] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4862, magic:0x78563412 [2024-09-11 16:05:56.076705] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:56.076712] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:56.123956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:56.138208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:56.138252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:56.138261] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:56.138271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:56.244917] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:56.313345] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:56.324077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:56.338497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:56.338540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:56.338548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:56.338557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:56.479180] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:56.479225] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4872 [2024-09-11 16:05:56.524214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:56.538783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:56.538829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:56.538837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:56.538846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:56.604176] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041956604172, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:05:56.610896] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041956610892, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:05:56.677417] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4872, magic:0x78563412 [2024-09-11 16:05:56.677459] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:56.677468] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:56.724345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:56.739086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:56.739130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:56.739137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:56.739146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:56.924530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:56.939364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:56.939404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:56.939411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:56.939420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:57.079436] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:57.079481] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4878 [2024-09-11 16:05:57.128555] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3844, replace_start_pos=7400000, replace_num=100000) [2024-09-11 16:05:57.128620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:57.139658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:57.139700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:57.139707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:57.139716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:57.245114] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:57.277838] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4878, magic:0x78563412 [2024-09-11 16:05:57.277875] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:57.277883] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:57.314247] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=153] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:57.328765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:57.339954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:57.339994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:57.340001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:57.340010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:57.347185] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7162, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:05:57.528956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:57.547424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:57.547471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:57.547479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:57.547488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:57.611723] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041957611720, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:05:57.618488] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726041957618485, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:05:57.679463] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:57.679507] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4892 [2024-09-11 16:05:57.729155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:57.747781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:57.747828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:57.747836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:57.747846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:57.878072] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4892, magic:0x78563412 [2024-09-11 16:05:57.878112] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:57.878119] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:57.929346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:05:57.948139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:57.948185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:57.948193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:57.948202] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:58.129536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:05:58.148517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:58.148584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:58.148591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:58.148599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:58.245296] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:58.280215] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:58.280259] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4904 [2024-09-11 16:05:58.315329] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:58.329727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:05:58.348810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:58.348847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:58.348853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:58.348860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:58.478682] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4904, magic:0x78563412 [2024-09-11 16:05:58.478722] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:58.478730] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:58.529894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:05:58.549082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:58.549127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:58.549134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:58.549143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:58.619403] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726041958619400, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:05:58.626112] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041958626109, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:05:58.730101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:05:58.749453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:58.749517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:58.749526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:58.749536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:58.880381] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:58.880419] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4918 [2024-09-11 16:05:58.930219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:05:58.949835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:58.949877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:58.949885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:58.949894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:59.079017] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4918, magic:0x78563412 [2024-09-11 16:05:59.079058] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:59.079070] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=11][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:59.130336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:05:59.150268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:59.150309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:59.150317] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:59.150326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:59.245429] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:05:59.316591] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:05:59.333748] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3300, replace_start_pos=7500000, replace_num=100000) [2024-09-11 16:05:59.333789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:05:59.350587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:59.350651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:59.350660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:59.350669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:59.358244] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7562, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:05:59.481227] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:05:59.481271] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4922 [2024-09-11 16:05:59.533868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:05:59.558568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:59.558606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:59.558614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:59.558624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:59.627027] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041959627024, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:05:59.633727] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041959633724, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:05:59.679691] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4922, magic:0x78563412 [2024-09-11 16:05:59.679726] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:05:59.679733] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:05:59.734056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:05:59.758856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:59.758945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=88][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:59.758955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:59.758964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:05:59.934244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:05:59.959188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:05:59.959232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:05:59.959239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:05:59.959249] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:00.081875] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:00.081932] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4928 [2024-09-11 16:06:00.134379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:00.159475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:00.159517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:00.159525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:00.159534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:00.245550] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:00.280413] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4928, magic:0x78563412 [2024-09-11 16:06:00.280456] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:00.280478] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:00.317387] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:00.334559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:00.359756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:00.359801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:00.359827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:00.359836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:00.534781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:00.560061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:00.560106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:00.560113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:00.560122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:00.628690] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:06:00.634579] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041960634575, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:06:00.634622] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:06:00.639078] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:06:00.641344] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041960641341, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:06:00.641374] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:06:00.682065] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:00.682110] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4936 [2024-09-11 16:06:00.734978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:00.760357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:00.760403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:00.760411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:00.760436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:00.880501] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4936, magic:0x78563412 [2024-09-11 16:06:00.880543] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:00.880550] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:00.935181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:00.960663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:00.960704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:00.960712] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:00.960721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:01.135377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:01.160964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:01.161001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:01.161008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:01.161017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:01.245745] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:01.282156] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:01.282200] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4938 [2024-09-11 16:06:01.318243] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:01.335555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:01.361236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:01.361276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:01.361282] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:01.361290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:01.369514] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8200, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:06:01.425550] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:01.425589] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:01.425668] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=98, max_check_version=99, global_version=100) [2024-09-11 16:06:01.427686] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2017 [2024-09-11 16:06:01.427729] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:01.427764] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:06:01.427807] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:06:01.427920] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:01.428029] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:06:01.428081] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:06:01.428092] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:06:01.428106] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:06:01.428143] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:06:01.428203] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:06:01.428230] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:06:01.480957] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4938, magic:0x78563412 [2024-09-11 16:06:01.480998] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:01.481006] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:01.540064] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4336, replace_start_pos=7600000, replace_num=100000) [2024-09-11 16:06:01.540113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:01.569757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:01.569802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:01.569809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:01.569838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:01.642205] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726041961642202, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:06:01.648964] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726041961648960, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:06:01.740221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:01.770064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:01.770103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:01.770110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:01.770118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:01.882596] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:01.882636] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4950 [2024-09-11 16:06:01.940338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:01.970337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:01.970383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:01.970389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:01.970396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:02.080311] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4950, magic:0x78563412 [2024-09-11 16:06:02.080356] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:02.080363] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:02.140453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:02.170696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:02.170740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:02.170749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:02.170759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:02.245861] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:02.319031] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:02.340588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:02.371077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:02.371121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:02.371129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:02.371139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:02.481808] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:02.481854] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4952 [2024-09-11 16:06:02.540706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:02.571380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:02.571432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:02.571459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:02.571473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:02.649877] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726041962649873, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:06:02.656577] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041962656574, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:06:02.680702] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4952, magic:0x78563412 [2024-09-11 16:06:02.680743] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:02.680766] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:02.740819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:02.771814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:02.771858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:02.771866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:02.771875] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:02.940958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:02.972185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:02.972233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:02.972241] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:02.972252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:03.083151] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:03.083196] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4962 [2024-09-11 16:06:03.141087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:03.172551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:03.172597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:03.172605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:03.172615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:03.246002] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:03.281419] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4962, magic:0x78563412 [2024-09-11 16:06:03.281458] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:03.281466] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:03.319883] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:03.341206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:03.372950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:03.372997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:03.373006] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:03.373015] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:03.380233] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7204, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:06:03.541381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:03.580559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:03.580605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:03.580613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:03.580622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:03.657431] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041963657426, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:06:03.664185] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041963664181, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:06:03.683303] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:03.683350] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4968 [2024-09-11 16:06:03.745590] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4075, replace_start_pos=7700000, replace_num=100000) [2024-09-11 16:06:03.745636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:03.780947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:03.781013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:03.781021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:03.781031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:03.881894] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4968, magic:0x78563412 [2024-09-11 16:06:03.881945] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:03.881953] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:03.945781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:03.981278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:03.981326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:03.981335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:03.981344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:04.145895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:04.181645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:04.181692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:04.181700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:04.181710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:04.246121] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:04.283933] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:04.283990] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4982 [2024-09-11 16:06:04.321140] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=117] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:04.346041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:04.382035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:04.382078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:04.382086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:04.382113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:04.482327] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4982, magic:0x78563412 [2024-09-11 16:06:04.482378] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:04.482389] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:04.546225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:04.582416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:04.582461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:04.582469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:04.582478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:04.665034] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041964665030, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:06:04.671803] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041964671800, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:06:04.746353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:04.782722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:04.782759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:04.782766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:04.782776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:04.884480] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:04.884538] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:4988 [2024-09-11 16:06:04.946481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:04.983078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:04.983124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:04.983131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:04.983141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:05.082694] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:4988, magic:0x78563412 [2024-09-11 16:06:05.082731] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:05.082739] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:05.146610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:05.183401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:05.183445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:05.183453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:05.183463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:05.246242] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:05.322011] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:05.346799] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:05.383761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:05.383803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:05.383811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:05.383820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:05.391209] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7375, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:06:05.484726] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:05.484769] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45256 [2024-09-11 16:06:05.546949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:05.591475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:05.591515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:05.591523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:05.591532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:05.672649] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041965672645, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:06:05.679422] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041965679418, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:06:05.683065] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45256, magic:0x78563412 [2024-09-11 16:06:05.683090] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:05.683096] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:05.747064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:05.791771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:05.791813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:05.791821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:05.791830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:05.951621] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4380, replace_start_pos=7800000, replace_num=100000) [2024-09-11 16:06:05.951664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:05.992152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:05.992195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:05.992204] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:05.992213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:06.085348] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:06.085386] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45270 [2024-09-11 16:06:06.151779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:06.192533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:06.192576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:06.192584] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:06.192593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:06.246376] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:06.283616] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45270, magic:0x78563412 [2024-09-11 16:06:06.283646] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:06.283652] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:06.322873] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:06.351898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:06.392899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:06.392965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:06.392973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:06.392983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:06.552083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:06.593231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:06.593276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:06.593301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:06.593310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:06.680267] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041966680264, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:06:06.685579] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:06.685603] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45280 [2024-09-11 16:06:06.687031] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041966687029, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:06:06.752200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:06.793610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:06.793653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:06.793661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:06.793671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:06.884090] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45280, magic:0x78563412 [2024-09-11 16:06:06.884136] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:06.884144] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:06.952312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:06.993989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:06.994027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:06.994035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:06.994065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:07.152428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:07.194318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:07.194358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:07.194366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:07.194375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:07.246502] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:07.286421] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:07.286467] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45296 [2024-09-11 16:06:07.323786] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:07.352672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:07.394615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:07.394662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:07.394669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:07.394679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:07.402348] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7656, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:06:07.484760] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45296, magic:0x78563412 [2024-09-11 16:06:07.484800] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:07.484808] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:07.552808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:07.602626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:07.602687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:07.602705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:07.602732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:07.687881] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041967687877, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:06:07.694660] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726041967694656, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:06:07.752921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:07.802994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:07.803039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:07.803046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:07.803056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:07.893130] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:07.893176] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45298 [2024-09-11 16:06:07.953034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:08.003300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:08.003345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:08.003353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:08.003364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:08.085064] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45298, magic:0x78563412 [2024-09-11 16:06:08.085106] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:08.085114] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:08.156875] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3721, replace_start_pos=7900000, replace_num=100000) [2024-09-11 16:06:08.156925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:08.203592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:08.203637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:08.203645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:08.203654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:08.246615] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:08.324684] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:08.357012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:08.403881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:08.403942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:08.403949] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:08.403958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:08.487588] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:08.487630] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45308 [2024-09-11 16:06:08.557128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:08.604258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:08.604302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:08.604310] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:08.604320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:08.685602] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45308, magic:0x78563412 [2024-09-11 16:06:08.685646] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:08.685654] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:08.695504] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726041968695501, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:06:08.702281] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041968702277, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:06:08.757253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:08.804556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:08.804605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:08.804612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:08.804621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:08.957380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:09.004952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:09.004992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:09.005000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:09.005009] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:09.088014] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:09.088058] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45322 [2024-09-11 16:06:09.157500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:09.205309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:09.205353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:09.205362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:09.205388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:09.246743] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:09.285830] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45322, magic:0x78563412 [2024-09-11 16:06:09.285873] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:09.285880] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:09.325616] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:09.357622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:09.405640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:09.405686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:09.405694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:09.405703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:09.413844] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8128, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:06:09.557744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:09.614168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:09.614209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:09.614218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:09.614227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:09.688283] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:09.688324] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45332 [2024-09-11 16:06:09.703133] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041969703128, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:06:09.709890] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041969709885, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:06:09.757864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:09.814520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:09.814566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:09.814595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:09.814606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:09.886660] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45332, magic:0x78563412 [2024-09-11 16:06:09.886699] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:09.886706] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:09.957995] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:10.014843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:10.014886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:10.014894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:10.014933] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:10.158123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:10.215186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:10.215227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:10.215234] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:10.215242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:10.246860] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:10.288676] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:10.288724] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45342 [2024-09-11 16:06:10.326622] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=93] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:10.362643] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4403, replace_start_pos=8000000, replace_num=100000) [2024-09-11 16:06:10.362693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:10.415484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:10.415530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:10.415554] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:10.415564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:10.487019] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45342, magic:0x78563412 [2024-09-11 16:06:10.487061] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:10.487070] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:10.562773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:10.615873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:10.615941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:10.615951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:10.615960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:10.710751] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726041970710747, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:06:10.717492] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726041970717488, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:06:10.762885] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:10.816191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:10.816232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:10.816239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:10.816247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:10.889094] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:10.889137] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45348 [2024-09-11 16:06:10.963009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:11.016567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:11.016607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:11.016615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:11.016624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:11.087593] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45348, magic:0x78563412 [2024-09-11 16:06:11.087635] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:11.087642] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:11.163124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:11.216956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:11.217001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:11.217008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:11.217017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:11.247115] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=94] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:11.327743] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:11.363239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:11.417330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:11.417374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:11.417382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:11.417392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:11.425949] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8542, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:06:11.442961] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:11.443000] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:11.443071] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] update_check_range(min_check_version=99, max_check_version=100, global_version=101) [2024-09-11 16:06:11.444780] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1708 [2024-09-11 16:06:11.444818] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:11.444850] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:06:11.444883] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:06:11.444973] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:11.445071] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:06:11.445115] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:06:11.445124] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:06:11.445133] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:06:11.445167] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:06:11.445215] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:06:11.445232] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:06:11.489259] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:11.489304] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45360 [2024-09-11 16:06:11.563358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:11.626305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:11.626353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:11.626361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:11.626371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:11.687969] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45360, magic:0x78563412 [2024-09-11 16:06:11.688011] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:11.688018] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:11.718361] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041971718357, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:06:11.725172] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041971725169, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:06:11.763541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:11.826677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:11.826724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:11.826732] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:11.826742] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:11.963657] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:12.027015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:12.027058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:12.027066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:12.027076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:12.090065] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:12.090110] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45362 [2024-09-11 16:06:12.163775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:12.227382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:12.227422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:12.227430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:12.227458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:12.247339] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:12.288442] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45362, magic:0x78563412 [2024-09-11 16:06:12.288490] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:12.288497] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:12.328780] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:12.363957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:12.427726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:12.427772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:12.427779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:12.427788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:12.568532] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4395, replace_start_pos=8100000, replace_num=100000) [2024-09-11 16:06:12.568574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:12.628080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:12.628141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:12.628156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:12.628169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:12.689231] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:12.689277] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45372 [2024-09-11 16:06:12.726101] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041972726096, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007739, add_bytes: 0 [2024-09-11 16:06:12.732727] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041972732724, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:06:12.768698] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:12.828406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:12.828485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:12.828495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:12.828504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:12.887764] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45372, magic:0x78563412 [2024-09-11 16:06:12.887806] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:12.887814] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:12.968880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:13.028791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:13.028835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:13.028843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:13.028852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:13.169092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:13.229131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:13.229175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:13.229183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:13.229192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:13.247547] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:13.289520] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:13.289580] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45384 [2024-09-11 16:06:13.329727] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:13.369219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:13.429442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:13.429496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:13.429505] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:13.429530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:13.436770] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7227, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:06:13.488190] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45384, magic:0x78563412 [2024-09-11 16:06:13.488228] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:13.488237] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:13.569340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:13.637029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:13.637071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:13.637077] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:13.637086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:13.733584] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041973733580, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007484, add_bytes: 0 [2024-09-11 16:06:13.740416] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041973740412, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:06:13.769467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:13.837317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:13.837352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:13.837358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:13.837366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:13.890225] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:13.890270] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45400 [2024-09-11 16:06:13.969592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:14.037612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:14.037655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:14.037663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:14.037672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:14.088694] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45400, magic:0x78563412 [2024-09-11 16:06:14.088733] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:14.088739] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:14.169831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:14.237890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:14.237955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:14.237962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:14.237983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:14.247668] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:14.330536] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:14.369955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:14.438209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:14.438242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:14.438250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:14.438259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:14.490842] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:14.490885] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45406 [2024-09-11 16:06:14.570089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:14.638484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:14.638528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:14.638536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:14.638545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:14.689035] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45406, magic:0x78563412 [2024-09-11 16:06:14.689073] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:14.689081] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:14.741244] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041974741240, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007660, add_bytes: 0 [2024-09-11 16:06:14.748030] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041974748026, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:06:14.773588] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3361, replace_start_pos=8200000, replace_num=100000) [2024-09-11 16:06:14.773635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:14.838792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:14.838836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:14.838843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:14.838852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:14.973724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:15.039154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:15.039197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:15.039205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:15.039215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:15.089788] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:15.089827] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:45420 [2024-09-11 16:06:15.173935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:15.239505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:15.239557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:15.239567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:15.239581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:15.247800] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:15.288421] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:45420, magic:0x78563412 [2024-09-11 16:06:15.288494] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=69] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:15.288500] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:15.331469] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:15.374057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:15.439891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:15.439958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:15.439966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:15.439976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:15.440192] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=101, refresh_score_time=63, wash_time=0) [2024-09-11 16:06:15.447790] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7585, clean_start_pos=0, clean_num=200000) [2024-09-11 16:06:15.574170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:15.648045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:15.648086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:15.648093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:15.648102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:15.691215] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:15.691258] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29282 [2024-09-11 16:06:15.748832] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=97] PNIO [ratelimit] time: 1726041975748827, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007587, add_bytes: 0 [2024-09-11 16:06:15.755637] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041975755633, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:06:15.774319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:15.848322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:15.848359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:15.848366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:15.848373] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:15.889139] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29282, magic:0x78563412 [2024-09-11 16:06:15.889180] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:15.889188] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:15.974502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:16.048604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:16.048668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:16.048677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:16.048686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:16.174619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:16.248043] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:16.248948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:16.248982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:16.248989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:16.248998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:16.291467] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:16.291512] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29292 [2024-09-11 16:06:16.332396] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:16.374736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:16.449229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:16.449268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:16.449275] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:16.449284] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:16.488599] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29292, magic:0x78563412 [2024-09-11 16:06:16.488636] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:16.488644] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:16.574857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:16.649587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:16.649632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:16.649657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:16.649668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:16.756425] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041976756421, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:06:16.763187] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041976763183, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:06:16.775004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:16.849896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:16.849961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:16.849970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:16.849980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:16.890331] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:16.890367] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29300 [2024-09-11 16:06:16.979444] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4313, replace_start_pos=8300000, replace_num=100000) [2024-09-11 16:06:16.979492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:17.050273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:17.050315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:17.050323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:17.050333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:17.088854] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29300, magic:0x78563412 [2024-09-11 16:06:17.088936] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=77] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:17.088945] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:17.179644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:17.248237] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:17.250560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:17.250590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:17.250598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:17.250607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:17.333497] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:17.379832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:17.450838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:17.450882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:17.450890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:17.450899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:17.459415] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8479, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:06:17.491272] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:17.491315] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29302 [2024-09-11 16:06:17.580026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:17.659662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:17.659712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:17.659720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:17.659729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:17.689456] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29302, magic:0x78563412 [2024-09-11 16:06:17.689514] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:17.689521] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:17.764107] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041977764102, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:06:17.770871] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041977770867, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:06:17.780208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:17.859970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:17.860006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:17.860012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:17.860021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:17.980384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:18.060316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:18.060365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:18.060373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:18.060382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:18.091812] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:18.091859] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29312 [2024-09-11 16:06:18.180567] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:18.248430] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:18.260624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:18.260667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:18.260675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:18.260684] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:18.289930] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29312, magic:0x78563412 [2024-09-11 16:06:18.289975] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:18.289982] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:18.334446] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:18.380763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:18.461005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:18.461049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:18.461056] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:18.461066] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:18.580978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:18.661362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:18.661427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:18.661436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:18.661446] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:18.691918] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:18.691962] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29328 [2024-09-11 16:06:18.771667] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041978771662, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:06:18.778434] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726041978778430, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:06:18.781164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:18.861762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:18.861823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:18.861831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:18.861841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:18.890355] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29328, magic:0x78563412 [2024-09-11 16:06:18.890397] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:18.890404] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:18.981328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:19.062086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:19.062129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:19.062137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:19.062145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:19.185910] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4375, replace_start_pos=8400000, replace_num=100000) [2024-09-11 16:06:19.185961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:19.248594] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:19.262471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:19.262517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:19.262526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:19.262535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:19.292819] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:19.292864] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29342 [2024-09-11 16:06:19.335679] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:19.386057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:19.462773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:19.462836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:19.462842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:19.462850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:19.469635] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6772, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:06:19.491160] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29342, magic:0x78563412 [2024-09-11 16:06:19.491204] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:19.491211] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:19.586247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:19.669924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:19.669969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:19.669977] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:19.669986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:19.779272] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041979779269, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:06:19.786043] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041979786039, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:06:19.786367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:19.870224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:19.870267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:19.870275] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:19.870306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:19.893128] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:19.893167] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29354 [2024-09-11 16:06:19.986537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:20.070541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:20.070585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:20.070592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:20.070600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:20.091418] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29354, magic:0x78563412 [2024-09-11 16:06:20.091455] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:20.091463] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:20.186666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:20.248736] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:20.270836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:20.270876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:20.270883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:20.270891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:20.336465] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:20.386880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:20.471245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:20.471290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:20.471298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:20.471307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:20.493200] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:20.493244] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29356 [2024-09-11 16:06:20.587085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:20.671630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:20.671676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:20.671684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:20.671694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:20.691858] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29356, magic:0x78563412 [2024-09-11 16:06:20.691898] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:20.691928] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:20.786919] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041980786897, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:06:20.787202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:20.793679] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726041980793675, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:06:20.871965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:20.872013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:20.872020] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:20.872030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:20.987303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:21.072256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:21.072303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:21.072310] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:21.072319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:21.093520] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:21.093556] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29362 [2024-09-11 16:06:21.187464] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:21.248886] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:21.272555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:21.272598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:21.272607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:21.272617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:21.292326] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29362, magic:0x78563412 [2024-09-11 16:06:21.292368] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:21.292376] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:21.337454] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:21.391177] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3593, replace_start_pos=8500000, replace_num=100000) [2024-09-11 16:06:21.391219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:21.458932] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:21.458978] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=44] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:21.459052] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=100, max_check_version=101, global_version=102) [2024-09-11 16:06:21.460782] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1728 [2024-09-11 16:06:21.460834] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:21.460864] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:06:21.460897] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:06:21.460990] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:21.461075] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:06:21.461123] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:06:21.461133] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:06:21.461141] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:06:21.461173] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:06:21.461224] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:06:21.461239] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:06:21.472957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:21.472996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:21.473003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:21.473013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:21.481651] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8624, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:06:21.591299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:21.682012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:21.682056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:21.682065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:21.682075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:21.694967] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:21.695011] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29370 [2024-09-11 16:06:21.791395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:21.794530] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041981794526, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:06:21.801265] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726041981801263, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007588, add_bytes: 0 [2024-09-11 16:06:21.882391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:21.882435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:21.882443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:21.882452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:21.892933] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29370, magic:0x78563412 [2024-09-11 16:06:21.892966] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:21.892972] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:21.991524] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:22.082760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:22.082806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:22.082815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:22.082825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:22.191655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:22.249033] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:22.283132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:22.283176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:22.283184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:22.283213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:22.295358] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:22.295402] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29386 [2024-09-11 16:06:22.338295] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:22.391838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:22.483524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:22.483571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:22.483579] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:22.483589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:22.493406] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29386, magic:0x78563412 [2024-09-11 16:06:22.493456] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:22.493466] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:22.592014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:22.683946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:22.683992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:22.684000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:22.684010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:22.792220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:22.802135] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041982802131, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:06:22.808926] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041982808898, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:06:22.884313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:22.884357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:22.884365] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:22.884375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:22.895035] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:22.895080] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29390 [2024-09-11 16:06:22.992365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:23.084695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:23.084742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:23.084750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:23.084759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:23.093753] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29390, magic:0x78563412 [2024-09-11 16:06:23.093794] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:23.093800] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:23.192488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:23.249168] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:23.285081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:23.285123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:23.285131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:23.285140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:23.339474] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:23.392666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:23.485368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:23.485412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:23.485420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:23.485430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:23.493915] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8472, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:06:23.495685] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:23.495720] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29396 [2024-09-11 16:06:23.596464] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3657, replace_start_pos=8600000, replace_num=100000) [2024-09-11 16:06:23.596508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:23.694136] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29396, magic:0x78563412 [2024-09-11 16:06:23.694177] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:23.694185] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:23.694289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:23.694321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:23.694329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:23.694338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:23.796596] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:23.809741] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041983809736, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:06:23.816513] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726041983816510, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:06:23.894655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:23.894700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:23.894707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:23.894716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:23.996743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:24.095078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:24.095124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:24.095132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:24.095142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:24.096468] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:24.096495] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29406 [2024-09-11 16:06:24.196939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:24.249281] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:24.293626] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29406, magic:0x78563412 [2024-09-11 16:06:24.293649] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:24.293657] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:24.295378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:24.295413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:24.295421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:24.295429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:24.340419] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:24.397068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:24.495660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:24.495705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:24.495713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:24.495722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:24.597217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:24.695477] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:24.695519] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29408 [2024-09-11 16:06:24.696083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:24.696117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:24.696125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:24.696134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:24.797352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:24.817422] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041984817419, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:06:24.824120] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041984824117, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:06:24.894003] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29408, magic:0x78563412 [2024-09-11 16:06:24.894046] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:24.894054] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:24.896361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:24.896395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:24.896403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:24.896413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:24.997473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:25.096638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:25.096700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:25.096706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:25.096715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:25.197603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:25.249506] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:25.295918] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:25.295964] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:29414 [2024-09-11 16:06:25.296951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:25.296980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:25.296987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:25.296995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:25.341379] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:25.397721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:25.494487] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:29414, magic:0x78563412 [2024-09-11 16:06:25.494527] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:25.494535] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:25.497229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:25.497254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:25.497260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:25.497268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:25.504364] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7083, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:06:25.597938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:25.704677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:25.704741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:25.704750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:25.704760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:25.704979] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:06:25.802547] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4482, replace_start_pos=8700000, replace_num=100000) [2024-09-11 16:06:25.802590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:25.825069] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041985825065, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007646, add_bytes: 0 [2024-09-11 16:06:25.831798] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726041985831795, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:06:25.896048] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:25.896093] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48534 [2024-09-11 16:06:25.905283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:25.905317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:25.905325] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:25.905335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:26.002690] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:26.094766] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48534, magic:0x78563412 [2024-09-11 16:06:26.094809] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:26.094817] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:26.105669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:26.105714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:26.105722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:26.105733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:26.202822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:26.249709] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:26.305994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:26.306037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:26.306044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:26.306053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:26.342424] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:26.402946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:26.496788] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:26.496835] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48540 [2024-09-11 16:06:26.506398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:26.506437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:26.506446] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:26.506455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:26.603082] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:26.695208] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48540, magic:0x78563412 [2024-09-11 16:06:26.695250] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:26.695258] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:26.706751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:26.706801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:26.706809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:26.706817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:26.803213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:26.832600] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041986832595, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 16:06:26.839355] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041986839353, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:06:26.907132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:26.907172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:26.907180] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:26.907189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:27.003344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:27.097084] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:27.097129] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48554 [2024-09-11 16:06:27.107496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:27.107539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:27.107547] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:27.107557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:27.203486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:27.249840] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:27.295554] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48554, magic:0x78563412 [2024-09-11 16:06:27.295594] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:27.295603] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:27.307799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:27.307826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:27.307833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:27.307841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:27.343338] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:27.403622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:27.508066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:27.508105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:27.508111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:27.508120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:27.515234] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7101, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:06:27.603748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:27.698170] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:27.698216] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48558 [2024-09-11 16:06:27.715555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:27.715597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:27.715605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:27.715615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:27.803869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:27.840214] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041987840211, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:06:27.847030] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726041987847028, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:06:27.896267] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48558, magic:0x78563412 [2024-09-11 16:06:27.896307] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:27.896314] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:27.915852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:27.915885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:27.915891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:27.915926] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:28.007345] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=87] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3315, replace_start_pos=8800000, replace_num=100000) [2024-09-11 16:06:28.007391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:28.116153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:28.116201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:28.116209] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:28.116218] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:28.207469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:28.249957] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:28.299316] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:28.299364] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48566 [2024-09-11 16:06:28.316440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:28.316473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:28.316480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:28.316489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:28.344308] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:28.407665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:28.496719] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48566, magic:0x78563412 [2024-09-11 16:06:28.496754] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:28.496761] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:28.516716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:28.516749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:28.516756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:28.516765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:28.607802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:28.717033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:28.717073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:28.717080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:28.717089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:28.807929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:28.847836] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726041988847832, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:06:28.854645] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041988854641, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:06:28.898921] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:28.898984] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48568 [2024-09-11 16:06:28.917316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:28.917354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:28.917361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:28.917369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:29.008047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:29.097165] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48568, magic:0x78563412 [2024-09-11 16:06:29.097207] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:29.097213] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:29.117594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:29.117636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:29.117643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:29.117652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:29.208162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:29.250086] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:29.317876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:29.317927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:29.317935] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:29.317944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:29.345203] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:29.408281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:29.498874] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:29.498931] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48578 [2024-09-11 16:06:29.518182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:29.518236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:29.518243] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:29.518252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:29.525965] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7699, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:06:29.608396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:29.697401] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48578, magic:0x78563412 [2024-09-11 16:06:29.697443] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:29.697451] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:29.726214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:29.726254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:29.726261] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:29.726270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:29.808516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:29.855441] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726041989855436, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:06:29.862263] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041989862260, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:06:29.926500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:29.926538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:29.926547] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:29.926568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:30.008639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:30.099654] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:30.099696] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48586 [2024-09-11 16:06:30.126799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:30.126841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:30.126849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:30.126857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:30.212295] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3407, replace_start_pos=8900000, replace_num=100000) [2024-09-11 16:06:30.212335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:30.250200] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:30.298086] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48586, magic:0x78563412 [2024-09-11 16:06:30.298117] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:30.298124] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:30.327096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:30.327133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:30.327141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:30.327151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:30.346142] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:30.412413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:30.527483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:30.527528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:30.527536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:30.527563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:30.612530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:30.700430] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:30.700475] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48590 [2024-09-11 16:06:30.727795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:30.727841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:30.727849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:30.727858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:30.812648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:30.863123] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041990863119, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:06:30.869825] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041990869822, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:06:30.898414] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48590, magic:0x78563412 [2024-09-11 16:06:30.898454] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:30.898462] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:30.928082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:30.928119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:30.928125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:30.928133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:31.012838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:31.128384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:31.128428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:31.128435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:31.128445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:31.212990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=79] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:31.250350] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:31.300787] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:31.300830] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48594 [2024-09-11 16:06:31.328685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:31.328731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:31.328739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:31.328748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:31.347329] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:31.413180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:31.475112] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:31.475165] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:31.475245] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=101, max_check_version=102, global_version=103) [2024-09-11 16:06:31.477276] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2031 [2024-09-11 16:06:31.477339] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:31.477375] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:06:31.477412] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:06:31.477496] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:31.477602] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:06:31.477660] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:06:31.477672] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:06:31.477683] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:06:31.477719] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:06:31.477779] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:06:31.477801] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:06:31.499143] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48594, magic:0x78563412 [2024-09-11 16:06:31.499186] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:31.499194] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:31.529022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:31.529068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:31.529076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:31.529085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:31.537282] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8182, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:06:31.613301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:31.737636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:31.737681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:31.737688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:31.737698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:31.813412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:31.870732] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041991870728, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:06:31.877490] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041991877487, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:06:31.901079] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:31.901134] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48598 [2024-09-11 16:06:31.938038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:31.938077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:31.938084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:31.938093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:32.013523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:32.099491] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48598, magic:0x78563412 [2024-09-11 16:06:32.099521] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:32.099528] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:32.138336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:32.138378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:32.138384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:32.138391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:32.213632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:32.250475] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:32.338722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:32.338770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:32.338778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:32.338788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:32.348710] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:32.418095] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4345, replace_start_pos=9000000, replace_num=100000) [2024-09-11 16:06:32.418145] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:32.500536] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:32.500591] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48608 [2024-09-11 16:06:32.539055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:32.539099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:32.539106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:32.539115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:32.618225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:32.699023] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48608, magic:0x78563412 [2024-09-11 16:06:32.699060] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:32.699066] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:32.739419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:32.739457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:32.739465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:32.739475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:32.818343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:32.878303] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726041992878298, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:06:32.885041] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726041992885036, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:06:32.939786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:32.939834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:32.939861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:32.939872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:33.018508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:33.100843] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:33.100888] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48624 [2024-09-11 16:06:33.140176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:33.140223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:33.140231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:33.140241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:33.218714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:33.250685] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:33.299256] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48624, magic:0x78563412 [2024-09-11 16:06:33.299301] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:33.299310] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:33.340455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:33.340489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:33.340495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:33.340503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:33.350102] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:33.418913] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:33.540798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:33.540843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:33.540851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:33.540861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:33.549141] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8249, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:06:33.619029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:33.701169] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:33.701207] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48640 [2024-09-11 16:06:33.749413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:33.749454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:33.749461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:33.749470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:33.819254] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:33.885921] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726041993885898, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:06:33.892659] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726041993892656, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:06:33.898699] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48640, magic:0x78563412 [2024-09-11 16:06:33.898729] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:33.898736] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:33.949779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:33.949822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:33.949830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:33.949839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:34.019371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:34.150154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:34.150198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:34.150206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:34.150216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:34.219483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:34.250804] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:34.300436] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:34.300459] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48646 [2024-09-11 16:06:34.350511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:34.350549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:34.350558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:34.350567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:34.351214] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:34.419593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:34.499108] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48646, magic:0x78563412 [2024-09-11 16:06:34.499150] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:34.499158] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:34.550815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:34.550859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:34.550866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:34.550876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:34.624169] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4356, replace_start_pos=9100000, replace_num=100000) [2024-09-11 16:06:34.624232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:34.751180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:34.751225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:34.751233] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:34.751243] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:34.824314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:34.893535] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041994893531, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:06:34.899657] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:34.899695] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:48654 [2024-09-11 16:06:34.900352] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041994900349, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:06:34.951543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:34.951583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:34.951591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:34.951600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:35.024424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:35.098405] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:48654, magic:0x78563412 [2024-09-11 16:06:35.098451] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:35.098458] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:35.151935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:35.151978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:35.151986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:35.151996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:35.224537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:35.250931] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:35.352296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:35.352339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:35.352348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:35.352357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:35.356723] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=42] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:35.424712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:35.500686] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:35.500729] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2684 [2024-09-11 16:06:35.552654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:35.552695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:35.552703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:35.552712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:35.561323] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8595, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:06:35.624830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:35.698750] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2684, magic:0x78563412 [2024-09-11 16:06:35.698796] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:35.698807] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:35.761654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:35.761701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:35.761710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:35.761719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:35.761956] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=81, refresh_score_time=62, wash_time=0) [2024-09-11 16:06:35.824941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:35.901198] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726041995901194, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:06:35.907896] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726041995907893, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:06:35.962194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:35.962236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:35.962243] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:35.962252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:36.025053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:36.109114] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:36.109152] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2690 [2024-09-11 16:06:36.162484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:36.162523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:36.162531] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:36.162562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:36.225166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:36.251057] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:36.299385] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2690, magic:0x78563412 [2024-09-11 16:06:36.299410] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:36.299417] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:36.362106] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:36.362792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:36.362825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:36.362833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:36.362842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:36.425273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:36.563076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:36.563117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:36.563125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:36.563134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:36.625387] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:36.706845] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:36.706874] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2696 [2024-09-11 16:06:36.763457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:36.763501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:36.763508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:36.763519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:36.829806] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4313, replace_start_pos=9200000, replace_num=100000) [2024-09-11 16:06:36.829854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:36.899923] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2696, magic:0x78563412 [2024-09-11 16:06:36.899961] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:36.899969] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:36.908835] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726041996908831, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:06:36.915510] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726041996915507, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:06:36.963779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:36.963822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:36.963829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:36.963838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:37.030032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:37.164140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:37.164201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:37.164211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:37.164221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:37.230151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:37.251228] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=28] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:37.301946] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:37.301990] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2704 [2024-09-11 16:06:37.363114] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:37.364521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:37.364557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:37.364566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:37.364591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:37.430261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:37.500070] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2704, magic:0x78563412 [2024-09-11 16:06:37.500105] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:37.500112] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:37.564893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:37.564959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:37.564967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:37.564976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:37.573441] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8452, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:06:37.630377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:37.773776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:37.773821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:37.773829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:37.773839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:37.830487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:37.902119] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:37.903679] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=1551] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2714 [2024-09-11 16:06:37.916370] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726041997916367, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007536, add_bytes: 0 [2024-09-11 16:06:37.923199] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726041997923195, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:06:37.974171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:37.974215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:37.974223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:37.974233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:38.030601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:38.100507] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2714, magic:0x78563412 [2024-09-11 16:06:38.100535] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:38.100541] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:38.174555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:38.174596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:38.174604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:38.174613] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:38.230710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:38.251365] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:38.364158] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:38.374949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:38.374990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:38.374998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:38.375008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:38.430827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:38.501504] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:38.501534] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2716 [2024-09-11 16:06:38.575309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:38.575349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:38.575357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:38.575366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:38.630962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:38.700134] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2716, magic:0x78563412 [2024-09-11 16:06:38.700176] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:38.700184] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:38.775669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:38.775715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:38.775723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:38.775732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:38.831074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:38.924007] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726041998924002, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:06:38.930748] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726041998930744, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:06:38.976061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:38.976105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:38.976130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:38.976139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:39.035476] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4287, replace_start_pos=9300000, replace_num=100000) [2024-09-11 16:06:39.035521] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:39.102404] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:39.102449] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2720 [2024-09-11 16:06:39.176454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:39.176498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:39.176506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:39.176516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:39.235667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:39.251479] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:39.300616] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2720, magic:0x78563412 [2024-09-11 16:06:39.300656] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:39.300664] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:39.365097] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:39.376762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:39.376806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:39.376813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:39.376823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:39.435849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:39.577072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:39.577115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:39.577140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:39.577149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:39.584070] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6907, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:06:39.636035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:39.702789] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:39.702834] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2734 [2024-09-11 16:06:39.784316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:39.784355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:39.784362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:39.784371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:39.836152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:39.901018] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2734, magic:0x78563412 [2024-09-11 16:06:39.901055] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:39.901061] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:39.931597] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726041999931593, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007591, add_bytes: 0 [2024-09-11 16:06:39.938435] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726041999938433, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:06:39.984668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:39.984711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:39.984743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:39.984754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:40.036289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:40.185063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:40.185108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:40.185116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:40.185126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:40.236426] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:40.251607] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:40.303181] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:40.303227] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2740 [2024-09-11 16:06:40.366361] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:40.385446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:40.385487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:40.385495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:40.385505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:40.436617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:40.501550] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2740, magic:0x78563412 [2024-09-11 16:06:40.501592] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:40.501599] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:40.585795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:40.585842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:40.585850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:40.585878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:40.636803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:40.786171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:40.786215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:40.786223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:40.786232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:40.836988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:40.903059] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:40.903105] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2750 [2024-09-11 16:06:40.939234] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042000939230, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:06:40.945968] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042000945965, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007532, add_bytes: 0 [2024-09-11 16:06:40.986542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:40.986589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:40.986598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:40.986608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:41.037123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:41.101730] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2750, magic:0x78563412 [2024-09-11 16:06:41.101772] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:41.101797] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:41.186854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:41.186896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:41.186921] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:41.186930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:41.241778] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4387, replace_start_pos=9400000, replace_num=100000) [2024-09-11 16:06:41.241829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:41.251821] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:41.367590] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:41.387164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:41.387200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:41.387208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:41.387218] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:41.442057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:41.493553] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:41.493607] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:41.493688] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=102, max_check_version=103, global_version=104) [2024-09-11 16:06:41.495676] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1988 [2024-09-11 16:06:41.495711] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:41.495769] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:06:41.495808] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:06:41.495890] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:41.496010] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:06:41.496064] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:06:41.496076] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:06:41.496087] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:06:41.496123] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:06:41.496182] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:06:41.496205] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:06:41.503457] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:41.503492] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2754 [2024-09-11 16:06:41.587542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:41.587588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:41.587596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:41.587606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:41.595779] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8159, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:06:41.642285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:41.701154] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2754, magic:0x78563412 [2024-09-11 16:06:41.701193] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:41.701202] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:41.796070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:41.796115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:41.796123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:41.796131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:41.842474] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:41.946833] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042001946828, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:06:41.953591] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042001953588, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:06:41.996354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:41.996398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:41.996406] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:41.996415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:42.042665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:42.101767] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:42.101812] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2756 [2024-09-11 16:06:42.196639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:42.196681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:42.196689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:42.196698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:42.242839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:42.251942] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:42.299679] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2756, magic:0x78563412 [2024-09-11 16:06:42.299721] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:42.299728] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:42.368620] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:42.396953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:42.396983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:42.396989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:42.396998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:42.442971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:42.597274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:42.597322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:42.597348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:42.597358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:42.643150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:42.701949] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:42.701990] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2770 [2024-09-11 16:06:42.797675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:42.797715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:42.797722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:42.797731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:42.843353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:42.900059] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2770, magic:0x78563412 [2024-09-11 16:06:42.900105] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:42.900113] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:42.954442] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042002954438, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:06:42.961207] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042002961204, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:06:42.997999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:42.998044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:42.998051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:42.998078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:43.043582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:43.198314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:43.198352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:43.198359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:43.198369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:43.243764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:43.252132] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:43.301951] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:43.301995] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2772 [2024-09-11 16:06:43.369567] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:43.398600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:43.398633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:43.398640] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:43.398650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:43.448315] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4362, replace_start_pos=9500000, replace_num=100000) [2024-09-11 16:06:43.448363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:43.500385] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2772, magic:0x78563412 [2024-09-11 16:06:43.500426] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:43.500434] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:43.598884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:43.598946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:43.598954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:43.598979] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:43.607468] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8475, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:06:43.648512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:43.807792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:43.807838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:43.807846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:43.807856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:43.848717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:43.902067] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:43.902113] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2782 [2024-09-11 16:06:43.962055] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042003962051, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:06:43.968821] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042003968817, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:06:44.008085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:44.008129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:44.008136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:44.008145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:44.048923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:44.100663] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2782, magic:0x78563412 [2024-09-11 16:06:44.100718] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:44.100725] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:44.208438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:44.208483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:44.208490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:44.208500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:44.249042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:44.252238] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:44.370465] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:44.408724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:44.408767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:44.408774] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:44.408784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:44.449173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:44.502791] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:44.502834] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2786 [2024-09-11 16:06:44.609043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:44.609086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:44.609094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:44.609104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:44.649301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:44.701153] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2786, magic:0x78563412 [2024-09-11 16:06:44.701193] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:44.701216] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:44.809311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:44.809350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:44.809356] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:44.809363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:44.849432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:44.969680] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042004969676, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:06:44.976499] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042004976496, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:06:45.009577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:45.009615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:45.009621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:45.009629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:45.049608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:45.103319] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:45.103356] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:2802 [2024-09-11 16:06:45.209851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:45.209893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:45.209899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:45.209923] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:45.249726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:45.252391] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=25] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:45.301865] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:2802, magic:0x78563412 [2024-09-11 16:06:45.301924] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=54] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:45.301933] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:45.371232] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:45.410174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:45.410231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:45.410239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:45.410247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:45.449834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:45.610478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:45.610521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:45.610528] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:45.610537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:45.619036] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8486, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:06:45.654378] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4366, replace_start_pos=9600000, replace_num=100000) [2024-09-11 16:06:45.654423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:45.703407] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:45.703452] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5342 [2024-09-11 16:06:45.819296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:45.819341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:45.819371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:45.819380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:45.854577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:45.902072] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5342, magic:0x78563412 [2024-09-11 16:06:45.902112] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:45.902120] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:45.977356] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042005977352, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:06:45.984050] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042005984046, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:06:46.019614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:46.019658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:46.019666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:46.019676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:46.054764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:46.219916] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:46.219961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:46.219968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:46.219978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:46.252522] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:46.254955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:46.304642] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:46.304684] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5346 [2024-09-11 16:06:46.372066] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:46.420215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:46.420256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:46.420281] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:46.420290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:46.455123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:46.502638] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5346, magic:0x78563412 [2024-09-11 16:06:46.502682] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:46.502690] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:46.620515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:46.620557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:46.620565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:46.620574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:46.655308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:46.820801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:46.820844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:46.820851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:46.820860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:46.855478] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:46.904684] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:46.904744] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5362 [2024-09-11 16:06:46.984924] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042006984919, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:06:46.991731] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042006991727, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:06:47.021084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:47.021124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:47.021132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:47.021141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:47.055661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:47.103008] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5362, magic:0x78563412 [2024-09-11 16:06:47.103050] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:47.103058] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:47.221369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:47.221415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:47.221423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:47.221432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:47.252663] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:47.255781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:47.372926] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:47.421658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:47.421700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:47.421707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:47.421716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:47.455950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:47.504646] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:47.504704] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5374 [2024-09-11 16:06:47.621956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:47.622001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:47.622008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:47.622017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:47.630259] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8228, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:06:47.656166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:47.703318] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5374, magic:0x78563412 [2024-09-11 16:06:47.703362] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:47.703370] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:47.830503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:47.830546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:47.830555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:47.830564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:47.860634] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4342, replace_start_pos=9700000, replace_num=100000) [2024-09-11 16:06:47.860672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:47.992585] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=76] PNIO [ratelimit] time: 1726042007992582, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:06:47.999302] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042007999299, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 16:06:48.030790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:48.030827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:48.030833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:48.030842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:48.060824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:48.105400] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:48.105443] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5384 [2024-09-11 16:06:48.231061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:48.231102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:48.231109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:48.231118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:48.252775] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:48.261005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:48.303856] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5384, magic:0x78563412 [2024-09-11 16:06:48.303897] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:48.303935] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:48.373804] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:48.431351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:48.431392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:48.431398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:48.431407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:48.461137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:48.631627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:48.631688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:48.631694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:48.631703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:48.661260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:48.704516] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:48.704559] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5394 [2024-09-11 16:06:48.831947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:48.831987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:48.831993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:48.832002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:48.861380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:48.902167] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5394, magic:0x78563412 [2024-09-11 16:06:48.902208] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:48.902217] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:49.000149] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=82] PNIO [ratelimit] time: 1726042009000144, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:06:49.006927] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042009006924, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:06:49.032225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:49.032266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:49.032288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:49.032297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:49.061560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:49.232523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:49.232563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:49.232569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:49.232577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:49.252952] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:49.261742] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:49.304582] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:49.304626] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5404 [2024-09-11 16:06:49.374671] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:49.432795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:49.432835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:49.432843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:49.432851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:49.461872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:49.502767] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5404, magic:0x78563412 [2024-09-11 16:06:49.502808] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:49.502816] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:49.633076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:49.633113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:49.633120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:49.633129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:49.641532] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8375, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:06:49.662064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:49.841778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:49.841820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:49.841828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:49.841837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:49.862247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:49.905062] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:49.905109] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5410 [2024-09-11 16:06:50.007759] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042010007754, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:06:50.014538] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042010014534, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:06:50.042069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:50.042117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:50.042125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:50.042135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:50.066819] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4391, replace_start_pos=9800000, replace_num=100000) [2024-09-11 16:06:50.066859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:50.103175] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5410, magic:0x78563412 [2024-09-11 16:06:50.103219] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:50.103226] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:50.242369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:50.242415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:50.242423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:50.242432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:50.253064] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:50.267037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:50.375539] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:50.442654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:50.442697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:50.442704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:50.442713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:50.467261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:50.504948] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:50.504994] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5414 [2024-09-11 16:06:50.642968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:50.643012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:50.643018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:50.643026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:50.667380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:50.703536] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5414, magic:0x78563412 [2024-09-11 16:06:50.703591] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:50.703597] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:50.843261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:50.843304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:50.843311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:50.843339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:50.867506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:51.015371] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042011015366, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:06:51.022126] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042011022125, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007591, add_bytes: 0 [2024-09-11 16:06:51.043566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:51.043612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:51.043620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:51.043630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:51.067691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:51.106073] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:51.106120] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5424 [2024-09-11 16:06:51.243863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:51.243926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:51.243933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:51.243963] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:51.253265] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:51.267867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:51.304331] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5424, magic:0x78563412 [2024-09-11 16:06:51.304373] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:51.304381] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:51.376435] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:51.444198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:51.444242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:51.444248] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:51.444257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:51.468073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:51.509149] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:51.509193] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:06:51.509274] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=103, max_check_version=104, global_version=105) [2024-09-11 16:06:51.511341] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2066 [2024-09-11 16:06:51.511384] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:51.511421] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:06:51.511478] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:06:51.511563] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:06:51.511670] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:06:51.511726] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:06:51.511740] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:06:51.511751] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:06:51.511788] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:06:51.511848] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:06:51.511869] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:06:51.644483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:51.644522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:51.644543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:51.644552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:51.652781] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8216, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:06:51.668195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:51.706467] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:51.706506] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5428 [2024-09-11 16:06:51.853040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:51.853083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:51.853090] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:51.853100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:51.868320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:51.904886] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5428, magic:0x78563412 [2024-09-11 16:06:51.904933] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:51.904940] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:52.022981] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042012022978, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:06:52.029750] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726042012029747, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:06:52.053324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:52.053368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:52.053397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:52.053406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:52.068410] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:52.253439] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:52.253624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:52.253651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:52.253658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:52.253667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:52.272876] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4358, replace_start_pos=9900000, replace_num=100000) [2024-09-11 16:06:52.272928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:52.306611] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:52.306655] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5438 [2024-09-11 16:06:52.377367] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:52.453892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:52.453952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:52.453960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:52.453969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:52.473074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:52.505160] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5438, magic:0x78563412 [2024-09-11 16:06:52.505204] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:52.505212] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:52.654186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:52.654226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:52.654245] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:52.654254] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:52.673197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:52.854473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:52.854513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:52.854519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:52.854527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:52.873370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:52.904953] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:52.904993] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5450 [2024-09-11 16:06:53.030679] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042013030675, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 16:06:53.037384] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042013037380, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:06:53.054748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:53.054788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:53.054795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:53.054804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:53.073486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:53.103528] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5450, magic:0x78563412 [2024-09-11 16:06:53.103587] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:53.103596] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:53.253635] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:53.255041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:53.255066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:53.255074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:53.255083] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:53.273592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:53.378123] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:53.455308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:53.455352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:53.455360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:53.455369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:53.473753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:53.505541] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:53.505584] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5454 [2024-09-11 16:06:53.655602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:53.655642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:53.655650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:53.655659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:53.664244] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8570, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:06:53.674014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:53.703994] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5454, magic:0x78563412 [2024-09-11 16:06:53.704054] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:53.704064] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:53.864497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:53.864533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:53.864540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:53.864549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:53.874160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:54.038226] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042014038223, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:06:54.045049] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042014045046, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:06:54.064779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:54.064824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:54.064831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:54.064840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:54.074272] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:54.106281] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:54.106325] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5464 [2024-09-11 16:06:54.253760] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:54.265066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:54.265106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:54.265131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:54.265140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:54.274457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:54.304561] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5464, magic:0x78563412 [2024-09-11 16:06:54.304603] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:54.304610] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:54.378896] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:54.465375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:54.465407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:54.465413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:54.465422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:54.478428] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3799, replace_start_pos=10000000, replace_num=100000) [2024-09-11 16:06:54.478466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:54.665646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:54.665684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:54.665691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:54.665699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:54.678554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:54.706578] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:54.706622] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5466 [2024-09-11 16:06:54.865953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:54.865994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:54.866002] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:54.866029] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:54.878675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:54.905154] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5466, magic:0x78563412 [2024-09-11 16:06:54.905197] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:54.905205] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:55.045846] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042015045841, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:06:55.052622] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042015052618, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 16:06:55.066253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:55.066296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:55.066303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:55.066312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:55.078851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:55.253888] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:55.266541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:55.266588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:55.266596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:55.266605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:55.278979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:55.307405] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:55.307449] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:5470 [2024-09-11 16:06:55.379651] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:55.466833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:55.466869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:55.466891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:55.466915] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:55.479117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:55.505767] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:5470, magic:0x78563412 [2024-09-11 16:06:55.505809] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:55.505817] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:55.667141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:55.667176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:55.667183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:55.667192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:55.675116] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7911, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:06:55.679286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:55.875376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:55.875435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:55.875443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:55.875452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:55.875637] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:06:55.879399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:55.908310] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:55.908352] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20650 [2024-09-11 16:06:56.053514] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042016053510, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:06:56.060236] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042016060233, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:06:56.075887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:56.075954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:56.075962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:56.075971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:56.076182] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=100, refresh_score_time=63, wash_time=0) [2024-09-11 16:06:56.079505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:56.106207] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20650, magic:0x78563412 [2024-09-11 16:06:56.106248] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:56.106256] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:56.254042] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:56.276418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:56.276461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:56.276468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:56.276477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:56.279611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:56.380399] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:56.476718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:56.476760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:56.476767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:56.476793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:56.479713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:56.507585] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:56.507627] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20660 [2024-09-11 16:06:56.677028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:56.677068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:56.677075] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:56.677083] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:56.683531] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3697, replace_start_pos=10100000, replace_num=100000) [2024-09-11 16:06:56.683570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:56.705447] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20660, magic:0x78563412 [2024-09-11 16:06:56.705484] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:56.705491] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:56.877309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:56.877351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:56.877357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:56.877365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:56.883669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:57.061069] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042017061066, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:06:57.067852] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042017067847, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:06:57.077606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:57.077645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:57.077653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:57.077662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:57.083786] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:57.107830] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:57.107874] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20672 [2024-09-11 16:06:57.254177] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:57.277892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:57.277947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:57.277954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:57.277962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:57.283896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:57.306130] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20672, magic:0x78563412 [2024-09-11 16:06:57.306174] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:57.306182] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:57.381157] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:57.478183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:57.478226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:57.478233] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:57.478242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:57.484100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:57.678497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:57.678542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:57.678550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:57.678558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:57.684212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:57.687080] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8508, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:06:57.706917] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:57.706962] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20680 [2024-09-11 16:06:57.884324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:06:57.887322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:57.887346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:57.887352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:57.887361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:57.905333] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20680, magic:0x78563412 [2024-09-11 16:06:57.905366] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:57.905373] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:58.068749] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042018068745, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:06:58.075543] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042018075539, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:06:58.084441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:06:58.087587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:58.087620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:58.087626] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:58.087635] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:58.254358] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:58.284553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:06:58.287854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:58.287879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:58.287886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:58.287895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:58.307450] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:58.307483] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20692 [2024-09-11 16:06:58.381913] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:58.484737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:06:58.488133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:58.488164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:58.488171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:58.488181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:58.505986] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20692, magic:0x78563412 [2024-09-11 16:06:58.506022] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:58.506030] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:58.684953] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:06:58.688400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:58.688429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:58.688436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:58.688445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:58.888671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:58.888722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:58.888731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:58.888741] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:58.888813] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3731, replace_start_pos=10200000, replace_num=100000) [2024-09-11 16:06:58.888841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:06:58.907797] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:58.907836] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20706 [2024-09-11 16:06:59.076372] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=76] PNIO [ratelimit] time: 1726042019076368, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:06:59.083058] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042019083055, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007516, add_bytes: 0 [2024-09-11 16:06:59.088922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:06:59.088988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:59.089015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:59.089038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:59.089046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:59.106352] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20706, magic:0x78563412 [2024-09-11 16:06:59.106395] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:59.106402] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:59.254497] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:06:59.289108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:06:59.289273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:59.289306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:59.289315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:59.289325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:59.382701] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:06:59.489241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:06:59.489550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:59.489584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:59.489591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:59.489600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:59.508085] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:06:59.508131] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20708 [2024-09-11 16:06:59.689362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:06:59.689820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:59.689850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:59.689858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:59.689866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:06:59.697369] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7476, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:06:59.706474] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20708, magic:0x78563412 [2024-09-11 16:06:59.706510] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:06:59.706518] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:06:59.889535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:06:59.897618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:06:59.897662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:06:59.897669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:06:59.897678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:00.077981] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:07:00.083915] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042020083912, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:07:00.083947] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:07:00.088410] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:07:00.089653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:00.090669] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042020090668, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:07:00.090681] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=12] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:07:00.097923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:00.097979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:00.097987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:00.097997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:00.107602] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:00.107640] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20716 [2024-09-11 16:07:00.254679] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:00.289805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:00.298232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:00.298276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:00.298285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:00.298294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:00.306233] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20716, magic:0x78563412 [2024-09-11 16:07:00.306264] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:00.306270] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:00.383473] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:00.489936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:00.498523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:00.498561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:00.498568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:00.498576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:00.690122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:00.698811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:00.698849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:00.698855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:00.698877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:00.707954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:00.707988] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20728 [2024-09-11 16:07:00.890320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:00.899101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:00.899142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:00.899148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:00.899157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:00.906390] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20728, magic:0x78563412 [2024-09-11 16:07:00.906424] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:00.906432] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:01.091601] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042021091597, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:07:01.094616] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4166, replace_start_pos=10300000, replace_num=100000) [2024-09-11 16:07:01.094649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:01.098297] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726042021098295, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:07:01.099395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:01.099426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:01.099434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:01.099458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:01.254840] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:01.294748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:01.299746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:01.299777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:01.299785] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:01.299794] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:01.308448] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:01.308481] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20744 [2024-09-11 16:07:01.384234] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:01.494934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:01.500092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:01.500130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:01.500138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:01.500147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:01.506858] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20744, magic:0x78563412 [2024-09-11 16:07:01.506888] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:01.506896] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:01.524144] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:01.524191] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:01.524276] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=104, max_check_version=105, global_version=106) [2024-09-11 16:07:01.526306] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2030 [2024-09-11 16:07:01.526358] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:01.526396] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:07:01.526434] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:07:01.526518] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:01.526626] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:07:01.526690] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:07:01.526702] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:07:01.526713] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:07:01.526749] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:07:01.526813] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:07:01.526835] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:07:01.695144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:01.700464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:01.700509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:01.700517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:01.700527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:01.708562] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8022, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:07:01.895334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:01.908565] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:01.908608] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20758 [2024-09-11 16:07:01.908932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:01.908964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:01.908972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:01.908981] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:02.095458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:02.099147] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042022099144, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:07:02.105981] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042022105977, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:07:02.107462] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20758, magic:0x78563412 [2024-09-11 16:07:02.107498] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:02.107508] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:02.109280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:02.109308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:02.109316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:02.109325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:02.254965] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:02.295599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:02.309570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:02.309616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:02.309624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:02.309633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:02.385262] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:02.495720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:02.509499] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:02.509538] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20774 [2024-09-11 16:07:02.509864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:02.509892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:02.509899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:02.509936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:02.695837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:02.707895] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20774, magic:0x78563412 [2024-09-11 16:07:02.707943] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:02.707950] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:02.710253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:02.710288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:02.710296] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:02.710305] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:02.895945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:02.910601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:02.910644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:02.910653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:02.910662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:03.096075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:03.106772] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042023106767, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:07:03.110020] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:03.110053] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20782 [2024-09-11 16:07:03.110897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:03.110955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:03.110976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:03.110986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:03.113583] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042023113580, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:07:03.255102] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:03.300284] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4068, replace_start_pos=10400000, replace_num=100000) [2024-09-11 16:07:03.300326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:03.308221] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20782, magic:0x78563412 [2024-09-11 16:07:03.308254] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:03.308261] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:03.311284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:03.311319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:03.311327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:03.311337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:03.386437] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:03.500490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:03.511632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:03.511674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:03.511682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:03.511692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:03.700626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:03.710156] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:03.710191] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20792 [2024-09-11 16:07:03.712024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:03.712069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:03.712077] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:03.712085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:03.719962] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7864, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:07:03.900763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:03.908712] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20792, magic:0x78563412 [2024-09-11 16:07:03.908744] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:03.908752] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:03.920272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:03.920311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:03.920319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:03.920328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:04.100947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:04.114378] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042024114373, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:07:04.120663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:04.120711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:04.120720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:04.120749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:04.121151] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042024121149, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007569, add_bytes: 0 [2024-09-11 16:07:04.255215] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:04.301151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:04.310574] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:04.310617] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20796 [2024-09-11 16:07:04.321068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:04.321109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:04.321117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:04.321127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:04.387689] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:04.501360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:04.508033] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20796, magic:0x78563412 [2024-09-11 16:07:04.508068] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:04.508074] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:04.521379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:04.521419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:04.521427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:04.521436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:04.701490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:04.721742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:04.721780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:04.721789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:04.721800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:04.901597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:04.910876] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:04.910931] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:20798 [2024-09-11 16:07:04.922117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:04.922159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:04.922167] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:04.922178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:05.101714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:05.108744] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:20798, magic:0x78563412 [2024-09-11 16:07:05.108778] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:05.108785] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:05.122067] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042025122063, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:07:05.122475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:05.122507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:05.122515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:05.122525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:05.128829] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042025128826, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:07:05.255341] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:05.301836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:05.322743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:05.322781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:05.322787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:05.322795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:05.388648] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:05.506143] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4179, replace_start_pos=10500000, replace_num=100000) [2024-09-11 16:07:05.506184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:05.511378] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:05.511408] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47644 [2024-09-11 16:07:05.523024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:05.523051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:05.523057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:05.523064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:05.706277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:05.709136] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47644, magic:0x78563412 [2024-09-11 16:07:05.709166] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:05.709172] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:05.723359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:05.723402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:05.723409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:05.723419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:05.731309] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7877, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:07:05.906412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:05.931662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:05.931707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:05.931715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:05.931724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:06.106551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:06.110943] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:06.110978] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47648 [2024-09-11 16:07:06.129627] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042026129622, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:07:06.132063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:06.132102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:06.132110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:06.132119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:06.136452] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042026136448, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:07:06.255503] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=88] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:06.306682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:06.309564] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47648, magic:0x78563412 [2024-09-11 16:07:06.309595] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:06.309619] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:06.332419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:06.332462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:06.332471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:06.332480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:06.389763] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:06.506815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:06.532783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:06.532825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:06.532832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:06.532840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:06.707017] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:06.711421] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:06.711459] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47654 [2024-09-11 16:07:06.733055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:06.733095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:06.733101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:06.733109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:06.907200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:06.910062] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47654, magic:0x78563412 [2024-09-11 16:07:06.910092] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:06.910100] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:06.933404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:06.933467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:06.933477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:06.933486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:07.107325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:07.133830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:07.133876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:07.133884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:07.133894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:07.137227] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042027137224, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:07:07.144063] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042027144061, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:07:07.255639] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:07.307512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:07.312155] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:07.312192] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47664 [2024-09-11 16:07:07.334139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:07.334180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:07.334188] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:07.334197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:07.390585] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:07.507624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:07.510623] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47664, magic:0x78563412 [2024-09-11 16:07:07.510642] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:07.510648] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:07.534445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:07.534492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:07.534500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:07.534509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:07.711266] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3434, replace_start_pos=10600000, replace_num=100000) [2024-09-11 16:07:07.711314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:07.734808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:07.734852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:07.734861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:07.734870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:07.743364] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8480, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:07:07.911396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:07.913378] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:07.913411] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47680 [2024-09-11 16:07:07.943690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:07.943735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:07.943743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:07.943753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:08.110930] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47680, magic:0x78563412 [2024-09-11 16:07:08.110993] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:08.111009] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=15][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:08.111533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:08.144077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:08.144120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:08.144129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:08.144139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:08.144920] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042028144917, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:07:08.151668] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042028151664, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:07:08.255759] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:08.311653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:08.344452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:08.344504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:08.344516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:08.344531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:08.391711] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:08.511831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:08.513222] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:08.513254] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47696 [2024-09-11 16:07:08.544808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:08.544854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:08.544865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:08.544879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:08.711957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:08.712144] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47696, magic:0x78563412 [2024-09-11 16:07:08.712178] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:08.712186] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:08.745185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:08.745230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:08.745238] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:08.745247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:08.912071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:08.945491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:08.945528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:08.945536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:08.945545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:09.112187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:09.113981] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:09.114014] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47706 [2024-09-11 16:07:09.145794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:09.145840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:09.145870] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:09.145880] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:09.152529] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042029152525, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:07:09.159294] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042029159291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:07:09.255890] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:09.312319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:09.312576] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47706, magic:0x78563412 [2024-09-11 16:07:09.312598] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:09.312606] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:09.346125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:09.346170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:09.346178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:09.346187] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:09.392966] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:09.512499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:09.546488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:09.546535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:09.546543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:09.546553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:09.712683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:09.714765] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:09.714796] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47712 [2024-09-11 16:07:09.746870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:09.746959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=88][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:09.746969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:09.746978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:09.755493] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8501, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:07:09.913264] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47712, magic:0x78563412 [2024-09-11 16:07:09.913300] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:09.913306] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:09.917302] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4484, replace_start_pos=10700000, replace_num=100000) [2024-09-11 16:07:09.917341] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:09.955740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:09.955779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:09.955787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:09.955796] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:10.117440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:10.156140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:10.156182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:10.156189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:10.156199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:10.160139] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042030160136, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:07:10.166835] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042030166831, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007540, add_bytes: 0 [2024-09-11 16:07:10.256020] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:10.315329] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:10.315358] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47726 [2024-09-11 16:07:10.317563] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:10.356520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:10.356565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:10.356573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:10.356582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:10.394145] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:10.513579] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47726, magic:0x78563412 [2024-09-11 16:07:10.513621] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:10.513629] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:10.517669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:10.556936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:10.556981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:10.556989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:10.556998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:10.717775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:10.757235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:10.757280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:10.757287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:10.757313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:10.915530] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:10.915572] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47742 [2024-09-11 16:07:10.917952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:10.957608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:10.957647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:10.957655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:10.957664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:11.114047] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47742, magic:0x78563412 [2024-09-11 16:07:11.114087] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:11.114095] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:11.118064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:11.157925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:11.157972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:11.157980] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:11.157990] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:11.167687] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042031167683, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:07:11.174461] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042031174457, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:07:11.256159] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:11.318177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:11.358224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:11.358269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:11.358276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:11.358286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:11.395512] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:11.516611] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:11.516655] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47754 [2024-09-11 16:07:11.518297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:11.541339] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:11.541391] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:11.541471] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=105, max_check_version=106, global_version=107) [2024-09-11 16:07:11.543545] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2073 [2024-09-11 16:07:11.543587] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:11.543622] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:07:11.543685] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:07:11.543769] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:11.543876] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:07:11.543950] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:07:11.543967] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:07:11.543978] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:07:11.544015] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:07:11.544075] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:07:11.544096] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:07:11.558522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:11.558566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:11.558573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:11.558582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:11.714684] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47754, magic:0x78563412 [2024-09-11 16:07:11.714720] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:11.714729] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:11.718411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:11.758836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:11.758883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:11.758891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:11.758920] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:11.766068] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7132, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:07:11.918510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:11.966419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:11.966463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:11.966471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:11.966480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:12.115459] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:12.115503] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47768 [2024-09-11 16:07:12.122038] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3409, replace_start_pos=10800000, replace_num=100000) [2024-09-11 16:07:12.122066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:12.166778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:12.166826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:12.166834] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:12.166844] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:12.175307] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042032175302, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:07:12.182073] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042032182071, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:07:12.256284] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:12.313943] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47768, magic:0x78563412 [2024-09-11 16:07:12.313979] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:12.313988] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:12.322168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:12.367146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:12.367184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:12.367192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:12.367202] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:12.396928] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:12.522281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:12.567533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:12.567577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:12.567585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:12.567595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:12.716061] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:12.716102] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47782 [2024-09-11 16:07:12.722391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:12.767932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:12.767978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:12.767986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:12.767996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:12.914439] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47782, magic:0x78563412 [2024-09-11 16:07:12.914478] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:12.914485] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:12.922518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:12.968293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:12.968338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:12.968346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:12.968356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:13.122625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:13.168655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:13.168703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:13.168711] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:13.168721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:13.182939] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042033182934, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:07:13.189774] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042033189771, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 16:07:13.256427] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:13.315943] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:13.315987] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47786 [2024-09-11 16:07:13.322749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:13.369082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:13.369125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:13.369133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:13.369143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:13.398331] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:13.514766] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47786, magic:0x78563412 [2024-09-11 16:07:13.514810] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:13.514818] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:13.522855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:13.569497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:13.569532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:13.569540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:13.569550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:13.723038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:13.769840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:13.769884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:13.769892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:13.769931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:13.778041] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8072, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:07:13.917068] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:13.917109] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47802 [2024-09-11 16:07:13.923167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:13.978303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:13.978345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:13.978352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:13.978362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:14.115353] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47802, magic:0x78563412 [2024-09-11 16:07:14.115393] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:14.115400] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:14.123378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:14.178610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:14.178654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:14.178661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:14.178671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:14.190552] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042034190548, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:07:14.197304] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042034197300, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007529, add_bytes: 0 [2024-09-11 16:07:14.256547] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:14.327445] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3953, replace_start_pos=10900000, replace_num=100000) [2024-09-11 16:07:14.327488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:14.378896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:14.378961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:14.378969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:14.378978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:14.399578] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:14.517195] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:14.517240] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47810 [2024-09-11 16:07:14.527587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:14.579274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:14.579319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:14.579327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:14.579336] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:14.715489] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47810, magic:0x78563412 [2024-09-11 16:07:14.715532] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:14.715539] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:14.727717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:14.779564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:14.779606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:14.779613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:14.779622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:14.927917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:14.979961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:14.980004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:14.980012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:14.980021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:15.117938] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:15.117980] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47826 [2024-09-11 16:07:15.128059] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:15.180316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:15.180381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:15.180389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:15.180398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:15.198158] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042035198154, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:07:15.204925] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042035204922, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:07:15.256674] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:15.316100] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47826, magic:0x78563412 [2024-09-11 16:07:15.316142] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:15.316149] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:15.328235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:15.380718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:15.380762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:15.380770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:15.380779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:15.400683] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:15.528432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:15.581082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:15.581125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:15.581133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:15.581143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:15.717525] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:15.717569] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10070 [2024-09-11 16:07:15.728564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:15.781444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:15.781488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:15.781496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:15.781506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:15.789752] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8232, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:07:15.915591] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10070, magic:0x78563412 [2024-09-11 16:07:15.915634] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:15.915641] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:15.928760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:15.990072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:15.990120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:15.990128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:15.990138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:16.128950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:16.190459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:16.190500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:16.190508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:16.190518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:16.205786] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042036205783, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:07:16.212538] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042036212534, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:07:16.256816] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:16.316327] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:16.316362] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10076 [2024-09-11 16:07:16.329089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:16.390756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:16.390798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:16.390805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:16.390815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:16.391077] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash time detail, (compute_wash_size_time=96, refresh_score_time=90, wash_time=0) [2024-09-11 16:07:16.401752] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:16.514683] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10076, magic:0x78563412 [2024-09-11 16:07:16.514712] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:16.514730] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:16.532619] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3349, replace_start_pos=11000000, replace_num=100000) [2024-09-11 16:07:16.532659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:16.591309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:16.591356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:16.591363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:16.591372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:16.732747] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:16.791595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:16.791640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:16.791648] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:16.791657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:16.917335] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:16.917376] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10080 [2024-09-11 16:07:16.932865] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:16.991882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:16.991943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:16.991951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:16.991959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:17.115513] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10080, magic:0x78563412 [2024-09-11 16:07:17.115552] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:17.115560] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:17.133027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:17.192203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:17.192247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:17.192254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:17.192264] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:17.213404] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042037213401, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:07:17.220142] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042037220139, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:07:17.256949] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:17.333235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:17.392487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:17.392532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:17.392556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:17.392566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:17.402512] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:17.517265] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:17.517308] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10086 [2024-09-11 16:07:17.533416] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:17.592774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:17.592811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:17.592817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:17.592837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:17.715743] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10086, magic:0x78563412 [2024-09-11 16:07:17.715784] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:17.715791] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:17.733597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:17.793082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:17.793142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:17.793150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:17.793159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:17.801724] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8552, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:07:17.933729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:18.002012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:18.002056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:18.002063] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:18.002072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:18.118111] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:18.118154] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10100 [2024-09-11 16:07:18.133925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:18.202298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:18.202346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:18.202360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:18.202370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:18.221081] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042038221078, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:07:18.227773] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042038227771, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:07:18.257130] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:18.315053] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10100, magic:0x78563412 [2024-09-11 16:07:18.315095] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:18.315102] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:18.334153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:18.402599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:18.402645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:18.402653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:18.402662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:18.403316] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:18.534344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:18.602882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:18.602944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:18.602950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:18.602959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:18.717142] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:18.717183] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10112 [2024-09-11 16:07:18.737771] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3310, replace_start_pos=11100000, replace_num=100000) [2024-09-11 16:07:18.737813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:18.803194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:18.803230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:18.803236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:18.803244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:18.915655] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10112, magic:0x78563412 [2024-09-11 16:07:18.915693] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:18.915701] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:18.937898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:19.003463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:19.003506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:19.003513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:19.003523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:19.138050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:19.203753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:19.203793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:19.203800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:19.203822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:19.228629] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042039228625, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:07:19.235380] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042039235377, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:07:19.257320] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:19.317806] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:19.317850] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10128 [2024-09-11 16:07:19.338227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:19.404074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:19.404129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:19.404137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:19.404146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:19.404142] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:19.516254] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10128, magic:0x78563412 [2024-09-11 16:07:19.516297] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:19.516306] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:19.538409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:19.604439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:19.604484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:19.604492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:19.604501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:19.738621] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:19.804705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:19.804743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:19.804763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:19.804771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:19.813309] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8525, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:07:19.918022] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:19.918067] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10132 [2024-09-11 16:07:19.938827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:20.013634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:20.013679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:20.013687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:20.013697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:20.116503] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10132, magic:0x78563412 [2024-09-11 16:07:20.116543] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:20.116549] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:20.139024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:20.214032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:20.214077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:20.214085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:20.214094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:20.236238] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042040236234, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:07:20.243000] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042040242996, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:07:20.257430] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:20.339206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:20.405174] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:20.414411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:20.414453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:20.414461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:20.414470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:20.517359] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:20.517402] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10136 [2024-09-11 16:07:20.539393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:20.614763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:20.614804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:20.614812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:20.614821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:20.715864] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10136, magic:0x78563412 [2024-09-11 16:07:20.715913] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:20.715922] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:20.739581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:20.815118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:20.815154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:20.815161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:20.815182] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:20.944036] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4320, replace_start_pos=11200000, replace_num=100000) [2024-09-11 16:07:20.944084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:21.015415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:21.015461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:21.015469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:21.015478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:21.118501] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:21.118540] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10144 [2024-09-11 16:07:21.144177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:21.215698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:21.215745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:21.215751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:21.215759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:21.243847] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042041243843, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:07:21.250675] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042041250673, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:07:21.257560] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:21.316356] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10144, magic:0x78563412 [2024-09-11 16:07:21.316409] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:21.316416] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:21.344346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:21.406260] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:21.416028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:21.416071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:21.416096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:21.416105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:21.544529] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:21.556796] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:21.556852] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:21.556961] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=106, max_check_version=107, global_version=108) [2024-09-11 16:07:21.558979] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2017 [2024-09-11 16:07:21.559017] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:21.559054] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:07:21.559115] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:07:21.559198] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:21.559305] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:07:21.559355] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:07:21.559370] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:07:21.559381] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:07:21.559418] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:07:21.559478] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:07:21.559499] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:07:21.616350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:21.616394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:21.616402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:21.616411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:21.718037] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:21.718088] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10146 [2024-09-11 16:07:21.744764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:21.816615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:21.816656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:21.816662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:21.816670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:21.823170] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6489, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:07:21.916776] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10146, magic:0x78563412 [2024-09-11 16:07:21.916817] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:21.916825] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:21.944918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:22.023409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:22.023446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:22.023452] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:22.023460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:22.145120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:22.223692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:22.223734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:22.223758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:22.223768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:22.251463] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042042251459, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:07:22.257732] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:22.258238] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042042258235, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:07:22.319079] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:22.319125] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10156 [2024-09-11 16:07:22.345256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:22.407293] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:22.424015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:22.424058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:22.424065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:22.424074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:22.517306] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10156, magic:0x78563412 [2024-09-11 16:07:22.517341] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:22.517349] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:22.545391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:22.624300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:22.624343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:22.624350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:22.624359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:22.745534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:22.824565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:22.824604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:22.824625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:22.824633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:22.920233] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:22.920276] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10168 [2024-09-11 16:07:22.945695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:23.024859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:23.024923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:23.024932] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:23.024941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:23.118009] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10168, magic:0x78563412 [2024-09-11 16:07:23.118050] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:23.118057] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:23.150284] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4397, replace_start_pos=11300000, replace_num=100000) [2024-09-11 16:07:23.150332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:23.225267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:23.225324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:23.225340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:23.225350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:23.257860] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:23.259150] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042043259147, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:07:23.265846] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042043265842, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:07:23.350418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:23.408323] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=93] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:23.425616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:23.425659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:23.425667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:23.425676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:23.520197] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:23.520242] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10172 [2024-09-11 16:07:23.550608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:23.625914] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:23.625958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:23.625965] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:23.625975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:23.718149] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10172, magic:0x78563412 [2024-09-11 16:07:23.718188] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:23.718196] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:23.750737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:23.826277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:23.826321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:23.826329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:23.826355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:23.833283] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6914, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:07:23.950863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:24.033601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:24.033646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:24.033655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:24.033665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:24.120329] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:24.120377] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10176 [2024-09-11 16:07:24.151001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:24.234015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:24.234055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:24.234063] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:24.234072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:24.257985] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:24.266710] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042044266706, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:07:24.273453] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042044273450, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:07:24.318755] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10176, magic:0x78563412 [2024-09-11 16:07:24.318813] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:24.318821] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:24.351113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:24.409191] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:24.434315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:24.434374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:24.434382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:24.434391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:24.551233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:24.634614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:24.634656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:24.634663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:24.634673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:24.720956] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:24.720996] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10178 [2024-09-11 16:07:24.751371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:24.835010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:24.835048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:24.835056] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:24.835065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:24.919112] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10178, magic:0x78563412 [2024-09-11 16:07:24.919156] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:24.919164] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:24.951485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:25.035295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:25.035338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:25.035346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:25.035355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:25.151605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:25.235593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:25.235633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:25.235641] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:25.235650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:25.258118] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:25.274315] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042045274312, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:07:25.281140] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042045281137, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:07:25.321370] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:25.321414] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:10182 [2024-09-11 16:07:25.356140] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4337, replace_start_pos=11400000, replace_num=100000) [2024-09-11 16:07:25.356189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:25.410197] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:25.435882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:25.435939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:25.435950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:25.435959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:25.519515] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:10182, magic:0x78563412 [2024-09-11 16:07:25.519570] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:25.519578] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:25.556280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:25.636181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:25.636222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:25.636228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:25.636237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:25.756400] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:25.836531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:25.836573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:25.836581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:25.836591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:25.843850] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7246, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:07:25.921305] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:25.921352] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41628 [2024-09-11 16:07:25.956531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:26.044092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:26.044139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:26.044182] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:26.044192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:26.044374] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:07:26.119945] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41628, magic:0x78563412 [2024-09-11 16:07:26.119988] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:26.119996] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:26.156659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:26.244673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:26.244716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:26.244724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:26.244733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:26.258350] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:26.281930] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042046281926, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:07:26.288757] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042046288755, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:07:26.356918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:26.411265] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:26.445077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:26.445121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:26.445129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:26.445139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:26.521942] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:26.521988] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41644 [2024-09-11 16:07:26.557038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:26.645433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:26.645477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:26.645485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:26.645495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:26.720253] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41644, magic:0x78563412 [2024-09-11 16:07:26.720287] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:26.720295] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:26.757182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:26.845736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:26.845779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:26.845787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:26.845796] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:26.957370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:27.046090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:27.046135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:27.046143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:27.046153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:27.122046] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:27.122107] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41654 [2024-09-11 16:07:27.157495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:27.246451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:27.246494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:27.246502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:27.246511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:27.258542] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:27.291407] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042047291402, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1009476, add_bytes: 0 [2024-09-11 16:07:27.296368] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042047296366, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:07:27.320709] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41654, magic:0x78563412 [2024-09-11 16:07:27.320752] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:27.320760] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:27.357673] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:27.412242] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=125] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:27.446811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:27.446857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:27.446865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:27.446874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:27.562203] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4347, replace_start_pos=11500000, replace_num=100000) [2024-09-11 16:07:27.562252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:27.647219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:27.647264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:27.647272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:27.647301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:27.722816] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:27.722861] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41662 [2024-09-11 16:07:27.762335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:27.847548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:27.847590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:27.847598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:27.847607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:27.855288] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7669, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:07:27.921146] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41662, magic:0x78563412 [2024-09-11 16:07:27.921188] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:27.921198] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:27.962450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:28.055612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:28.055654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:28.055662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:28.055672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:28.162617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:28.256005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:28.256062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:28.256071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:28.256080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:28.258734] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:28.297183] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042048297179, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1005777, add_bytes: 0 [2024-09-11 16:07:28.304037] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042048304033, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:07:28.322990] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:28.323035] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41670 [2024-09-11 16:07:28.362820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:28.413464] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:28.456447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:28.456493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:28.456501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:28.456511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:28.521731] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41670, magic:0x78563412 [2024-09-11 16:07:28.521773] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:28.521781] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:28.563012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:28.656806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:28.656850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:28.656858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:28.656868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:28.763232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:28.857185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:28.857228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:28.857236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:28.857246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:28.923566] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:28.923610] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41672 [2024-09-11 16:07:28.963352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:29.057546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:29.057590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:29.057598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:29.057608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:29.122190] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41672, magic:0x78563412 [2024-09-11 16:07:29.122232] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:29.122240] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:29.163518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:29.257971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:29.258015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:29.258022] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:29.258048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:29.258849] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:29.304788] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042049304784, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:07:29.311532] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042049311529, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007496, add_bytes: 0 [2024-09-11 16:07:29.363704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:29.414334] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:29.458342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:29.458383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:29.458391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:29.458400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:29.524113] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:29.524157] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41676 [2024-09-11 16:07:29.563829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:29.658698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:29.658742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:29.658750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:29.658760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:29.722795] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41676, magic:0x78563412 [2024-09-11 16:07:29.722834] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:29.722842] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:29.768032] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4021, replace_start_pos=11600000, replace_num=100000) [2024-09-11 16:07:29.768076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:29.859007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:29.859062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:29.859070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:29.859079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:29.867623] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8530, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:07:29.968165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:30.067987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:30.068031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:30.068039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:30.068048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:30.123889] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:30.123947] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41688 [2024-09-11 16:07:30.168347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:30.258932] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=10] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:30.268353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:30.268386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:30.268393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:30.268402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:30.312401] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042050312396, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:07:30.319164] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042050319161, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:07:30.322549] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41688, magic:0x78563412 [2024-09-11 16:07:30.322578] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:30.322586] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:30.368473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:30.415275] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:30.468705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:30.468748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:30.468756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:30.468766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:30.568592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:30.669084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:30.669126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:30.669133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:30.669142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:30.724269] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:30.724311] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41694 [2024-09-11 16:07:30.768708] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:30.869442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:30.869483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:30.869491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:30.869501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:30.923002] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41694, magic:0x78563412 [2024-09-11 16:07:30.923102] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=95] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:30.923112] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:30.968829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:31.069838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:31.069885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:31.069893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:31.069924] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:31.169011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:31.259171] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=82] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:31.270165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:31.270211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:31.270218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:31.270228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:31.320024] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=76] PNIO [ratelimit] time: 1726042051320019, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:07:31.324810] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:31.324843] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41696 [2024-09-11 16:07:31.326776] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042051326773, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:07:31.369136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:31.416608] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:31.470539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:31.470585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:31.470593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:31.470602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:31.523233] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41696, magic:0x78563412 [2024-09-11 16:07:31.523275] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:31.523282] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:31.569277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:31.573641] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:31.573667] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:31.573748] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=107, max_check_version=108, global_version=109) [2024-09-11 16:07:31.575770] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2021 [2024-09-11 16:07:31.575811] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:31.575847] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:07:31.575917] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:07:31.576003] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:31.576111] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:07:31.576161] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:07:31.576176] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:07:31.576188] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:07:31.576224] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:07:31.576283] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:07:31.576308] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:07:31.670870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:31.670932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:31.670941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:31.670951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:31.769389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:31.871257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:31.871300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:31.871308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:31.871318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:31.879912] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8582, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:07:31.925735] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:31.925777] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41712 [2024-09-11 16:07:31.973790] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4260, replace_start_pos=11700000, replace_num=100000) [2024-09-11 16:07:31.973827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:32.080246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:32.080293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:32.080301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:32.080310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:32.123750] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41712, magic:0x78563412 [2024-09-11 16:07:32.123791] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:32.123798] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:32.173924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:32.259348] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:32.280618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:32.280664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:32.280672] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:32.280682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:32.327751] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042052327747, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007728, add_bytes: 0 [2024-09-11 16:07:32.334381] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042052334378, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:07:32.374043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:32.417624] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:32.481008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:32.481050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:32.481057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:32.481067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:32.526186] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:32.526228] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41724 [2024-09-11 16:07:32.574142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:32.681364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:32.681401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:32.681409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:32.681419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:32.724252] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41724, magic:0x78563412 [2024-09-11 16:07:32.724293] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:32.724301] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:32.774262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:32.881719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:32.881763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:32.881771] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:32.881781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:32.974390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:33.082088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:33.082131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:33.082139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:33.082149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:33.125377] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:33.125420] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41740 [2024-09-11 16:07:33.174576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:33.259571] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:33.282465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:33.282505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:33.282513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:33.282523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:33.323643] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41740, magic:0x78563412 [2024-09-11 16:07:33.323703] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:33.323711] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:33.335303] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042053335299, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:07:33.342067] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042053342063, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:07:33.374787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:33.418919] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:33.482820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:33.482864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:33.482872] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:33.482882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:33.574918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:33.683184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:33.683230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:33.683238] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:33.683248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:33.725954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:33.725999] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41746 [2024-09-11 16:07:33.775096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:33.883548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:33.883593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:33.883601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:33.883612] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:33.892203] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8577, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:07:33.924253] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41746, magic:0x78563412 [2024-09-11 16:07:33.924309] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:33.924316] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:33.975223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:34.092527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:34.092567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:34.092575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:34.092585] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:34.179548] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4203, replace_start_pos=11800000, replace_num=100000) [2024-09-11 16:07:34.179593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:34.259771] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:34.292893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:34.292964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:34.292973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:34.292983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:34.326537] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:34.326580] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41758 [2024-09-11 16:07:34.342969] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042054342964, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:07:34.349624] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042054349621, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:07:34.379741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:34.419682] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:34.493238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:34.493283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:34.493290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:34.493322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:34.524697] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41758, magic:0x78563412 [2024-09-11 16:07:34.524737] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:34.524744] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:34.579864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:34.693627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:34.693668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:34.693676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:34.693685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:34.780006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:34.894025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:34.894070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:34.894078] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:34.894087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:34.925821] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:34.925865] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:41770 [2024-09-11 16:07:34.980124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:35.094391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:35.094448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:35.094457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:35.094468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:35.124713] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:41770, magic:0x78563412 [2024-09-11 16:07:35.124748] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:35.124755] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:35.180230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:35.259963] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:35.294768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:35.294813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:35.294821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:35.294831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:35.350539] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042055350533, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007569, add_bytes: 0 [2024-09-11 16:07:35.357295] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726042055357292, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:07:35.380403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:35.420583] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:35.495083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:35.495122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:35.495129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:35.495138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:35.525969] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:35.525999] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21574 [2024-09-11 16:07:35.580593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:35.695459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:35.695507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:35.695515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:35.695525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:35.724112] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21574, magic:0x78563412 [2024-09-11 16:07:35.724153] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:35.724160] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:35.780743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:35.895780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:35.895825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:35.895833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:35.895843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:35.902701] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6845, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:07:35.980869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:36.102999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:36.103039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:36.103046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:36.103055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:36.125557] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:36.125599] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21582 [2024-09-11 16:07:36.180997] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:36.260176] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:36.303331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:36.303379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:36.303386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:36.303396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:36.323915] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21582, magic:0x78563412 [2024-09-11 16:07:36.323956] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:36.323963] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:36.358111] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042056358104, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007571, add_bytes: 0 [2024-09-11 16:07:36.364870] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042056364866, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 16:07:36.385448] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4348, replace_start_pos=11900000, replace_num=100000) [2024-09-11 16:07:36.385490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:36.421888] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:36.503639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:36.503685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:36.503692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:36.503701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:36.585649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:36.703972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:36.704017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:36.704041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:36.704051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:36.704267] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=95, refresh_score_time=64, wash_time=0) [2024-09-11 16:07:36.725524] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:36.725565] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21596 [2024-09-11 16:07:36.785824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:36.904500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:36.904542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:36.904549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:36.904558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:36.924260] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21596, magic:0x78563412 [2024-09-11 16:07:36.924298] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:36.924306] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:36.986009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:37.104787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:37.104834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:37.104842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:37.104851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:37.186253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:37.260306] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:37.305171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:37.305214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:37.305222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:37.305232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:37.326876] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:37.326937] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21602 [2024-09-11 16:07:37.365714] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042057365711, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:07:37.372473] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042057372470, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:07:37.386376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:37.423010] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:37.505534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:37.505579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:37.505587] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:37.505597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:37.524726] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21602, magic:0x78563412 [2024-09-11 16:07:37.524755] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:37.524762] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:37.586560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:37.705921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:37.705966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:37.705974] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:37.705984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:37.786679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:37.906256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:37.906302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:37.906310] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:37.906319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:37.913195] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6862, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:07:37.926766] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:37.926807] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21618 [2024-09-11 16:07:37.986797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:38.113517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:38.113559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:38.113566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:38.113575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:38.125014] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21618, magic:0x78563412 [2024-09-11 16:07:38.125051] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:38.125058] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:38.186912] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:38.260487] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:38.313868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:38.313934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:38.313948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:38.313956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:38.373397] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042058373393, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:07:38.380099] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042058380095, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:07:38.387041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:38.424142] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:38.514255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:38.514298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:38.514306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:38.514316] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:38.526986] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:38.527029] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21628 [2024-09-11 16:07:38.591474] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4321, replace_start_pos=12000000, replace_num=100000) [2024-09-11 16:07:38.591519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:38.714612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:38.714656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:38.714664] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:38.714673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:38.725840] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21628, magic:0x78563412 [2024-09-11 16:07:38.725876] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:38.725883] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:38.791602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:38.914920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:38.914959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:38.914966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:38.914975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:38.991714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:39.115328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:39.115377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:39.115385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:39.115395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:39.127958] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:39.128004] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21630 [2024-09-11 16:07:39.191832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:39.260680] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:39.315718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:39.315764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:39.315772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:39.315781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:39.326280] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21630, magic:0x78563412 [2024-09-11 16:07:39.326322] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:39.326330] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:39.381000] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042059380995, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:07:39.387703] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042059387700, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:07:39.391948] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:39.425089] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:39.516104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:39.516147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:39.516156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:39.516165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:39.592037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:39.716467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:39.716511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:39.716519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:39.716529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:39.728399] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:39.728436] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21646 [2024-09-11 16:07:39.792155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:39.916834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:39.916880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:39.916888] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:39.916898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:39.923915] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6960, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:07:39.926734] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21646, magic:0x78563412 [2024-09-11 16:07:39.926760] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:39.926766] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:39.992265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:40.124267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:40.124314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:40.124322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:40.124332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:40.192381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:40.260865] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:40.324636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:40.324682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:40.324690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:40.324700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:40.328456] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:40.328489] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21648 [2024-09-11 16:07:40.388552] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042060388547, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:07:40.392497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:40.395318] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042060395317, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:07:40.426021] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:40.525024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:40.525069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:40.525095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:40.525105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:40.526973] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21648, magic:0x78563412 [2024-09-11 16:07:40.527001] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:40.527008] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:40.592587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:40.725409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:40.725451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:40.725459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:40.725468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:40.796194] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3494, replace_start_pos=12100000, replace_num=100000) [2024-09-11 16:07:40.796241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:40.925766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:40.925810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:40.925818] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:40.925827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:40.928875] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:40.928919] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21652 [2024-09-11 16:07:40.996322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:41.126151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:41.126191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:41.126199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:41.126208] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:41.127539] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21652, magic:0x78563412 [2024-09-11 16:07:41.127569] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:41.127578] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:41.196438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:41.261044] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=103] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:41.326504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:41.326546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:41.326554] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:41.326563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:41.396166] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1726042061396162, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:07:41.396542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:41.402961] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042061402958, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2024-09-11 16:07:41.426802] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:41.526876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:41.526945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:41.526954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:41.526965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:41.529745] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:41.529789] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21660 [2024-09-11 16:07:41.589579] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:41.589630] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:41.589710] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=108, max_check_version=109, global_version=110) [2024-09-11 16:07:41.591717] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2007 [2024-09-11 16:07:41.591755] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:41.591790] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:07:41.591827] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:07:41.591943] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:41.592052] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:07:41.592106] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:07:41.592117] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:07:41.592128] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:07:41.592167] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:07:41.592227] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:07:41.592249] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:07:41.596625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:41.727264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:41.727304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:41.727312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:41.727321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:41.727961] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21660, magic:0x78563412 [2024-09-11 16:07:41.727980] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:41.727987] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:41.796710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:41.927558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:41.927598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:41.927606] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:41.927615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:41.934954] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7325, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:07:41.996892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:42.129568] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:42.129614] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21668 [2024-09-11 16:07:42.135211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:42.135242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:42.135249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:42.135258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:42.197049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:42.261161] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:42.328329] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21668, magic:0x78563412 [2024-09-11 16:07:42.328371] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:42.328379] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:42.335492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:42.335544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:42.335551] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:42.335559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:42.397236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:42.403814] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042062403809, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007647, add_bytes: 0 [2024-09-11 16:07:42.410568] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042062410565, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:07:42.427654] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:42.535857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:42.535919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:42.535930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:42.535940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:42.597358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:42.729920] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:42.729965] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21680 [2024-09-11 16:07:42.736171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:42.736206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:42.736214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:42.736224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:42.797550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:42.928661] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21680, magic:0x78563412 [2024-09-11 16:07:42.928703] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:42.928710] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:42.936450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:42.936503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:42.936510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:42.936519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:43.001135] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3390, replace_start_pos=12200000, replace_num=100000) [2024-09-11 16:07:43.001183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:43.136852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:43.136896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:43.136930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:43.136940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:43.201267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:43.261292] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:43.329335] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:43.329391] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21694 [2024-09-11 16:07:43.337174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:43.337209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:43.337218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:43.337227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:43.401451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:43.411534] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042063411529, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007720, add_bytes: 0 [2024-09-11 16:07:43.418160] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042063418157, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:07:43.428636] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:43.528107] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=1624] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21694, magic:0x78563412 [2024-09-11 16:07:43.528151] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:43.528176] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:43.537526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:43.537571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:43.537579] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:43.537588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:43.601665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:43.737916] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:43.737955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:43.737963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:43.737973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:43.801842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:43.929930] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:43.929976] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21706 [2024-09-11 16:07:43.938265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:43.938298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:43.938305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:43.938315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:43.946112] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7785, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:07:44.001983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:44.128519] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21706, magic:0x78563412 [2024-09-11 16:07:44.128563] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:44.128572] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:44.146466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:44.146510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:44.146518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:44.146527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:44.202208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:44.261420] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:44.346827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:44.346873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:44.346881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:44.346890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:44.402331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:44.419093] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042064419089, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:07:44.425799] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042064425795, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 16:07:44.429576] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=46] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:44.530977] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:44.531022] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21720 [2024-09-11 16:07:44.547260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:44.547304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:44.547312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:44.547322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:44.602528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:44.729206] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21720, magic:0x78563412 [2024-09-11 16:07:44.729245] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:44.729254] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:44.747586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:44.747629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:44.747637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:44.747646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:44.802655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:44.947871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:44.947926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:44.947935] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:44.947945] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:45.002768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:45.130591] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:45.130635] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:21730 [2024-09-11 16:07:45.148272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:45.148331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:45.148340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:45.148350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:45.206203] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3316, replace_start_pos=12300000, replace_num=100000) [2024-09-11 16:07:45.206247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:45.261622] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:45.329387] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:21730, magic:0x78563412 [2024-09-11 16:07:45.329433] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:45.329441] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:45.348671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:45.348718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:45.348726] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:45.348736] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:45.406401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:45.426647] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042065426644, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:07:45.430614] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:45.433453] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042065433451, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007656, add_bytes: 0 [2024-09-11 16:07:45.549017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:45.549062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:45.549070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:45.549079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:45.606523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:45.731647] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:45.731709] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57542 [2024-09-11 16:07:45.749407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:45.749452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:45.749460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:45.749470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:45.806650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:45.930079] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57542, magic:0x78563412 [2024-09-11 16:07:45.930122] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:45.930129] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:45.949771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:45.949815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:45.949823] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:45.949832] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:45.957555] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7709, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:07:46.006840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:46.157885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:46.157960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:46.157969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:46.158000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:46.207034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:46.261853] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:46.331090] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:46.331134] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57550 [2024-09-11 16:07:46.358237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:46.358281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:46.358290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:46.358299] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:46.407174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:46.431522] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:46.434317] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042066434313, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:07:46.441009] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042066441006, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:07:46.529347] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57550, magic:0x78563412 [2024-09-11 16:07:46.529390] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:46.529398] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:46.558610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:46.558657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:46.558665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:46.558675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:46.607292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:46.759011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:46.759058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:46.759066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:46.759092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:46.807401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:46.931344] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:46.931384] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57564 [2024-09-11 16:07:46.959319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:46.959350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:46.959356] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:46.959364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:47.007583] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:47.129770] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57564, magic:0x78563412 [2024-09-11 16:07:47.129814] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:47.129823] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:47.159590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:47.159629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:47.159635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:47.159644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:47.207784] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:47.262004] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:47.359891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:47.359949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:47.359955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:47.359965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:47.412274] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4346, replace_start_pos=12400000, replace_num=100000) [2024-09-11 16:07:47.412322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:47.432491] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:47.441932] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042067441928, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:07:47.448705] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042067448702, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 16:07:47.532287] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:47.532326] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57572 [2024-09-11 16:07:47.560221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:47.560264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:47.560272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:47.560281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:47.612414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:47.730390] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57572, magic:0x78563412 [2024-09-11 16:07:47.730431] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:47.730439] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:47.760517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:47.760553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:47.760560] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:47.760569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:47.812656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:47.960897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:47.960963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:47.960971] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:47.960980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:47.969441] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8447, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:07:48.012767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:48.131864] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:48.131932] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=61] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57586 [2024-09-11 16:07:48.169695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:48.169737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:48.169744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:48.169752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:48.212889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:48.262110] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:48.330639] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57586, magic:0x78563412 [2024-09-11 16:07:48.330680] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:48.330699] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:48.369997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:48.370036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:48.370043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:48.370052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:48.413040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:48.433830] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:48.449491] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042068449486, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:07:48.456257] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042068456254, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:07:48.570294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:48.570336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:48.570343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:48.570353] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:48.613180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:48.732593] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:48.732632] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57602 [2024-09-11 16:07:48.770574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:48.770615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:48.770621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:48.770629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:48.813366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:48.930992] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57602, magic:0x78563412 [2024-09-11 16:07:48.931032] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:48.931039] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:48.970871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:48.972808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=1934][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:48.972827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:48.972840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:49.013498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:49.173137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:49.173181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:49.173189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:49.173199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:49.213625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:49.262237] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:49.332421] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:49.332467] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57604 [2024-09-11 16:07:49.373498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:49.373544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:49.373553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:49.373563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:49.413737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:49.434921] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:49.457168] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042069457163, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:07:49.463944] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042069463941, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:07:49.530483] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57604, magic:0x78563412 [2024-09-11 16:07:49.530524] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:49.530551] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:49.573858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:49.573924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:49.573936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:49.573946] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:49.617255] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3373, replace_start_pos=12500000, replace_num=100000) [2024-09-11 16:07:49.617302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:49.774185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:49.774228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:49.774236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:49.774245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:49.817396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:49.932680] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:49.932722] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57614 [2024-09-11 16:07:49.974477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:49.974514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:49.974521] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:49.974530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:49.982710] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8151, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:07:50.017518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:50.131022] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57614, magic:0x78563412 [2024-09-11 16:07:50.131069] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:50.131081] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:50.182989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:50.183026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:50.183033] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:50.183041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:50.217653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:50.262351] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:50.383273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:50.383314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:50.383322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:50.383331] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:50.417772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:50.436006] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:50.464726] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042070464722, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:07:50.471469] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042070471466, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007525, add_bytes: 0 [2024-09-11 16:07:50.530536] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:50.530572] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57622 [2024-09-11 16:07:50.583649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:50.583687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:50.583694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:50.583716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:50.617886] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:50.729223] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57622, magic:0x78563412 [2024-09-11 16:07:50.729268] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:50.729276] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:50.783977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:50.784024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:50.784032] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:50.784041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:50.818012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:50.984281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:50.984327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:50.984334] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:50.984344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:51.018124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:51.130891] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:51.130946] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57624 [2024-09-11 16:07:51.184583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:51.184623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:51.184630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:51.184639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:51.218253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:51.262494] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:51.329430] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57624, magic:0x78563412 [2024-09-11 16:07:51.329471] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:51.329480] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:51.384869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:51.384915] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:51.384924] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:51.384933] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:51.418384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:51.437023] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:51.472335] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726042071472332, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:07:51.479105] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042071479101, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:07:51.585208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:51.585249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:51.585257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:51.585267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:51.605008] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:51.605055] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:07:51.605162] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] update_check_range(min_check_version=109, max_check_version=110, global_version=111) [2024-09-11 16:07:51.607202] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2039 [2024-09-11 16:07:51.607243] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:51.607278] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:07:51.607317] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:07:51.607400] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:07:51.607522] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:07:51.607578] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:07:51.607589] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:07:51.607600] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:07:51.607637] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:07:51.607701] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:07:51.607722] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:07:51.618503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:51.731693] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:51.731738] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57626 [2024-09-11 16:07:51.785566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:51.785607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:51.785615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:51.785625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:51.823033] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4358, replace_start_pos=0, replace_num=100000) [2024-09-11 16:07:51.823082] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:51.930075] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57626, magic:0x78563412 [2024-09-11 16:07:51.930107] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:51.930113] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:51.986000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:51.986043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:51.986050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:51.986060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:51.993669] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7597, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:07:52.023193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:52.194056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:52.194100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:52.194108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:52.194117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:52.223375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:52.262605] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:52.331983] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:52.332023] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57640 [2024-09-11 16:07:52.394471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:52.394516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:52.394524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:52.394534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:52.423557] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:52.437952] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:52.479967] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042072479963, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:07:52.486769] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042072486766, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:07:52.529357] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57640, magic:0x78563412 [2024-09-11 16:07:52.529412] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:52.529420] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:52.594851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:52.594889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:52.594896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:52.594927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:52.623739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:52.795160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:52.795207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:52.795216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:52.795225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:52.823855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:52.931096] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:52.931140] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57646 [2024-09-11 16:07:52.995459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:52.995506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:52.995514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:52.995523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:53.023955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:53.129784] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57646, magic:0x78563412 [2024-09-11 16:07:53.129834] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:53.129842] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:53.195777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:53.195827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:53.195835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:53.195845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:53.224073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:53.262735] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:53.396141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:53.396197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:53.396213] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:53.396225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:53.424317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:53.438959] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:53.487559] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042073487555, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:07:53.494383] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042073494381, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:07:53.531821] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:53.531859] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57648 [2024-09-11 16:07:53.596516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:53.596559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:53.596567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:53.596576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:53.624502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:53.730128] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57648, magic:0x78563412 [2024-09-11 16:07:53.730173] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:53.730181] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:53.796819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:53.796862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:53.796869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:53.796879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:53.824618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:53.997097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:53.997132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:53.997138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:53.997146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:54.005017] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7857, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:07:54.029060] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4341, replace_start_pos=100000, replace_num=100000) [2024-09-11 16:07:54.029107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:54.132063] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:54.132126] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57650 [2024-09-11 16:07:54.205263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:54.205304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:54.205312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:54.205320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:54.229252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:54.262847] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:54.330605] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57650, magic:0x78563412 [2024-09-11 16:07:54.330626] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:54.330633] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:54.405556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:54.405591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:54.405598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:54.405607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:54.429435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:54.440058] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:54.495207] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042074495201, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007646, add_bytes: 0 [2024-09-11 16:07:54.501942] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042074501938, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:07:54.605853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:54.605899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:54.605932] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:54.605941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:54.629618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:54.733406] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:54.733441] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57664 [2024-09-11 16:07:54.806171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:54.806215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:54.806223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:54.806232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:54.829757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:54.930733] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57664, magic:0x78563412 [2024-09-11 16:07:54.930774] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:54.930783] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:55.006521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:55.006563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:55.006570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:55.006581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:55.029951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:55.206804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:55.206847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:55.206855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:55.206881] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:55.230138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:55.263046] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:55.332872] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:55.332932] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:57668 [2024-09-11 16:07:55.407177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:55.407215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:55.407224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:55.407233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:55.430329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:55.441182] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:55.502808] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042075502804, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:07:55.509623] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042075509620, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:07:55.531142] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:57668, magic:0x78563412 [2024-09-11 16:07:55.531178] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:55.531186] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:55.607532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:55.607572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:55.607580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:55.607590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:55.630514] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:55.807889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:55.807953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:55.807961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:55.807987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:55.830631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:55.932612] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:55.932657] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3780 [2024-09-11 16:07:56.008291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:56.008337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:56.008344] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:56.008354] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:56.016791] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8424, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:07:56.030820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:56.130602] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3780, magic:0x78563412 [2024-09-11 16:07:56.130642] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:56.130650] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:56.217055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:56.217099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:56.217107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:56.217116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:56.217318] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:07:56.235359] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4358, replace_start_pos=200000, replace_num=100000) [2024-09-11 16:07:56.235407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:56.263188] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:56.417615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:56.417662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:56.417670] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:56.417679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:56.435555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:56.442069] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:56.510431] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042076510428, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:07:56.517237] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042076517233, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:07:56.532399] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:56.532444] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3792 [2024-09-11 16:07:56.618002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:56.618043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:56.618051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:56.618060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:56.635738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:56.730987] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3792, magic:0x78563412 [2024-09-11 16:07:56.731023] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:56.731031] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:56.818354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:56.818398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:56.818424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:56.818434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:56.835920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:57.018727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:57.018771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:57.018779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:57.018788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:57.019029] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=77, refresh_score_time=64, wash_time=0) [2024-09-11 16:07:57.036107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:57.133254] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:57.133297] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3798 [2024-09-11 16:07:57.219331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:57.219371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:57.219379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:57.219388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:57.236283] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:57.263378] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:57.331775] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3798, magic:0x78563412 [2024-09-11 16:07:57.331832] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:57.331840] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:57.419618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:57.419661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:57.419669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:57.419678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:57.436462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:57.442989] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:57.518027] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042077518023, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 16:07:57.524853] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042077524849, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:07:57.619936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:57.619975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:57.619983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:57.619992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:57.636671] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:07:57.734509] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:57.734554] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3814 [2024-09-11 16:07:57.820218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:57.820259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:57.820267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:57.820276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:57.836792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:07:57.932190] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3814, magic:0x78563412 [2024-09-11 16:07:57.932246] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:57.932253] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:58.020512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:58.020553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:58.020562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:58.020571] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:58.028033] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7449, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:07:58.036975] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:07:58.228302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:58.228347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:58.228354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:58.228363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:58.237152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:07:58.263500] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:58.334496] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:58.334539] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3828 [2024-09-11 16:07:58.428588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:58.428641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:58.428670] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:58.428681] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:58.441663] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=300000, replace_num=100000) [2024-09-11 16:07:58.441709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:07:58.443811] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:58.525711] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042078525707, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:07:58.531485] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3828, magic:0x78563412 [2024-09-11 16:07:58.531526] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:58.531534] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:58.532401] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042078532398, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:07:58.628941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:58.628986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:58.628994] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:58.629003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:58.641789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:07:58.829297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:58.829342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:58.829350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:58.829359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:58.841965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:07:58.934028] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:58.934069] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3830 [2024-09-11 16:07:59.029661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:59.029731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:59.029740] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:59.029749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:59.042153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:07:59.132332] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3830, magic:0x78563412 [2024-09-11 16:07:59.132373] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:59.132381] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:59.230102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:59.230144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:59.230152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:59.230161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:59.242369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:07:59.263634] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:07:59.430393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:59.430440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:59.430447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:59.430455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:59.442497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:07:59.444652] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:07:59.533263] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042079533258, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:07:59.534929] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:07:59.534965] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3840 [2024-09-11 16:07:59.540028] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042079540024, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:07:59.630775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:59.630823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:59.630831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:59.630840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:59.642697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:07:59.732886] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3840, magic:0x78563412 [2024-09-11 16:07:59.732936] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:07:59.732944] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:07:59.831135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:07:59.831179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:07:59.831187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:07:59.831197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:07:59.842887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:00.031448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:00.031489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:00.031497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:00.031506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:00.039030] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7510, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:08:00.043036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:00.133680] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:00.133723] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3850 [2024-09-11 16:08:00.239385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:00.239429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:00.239437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:00.239446] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:00.243214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:00.263748] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:00.332382] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3850, magic:0x78563412 [2024-09-11 16:08:00.332415] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:00.332422] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:00.439738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:00.439781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:00.439789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:00.439799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:00.443379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:00.445621] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:00.534935] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:08:00.540943] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042080540939, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:08:00.540981] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:08:00.546386] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:08:00.547725] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726042080547724, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 16:08:00.547769] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:08:00.640094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:00.640137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:00.640145] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:00.640154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:00.647920] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4373, replace_start_pos=400000, replace_num=100000) [2024-09-11 16:08:00.647969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:00.734767] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:00.734812] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3862 [2024-09-11 16:08:00.840504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:00.840548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:00.840556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:00.840566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:00.848121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:00.931829] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3862, magic:0x78563412 [2024-09-11 16:08:00.931874] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:00.931883] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:01.040861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:01.040926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:01.040952] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:01.040961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:01.048306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:01.241201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:01.241245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:01.241253] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:01.241262] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:01.248431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:01.263892] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:01.333819] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:01.333852] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3870 [2024-09-11 16:08:01.441559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:01.441601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:01.441609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:01.441619] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:01.447331] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:01.448612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:01.532410] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3870, magic:0x78563412 [2024-09-11 16:08:01.532451] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:01.532459] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:01.548486] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726042081548484, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:08:01.555258] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042081555255, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007531, add_bytes: 0 [2024-09-11 16:08:01.622474] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:01.622542] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=66] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:01.622623] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=110, max_check_version=111, global_version=112) [2024-09-11 16:08:01.624646] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2023 [2024-09-11 16:08:01.624685] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:01.624720] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:08:01.624758] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:08:01.624844] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:01.624984] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:08:01.625044] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:08:01.625055] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:08:01.625066] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:08:01.625107] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:08:01.625168] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:08:01.625189] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:08:01.641937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:01.641980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:01.641988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:01.641997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:01.648813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:01.842304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:01.842348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:01.842356] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:01.842366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:01.849036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:01.934971] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:01.935015] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3884 [2024-09-11 16:08:02.042661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:02.042705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:02.042713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:02.042723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:02.049164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:02.050536] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7800, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:08:02.133074] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3884, magic:0x78563412 [2024-09-11 16:08:02.133107] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:02.133113] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:02.249345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:02.250770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:02.250806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:02.250814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:02.250823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:02.264008] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:02.448294] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:02.449548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:02.451056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:02.451085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:02.451093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:02.451102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:02.534705] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:02.534747] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3886 [2024-09-11 16:08:02.556100] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042082556096, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:08:02.562934] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042082562931, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:08:02.649687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:02.651410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:02.651444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:02.651451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:02.651459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:02.733367] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3886, magic:0x78563412 [2024-09-11 16:08:02.733406] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:02.733412] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:02.851691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:02.851734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:02.851741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:02.851751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:02.854303] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4374, replace_start_pos=500000, replace_num=100000) [2024-09-11 16:08:02.854342] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:03.052061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:03.052105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:03.052113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:03.052123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:03.054455] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:03.135285] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:03.135329] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3896 [2024-09-11 16:08:03.252356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:03.252398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:03.252405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:03.252415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:03.254577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:03.264171] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:03.333705] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3896, magic:0x78563412 [2024-09-11 16:08:03.333741] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:03.333749] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:03.449473] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:03.452654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:03.452687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:03.452695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:03.452703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:03.454674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:03.563718] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042083563715, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:08:03.570547] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042083570544, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:08:03.653036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:03.653080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:03.653088] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:03.653097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:03.654843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:03.735719] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:03.735757] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3902 [2024-09-11 16:08:03.853414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:03.853458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:03.853466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:03.853475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:03.855001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:03.934275] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3902, magic:0x78563412 [2024-09-11 16:08:03.934310] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:03.934316] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:04.053728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:04.053786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:04.053795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:04.053821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:04.055111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:04.062006] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8172, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:08:04.255211] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:04.262338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:04.262378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:04.262386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:04.262395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:04.264286] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:04.335683] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:04.335725] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3904 [2024-09-11 16:08:04.450512] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:04.455318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:04.462687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:04.462723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:04.462731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:04.462741] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:04.534467] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3904, magic:0x78563412 [2024-09-11 16:08:04.534509] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:04.534516] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:04.571423] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042084571420, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007705, add_bytes: 0 [2024-09-11 16:08:04.578166] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042084578163, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:08:04.655429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:04.663059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:04.663098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:04.663106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:04.663116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:04.855564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:04.863364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:04.863402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:04.863410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:04.863419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:04.935285] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:04.935332] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:3910 [2024-09-11 16:08:05.060018] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=600000, replace_num=100000) [2024-09-11 16:08:05.060065] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:05.063643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:05.063710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:05.063734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:05.063777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:05.133972] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:3910, magic:0x78563412 [2024-09-11 16:08:05.134013] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:05.134021] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:05.260158] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:05.264138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:05.264204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:05.264212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:05.264221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:05.264408] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:05.451604] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:05.460336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:05.464540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:05.464574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:05.464582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:05.464591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:05.536493] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:05.536534] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54084 [2024-09-11 16:08:05.579017] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042085579013, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:08:05.585729] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042085585725, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:08:05.660454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:05.664881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:05.664936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:05.664946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:05.664955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:05.734476] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54084, magic:0x78563412 [2024-09-11 16:08:05.734519] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:05.734526] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:05.860633] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:05.865196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:05.865228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:05.865236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:05.865245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:06.060811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:06.065531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:06.065557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:06.065565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:06.065574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:06.072576] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6990, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:08:06.136822] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:06.136865] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54090 [2024-09-11 16:08:06.260968] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:06.264504] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=18] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:06.272803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:06.272837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:06.272843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:06.272852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:06.335056] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54090, magic:0x78563412 [2024-09-11 16:08:06.335098] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:06.335107] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:06.452528] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:06.461088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:06.473082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:06.473123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:06.473130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:06.473138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:06.586643] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042086586639, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:08:06.593339] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042086593335, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:08:06.661215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:06.673352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:06.673394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:06.673401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:06.673408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:06.736659] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:06.736700] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54098 [2024-09-11 16:08:06.861397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:06.873703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:06.873745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:06.873753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:06.873762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:06.935328] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54098, magic:0x78563412 [2024-09-11 16:08:06.935369] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:06.935378] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:07.061620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:07.074080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:07.074123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:07.074131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:07.074141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:07.264658] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:07.266049] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4216, replace_start_pos=700000, replace_num=100000) [2024-09-11 16:08:07.266072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:07.274436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:07.274475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:07.274482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:07.274507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:07.337088] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:07.337133] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54112 [2024-09-11 16:08:07.453630] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:07.466160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:07.474812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:07.474853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:07.474861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:07.474871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:07.535672] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54112, magic:0x78563412 [2024-09-11 16:08:07.535711] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:07.535719] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:07.594202] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042087594198, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:08:07.600950] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042087600947, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:08:07.666302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:07.675166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:07.675203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:07.675210] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:07.675218] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:07.866480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:07.875449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:07.875484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:07.875491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:07.875514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:07.937764] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:07.937808] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54116 [2024-09-11 16:08:08.066663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:08.075808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:08.075850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:08.075858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:08.075869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:08.084111] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8229, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:08:08.136044] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54116, magic:0x78563412 [2024-09-11 16:08:08.136084] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:08.136093] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:08.264859] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:08.266846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:08.284433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:08.284476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:08.284484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:08.284494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:08.454929] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:08.467006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:08.484815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:08.484860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:08.484868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:08.484896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:08.538140] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:08.538187] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54122 [2024-09-11 16:08:08.601823] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042088601818, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:08:08.608565] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042088608561, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:08:08.667189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:08.685211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:08.685251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:08.685259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:08.685270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:08.736587] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54122, magic:0x78563412 [2024-09-11 16:08:08.736622] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:08.736630] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:08.867324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:08.885508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:08.885552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:08.885559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:08.885568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:09.067506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:09.085875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:09.085931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:09.085940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:09.085950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:09.138055] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:09.138098] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54130 [2024-09-11 16:08:09.265028] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:09.267707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:09.286249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:09.286293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:09.286301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:09.286310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:09.335895] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54130, magic:0x78563412 [2024-09-11 16:08:09.335958] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=57] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:09.335967] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:09.456363] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:09.472200] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=800000, replace_num=100000) [2024-09-11 16:08:09.472242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:09.486632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:09.486673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:09.486679] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:09.486687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:09.609422] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042089609419, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:08:09.616253] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042089616249, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:08:09.672394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:09.686955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:09.686992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:09.686999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:09.687008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:09.736817] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:09.736858] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54138 [2024-09-11 16:08:09.872626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:09.887324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:09.887369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:09.887377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:09.887387] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:09.935134] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54138, magic:0x78563412 [2024-09-11 16:08:09.935176] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:09.935184] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:10.072810] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:10.087728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:10.087793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:10.087802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:10.087813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:10.094872] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7046, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:08:10.265208] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:10.272991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:10.295200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:10.295248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:10.295256] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:10.295267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:10.335844] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:10.335887] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54148 [2024-09-11 16:08:10.457460] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:10.473167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:10.495571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:10.495617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:10.495625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:10.495635] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:10.534411] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54148, magic:0x78563412 [2024-09-11 16:08:10.534446] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:10.534455] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:10.617030] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042090617028, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:08:10.623822] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042090623818, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007569, add_bytes: 0 [2024-09-11 16:08:10.673354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:10.695961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:10.696004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:10.696012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:10.696021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:10.873473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:10.896322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:10.896365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:10.896373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:10.896383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:10.936899] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:10.936959] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54158 [2024-09-11 16:08:11.073594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:11.096691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:11.096736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:11.096744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:11.096754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:11.135090] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54158, magic:0x78563412 [2024-09-11 16:08:11.135146] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:11.135155] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:11.265371] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:11.273722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:11.297038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:11.297076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:11.297083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:11.297092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:11.458665] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:11.473898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:11.497405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:11.497444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:11.497451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:11.497459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:11.536545] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:11.536590] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54174 [2024-09-11 16:08:11.624648] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042091624644, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:08:11.631423] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042091631419, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:08:11.640288] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:11.640330] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:11.640403] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=111, max_check_version=112, global_version=113) [2024-09-11 16:08:11.642122] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1718 [2024-09-11 16:08:11.642168] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:11.642199] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:08:11.642231] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:08:11.642305] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:11.642388] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:08:11.642433] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:08:11.642442] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:08:11.642451] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:08:11.642483] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:08:11.642534] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:08:11.642549] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:08:11.677548] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3437, replace_start_pos=900000, replace_num=100000) [2024-09-11 16:08:11.677593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:11.697677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:11.697720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:11.697726] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:11.697733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:11.734451] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54174, magic:0x78563412 [2024-09-11 16:08:11.734491] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:11.734498] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:11.877777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:11.898054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:11.898100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:11.898108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:11.898118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:12.077968] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:12.098440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:12.098484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:12.098493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:12.098502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:12.106060] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7544, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:08:12.136738] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:12.136782] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54186 [2024-09-11 16:08:12.265549] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:12.278166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:12.306381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:12.306424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:12.306432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:12.306442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:12.334950] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54186, magic:0x78563412 [2024-09-11 16:08:12.334992] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:12.335000] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:12.459720] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:12.478348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:12.506786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:12.506830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:12.506838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:12.506848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:12.632329] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042092632325, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:08:12.639023] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042092639020, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:08:12.678566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:12.707170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:12.707218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:12.707227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:12.707236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:12.737668] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:12.737713] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54190 [2024-09-11 16:08:12.878688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:12.907483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:12.907534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:12.907542] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:12.907551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:12.935589] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54190, magic:0x78563412 [2024-09-11 16:08:12.935630] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:12.935638] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:13.078798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:13.107795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:13.107839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:13.107845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:13.107852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:13.265693] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:13.278998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:13.308145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:13.308187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:13.308195] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:13.308205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:13.337020] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:13.337064] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54194 [2024-09-11 16:08:13.460919] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:13.479126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:13.508508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:13.508558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:13.508566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:13.508576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:13.535781] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54194, magic:0x78563412 [2024-09-11 16:08:13.535822] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:13.535831] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:13.639971] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042093639968, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007643, add_bytes: 0 [2024-09-11 16:08:13.646652] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042093646648, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:08:13.679268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:13.708832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:13.708877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:13.708885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:13.708894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:13.883634] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4160, replace_start_pos=1000000, replace_num=100000) [2024-09-11 16:08:13.883673] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:13.909221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:13.909260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:13.909268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:13.909279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:13.936729] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:13.936772] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54206 [2024-09-11 16:08:14.083850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:14.109510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:14.109552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:14.109559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:14.109567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:14.116045] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6451, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:08:14.135315] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54206, magic:0x78563412 [2024-09-11 16:08:14.135357] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:14.135365] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:14.265825] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:14.284053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:14.316300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:14.316343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:14.316349] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:14.316357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:14.461995] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:14.484238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:14.516688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:14.516732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:14.516739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:14.516748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:14.537652] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:14.537699] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54208 [2024-09-11 16:08:14.647567] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042094647562, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:08:14.654333] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042094654329, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:08:14.684437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:14.717066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:14.717112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:14.717120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:14.717145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:14.735627] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54208, magic:0x78563412 [2024-09-11 16:08:14.735666] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:14.735674] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:14.884551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:14.917382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:14.917428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:14.917435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:14.917444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:15.084721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:15.117692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:15.117733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:15.117741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:15.117751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:15.136827] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:15.136872] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:54218 [2024-09-11 16:08:15.266013] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:15.284841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:15.318022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:15.318068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:15.318075] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:15.318085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:15.335060] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:54218, magic:0x78563412 [2024-09-11 16:08:15.335100] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:15.335109] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:15.463034] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:15.485061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=79] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:15.518339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:15.518385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:15.518393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:15.518402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:15.655197] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042095655193, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:08:15.661878] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042095661875, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:08:15.685185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:15.718644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:15.718693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:15.718702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:15.718712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:15.737307] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:15.737351] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11122 [2024-09-11 16:08:15.885386] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:15.918973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:15.919017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:15.919024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:15.919033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:15.935553] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11122, magic:0x78563412 [2024-09-11 16:08:15.935595] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:15.935603] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:16.089155] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3624, replace_start_pos=1100000, replace_num=100000) [2024-09-11 16:08:16.089201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:16.119246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:16.119283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:16.119289] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:16.119296] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:16.125851] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6543, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:08:16.266155] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:16.289279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:16.326099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:16.326140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:16.326163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:16.326172] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:16.336526] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:16.336562] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11138 [2024-09-11 16:08:16.464145] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:16.489385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:16.526401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:16.526440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:16.526446] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:16.526454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:16.534713] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11138, magic:0x78563412 [2024-09-11 16:08:16.534746] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:16.534754] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:16.662830] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042096662826, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:08:16.669507] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726042096669503, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:08:16.689513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:16.726679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:16.726716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:16.726722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:16.726730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:16.889640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:16.927062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:16.927106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:16.927132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:16.927143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:16.937169] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:16.937209] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11144 [2024-09-11 16:08:17.089767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:17.127372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:17.127417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:17.127425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:17.127434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:17.135441] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11144, magic:0x78563412 [2024-09-11 16:08:17.135476] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:17.135484] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:17.266288] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:17.289885] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:17.327734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:17.327777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:17.327785] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:17.327795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:17.328054] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash time detail, (compute_wash_size_time=93, refresh_score_time=63, wash_time=0) [2024-09-11 16:08:17.465417] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:17.490012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:17.528365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:17.528409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:17.528433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:17.528444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:17.537653] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:17.537696] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11156 [2024-09-11 16:08:17.670439] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042097670435, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:08:17.677110] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042097677106, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:08:17.690135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:17.728674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:17.728718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:17.728725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:17.728735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:17.735832] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11156, magic:0x78563412 [2024-09-11 16:08:17.735885] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:17.735895] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:17.890261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:17.928990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:17.929029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:17.929036] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:17.929046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:18.090456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:18.129304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:18.129342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:18.129349] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:18.129357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:18.136985] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7614, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:08:18.137762] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:18.137795] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11166 [2024-09-11 16:08:18.266401] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:18.295029] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4387, replace_start_pos=1200000, replace_num=100000) [2024-09-11 16:08:18.295072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:18.336205] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11166, magic:0x78563412 [2024-09-11 16:08:18.336246] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:18.336254] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:18.337236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:18.337269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:18.337276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:18.337284] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:18.466542] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:18.495170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:18.537534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:18.537585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:18.537593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:18.537619] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:18.677960] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042098677956, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007521, add_bytes: 0 [2024-09-11 16:08:18.684731] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042098684727, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:08:18.695291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:18.737325] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:18.737366] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11168 [2024-09-11 16:08:18.737862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:18.737888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:18.737894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:18.737925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:18.895402] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:18.935577] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11168, magic:0x78563412 [2024-09-11 16:08:18.935621] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:18.935635] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:18.938160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:18.938194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:18.938202] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:18.938210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:19.095521] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:19.138470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:19.138509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:19.138516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:19.138525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:19.266534] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:19.295621] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:19.336721] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:19.336765] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11174 [2024-09-11 16:08:19.338746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:19.338776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:19.338782] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:19.338791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:19.467688] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:19.495737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:19.534993] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11174, magic:0x78563412 [2024-09-11 16:08:19.535034] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:19.535042] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:19.539038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:19.539071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:19.539078] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:19.539086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:19.685662] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042099685659, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007703, add_bytes: 0 [2024-09-11 16:08:19.692344] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042099692342, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:08:19.695866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:19.739319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:19.739356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:19.739363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:19.739371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:19.895973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:19.935340] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:19.935381] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11182 [2024-09-11 16:08:19.939603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:19.939637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:19.939645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:19.939654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:20.096100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:20.134299] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11182, magic:0x78563412 [2024-09-11 16:08:20.134341] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:20.134351] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:20.139888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:20.139958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:20.139965] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:20.139974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:20.147747] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7755, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:08:20.266653] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:20.296214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:20.348068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:20.348114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:20.348122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:20.348132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:20.468579] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:20.500711] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4375, replace_start_pos=1300000, replace_num=100000) [2024-09-11 16:08:20.500759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:20.536157] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:20.536197] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11196 [2024-09-11 16:08:20.548498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:20.548535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:20.548544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:20.548553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:20.693194] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042100693190, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007531, add_bytes: 0 [2024-09-11 16:08:20.700021] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=205] PNIO [ratelimit] time: 1726042100700018, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:08:20.700847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:20.735002] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11196, magic:0x78563412 [2024-09-11 16:08:20.735060] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:20.735070] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:20.748788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:20.748832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:20.748841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:20.748851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:20.900935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=15] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:20.949082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:20.949122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:20.949130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:20.949138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:21.101120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:21.135665] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:21.135711] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11198 [2024-09-11 16:08:21.149370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:21.149413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:21.149423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:21.149432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:21.266807] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:21.301266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:21.334333] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11198, magic:0x78563412 [2024-09-11 16:08:21.334375] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:21.334383] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:21.349682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:21.349714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:21.349721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:21.349729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:21.469446] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:21.501401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:21.550018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:21.550057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:21.550064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:21.550072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:21.656626] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:21.656681] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:21.656766] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=112, max_check_version=113, global_version=114) [2024-09-11 16:08:21.658782] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2016 [2024-09-11 16:08:21.658842] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:21.658877] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:08:21.658929] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:08:21.659014] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:21.659121] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:08:21.659179] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:08:21.659191] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:08:21.659202] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:08:21.659238] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:08:21.659302] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:08:21.659326] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:08:21.700811] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=73] PNIO [ratelimit] time: 1726042101700807, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:08:21.701524] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:21.707582] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042101707580, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:08:21.735935] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:21.735980] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11206 [2024-09-11 16:08:21.750307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:21.750336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:21.750342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:21.750351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:21.901612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:21.934723] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11206, magic:0x78563412 [2024-09-11 16:08:21.934758] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:21.934767] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:21.950667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:21.950707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:21.950714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:21.950723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:22.101773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=87] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:22.151042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:22.151085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:22.151092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:22.151099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:22.159541] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8428, clean_start_pos=0, clean_num=200000) [2024-09-11 16:08:22.266986] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:22.301917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:22.336933] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:22.336976] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11216 [2024-09-11 16:08:22.359819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:22.359866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:22.359873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:22.359883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:22.470467] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:22.502025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:22.535405] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11216, magic:0x78563412 [2024-09-11 16:08:22.535447] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:22.535454] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:22.560127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:22.560172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:22.560179] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:22.560188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:22.705509] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3368, replace_start_pos=1400000, replace_num=100000) [2024-09-11 16:08:22.705574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:22.708497] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042102708494, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:08:22.715260] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042102715256, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:08:22.760449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:22.760495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:22.760503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:22.760513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:22.905718] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:22.937201] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:22.937245] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11224 [2024-09-11 16:08:22.960811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:22.960847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:22.960856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:22.960865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:23.105845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:23.135745] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11224, magic:0x78563412 [2024-09-11 16:08:23.135779] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:23.135785] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:23.161189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:23.161231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:23.161239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:23.161248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:23.267118] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:23.305974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:23.361479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:23.361526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:23.361534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:23.361543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:23.471407] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:23.506095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:23.538026] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:23.538070] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11234 [2024-09-11 16:08:23.561769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:23.561810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:23.561817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:23.561826] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:23.706228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:23.716133] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042103716129, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:08:23.722816] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042103722813, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:08:23.736243] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11234, magic:0x78563412 [2024-09-11 16:08:23.736283] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:23.736306] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:23.762063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:23.762106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:23.762114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:23.762123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:23.906360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:23.962372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:23.962414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:23.962421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:23.962430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:24.106531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:24.137971] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:24.138015] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11238 [2024-09-11 16:08:24.162734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:24.162772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:24.162780] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:24.162789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:24.170036] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7233, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:08:24.267233] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:24.306657] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:24.336438] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11238, magic:0x78563412 [2024-09-11 16:08:24.336479] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:24.336486] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:24.370384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:24.370421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:24.370429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:24.370439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:24.472291] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:24.506849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:24.570737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:24.570781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:24.570790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:24.570800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:24.706924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:24.723738] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042104723734, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:08:24.730441] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042104730437, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:08:24.738678] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:24.738720] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11242 [2024-09-11 16:08:24.771150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:24.771188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:24.771196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:24.771206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:24.911162] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4056, replace_start_pos=1500000, replace_num=100000) [2024-09-11 16:08:24.911205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:24.937183] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11242, magic:0x78563412 [2024-09-11 16:08:24.937228] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:24.937235] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:24.971459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:24.971493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:24.971500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:24.971509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:25.111288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:25.171720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:25.171755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:25.171761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:25.171768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:25.267373] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:25.311477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:25.339269] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:25.339323] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:11244 [2024-09-11 16:08:25.372023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:25.372064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:25.372072] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:25.372081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:25.473353] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:25.511604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:25.537649] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:11244, magic:0x78563412 [2024-09-11 16:08:25.537675] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:25.537681] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:25.572329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:25.572370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:25.572379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:25.572388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:25.711720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:25.731364] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042105731360, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:08:25.738135] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042105738132, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 16:08:25.772639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:25.772683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:25.772691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:25.772700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:25.911838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:25.939069] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:25.939144] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=68] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55734 [2024-09-11 16:08:25.972945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:25.972978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:25.972985] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:25.972992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:26.112057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:26.137034] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55734, magic:0x78563412 [2024-09-11 16:08:26.137066] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:26.137073] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:26.173293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:26.173333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:26.173341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:26.173350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:26.180743] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7377, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:08:26.267513] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:26.312178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:26.381074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:26.381120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:26.381128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:26.381161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:26.381354] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:08:26.474395] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:26.512297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:26.539160] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:26.539204] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55742 [2024-09-11 16:08:26.581593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:26.581621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:26.581629] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:26.581638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:26.712552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:26.737545] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55742, magic:0x78563412 [2024-09-11 16:08:26.737581] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:26.737586] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:26.738921] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042106738914, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:08:26.745656] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042106745652, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007520, add_bytes: 0 [2024-09-11 16:08:26.781984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:26.782031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:26.782039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:26.782049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:26.912747] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:26.982359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:26.982425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:26.982435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:26.982444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:27.117047] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4159, replace_start_pos=1600000, replace_num=100000) [2024-09-11 16:08:27.117094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:27.139162] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:27.139205] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55756 [2024-09-11 16:08:27.182691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:27.182727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:27.182735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:27.182744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:27.267636] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:27.317178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:27.337893] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55756, magic:0x78563412 [2024-09-11 16:08:27.337959] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=61] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:27.337966] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:27.382983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:27.383016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:27.383024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:27.383048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:27.475311] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:27.517369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:27.583287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:27.583348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:27.583356] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:27.583364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:27.717491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:27.739260] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:27.739297] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55760 [2024-09-11 16:08:27.746574] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042107746571, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:08:27.753329] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042107753325, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:08:27.783611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:27.783652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:27.783658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:27.783667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:27.917615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:27.937414] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55760, magic:0x78563412 [2024-09-11 16:08:27.937451] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:27.937457] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:27.983899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:27.983949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:27.983962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:27.983998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:28.117733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:28.184221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:28.184258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:28.184264] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:28.184272] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:28.191869] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7585, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:08:28.267742] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:28.317928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:28.339056] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:28.339093] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55774 [2024-09-11 16:08:28.392122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:28.392154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:28.392161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:28.392170] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:28.476104] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:28.518117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:28.537619] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55774, magic:0x78563412 [2024-09-11 16:08:28.537653] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:28.537659] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:28.592389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:28.592420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:28.592425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:28.592447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:28.718240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:28.754192] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042108754188, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:08:28.760883] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042108760879, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:08:28.792669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:28.792708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:28.792714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:28.792722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:28.918373] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:28.939647] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:28.939687] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55782 [2024-09-11 16:08:28.992976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:28.993014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:28.993021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:28.993030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:29.118545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:29.138185] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55782, magic:0x78563412 [2024-09-11 16:08:29.138236] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:29.138242] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:29.193260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:29.193296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:29.193303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:29.193313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:29.267855] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:29.323053] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4382, replace_start_pos=1700000, replace_num=100000) [2024-09-11 16:08:29.323098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:29.393571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:29.393614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:29.393621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:29.393630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:29.476964] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:29.523195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:29.539346] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:29.539403] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55792 [2024-09-11 16:08:29.593857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:29.593920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:29.593929] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:29.593938] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:29.723332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:29.736617] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55792, magic:0x78563412 [2024-09-11 16:08:29.736671] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:29.736679] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:29.761805] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042109761802, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:08:29.768568] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042109768564, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:08:29.794161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:29.794197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:29.794205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:29.794214] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:29.923468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:29.994454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:29.994500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:29.994508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:29.994517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:30.123602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:30.137694] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:30.137735] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55794 [2024-09-11 16:08:30.194767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:30.194811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:30.194819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:30.194852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:30.202618] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7752, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:08:30.267982] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=27] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:30.323751] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:30.335968] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55794, magic:0x78563412 [2024-09-11 16:08:30.336004] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:30.336011] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:30.402868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:30.402899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:30.402928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:30.402936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:30.477925] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:30.523881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:30.603174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:30.603214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:30.603220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:30.603229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:30.724028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:30.737776] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:30.737818] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55810 [2024-09-11 16:08:30.769368] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042110769364, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:08:30.776128] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042110776125, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:08:30.803454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:30.803513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:30.803520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:30.803528] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:30.924162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:30.936430] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55810, magic:0x78563412 [2024-09-11 16:08:30.936470] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:30.936477] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:31.003777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:31.003822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:31.003829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:31.003838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:31.124301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:31.204064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:31.204106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:31.204114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:31.204123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:31.268127] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:31.324507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:31.338633] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:31.338674] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55816 [2024-09-11 16:08:31.404352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:31.404394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:31.404401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:31.404409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:31.478856] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:31.528388] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3658, replace_start_pos=1800000, replace_num=100000) [2024-09-11 16:08:31.528434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:31.537063] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55816, magic:0x78563412 [2024-09-11 16:08:31.537100] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:31.537107] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:31.604650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:31.604692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:31.604700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:31.604709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:31.672887] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:31.672963] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=74] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:31.673045] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=113, max_check_version=114, global_version=115) [2024-09-11 16:08:31.675062] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2017 [2024-09-11 16:08:31.675119] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:31.675155] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:08:31.675193] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:08:31.675276] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:31.675383] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:08:31.675443] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:08:31.675455] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:08:31.675466] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:08:31.675502] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:08:31.675562] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:08:31.675587] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:08:31.728577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:31.776976] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042111776972, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:08:31.783794] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042111783791, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:08:31.804934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:31.804975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:31.804982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:31.804989] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:31.928759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:31.938834] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:31.938871] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55828 [2024-09-11 16:08:32.005217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:32.005260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:32.005267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:32.005275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:32.128893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:32.137250] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55828, magic:0x78563412 [2024-09-11 16:08:32.137304] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:32.137311] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:32.205496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:32.205530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:32.205536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:32.205545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:32.212560] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7002, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:08:32.268256] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:32.329106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:32.412808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:32.412853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:32.412859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:32.412868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:32.479732] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:32.529307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:32.543879] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:32.543929] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55842 [2024-09-11 16:08:32.613094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:32.613126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:32.613134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:32.613143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:32.729449] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:32.737681] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55842, magic:0x78563412 [2024-09-11 16:08:32.737731] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:32.737738] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:32.784597] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042112784593, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:08:32.791411] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042112791408, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:08:32.813368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:32.813402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:32.813409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:32.813417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:32.929580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:33.013670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:33.013714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:33.013720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:33.013728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:33.129706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:33.139635] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:33.139674] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55846 [2024-09-11 16:08:33.213969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:33.214005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:33.214013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:33.214040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:33.268441] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:33.329897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:33.338140] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55846, magic:0x78563412 [2024-09-11 16:08:33.338173] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:33.338179] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:33.414268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:33.414306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:33.414313] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:33.414322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:33.480802] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:33.530102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:33.614543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:33.614582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:33.614590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:33.614598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:33.734783] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4405, replace_start_pos=1900000, replace_num=100000) [2024-09-11 16:08:33.734828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:33.740464] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:33.740499] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55858 [2024-09-11 16:08:33.792214] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042113792209, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:08:33.798966] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042113798963, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:08:33.814827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:33.814892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:33.814921] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:33.814931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:33.934926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:33.938635] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55858, magic:0x78563412 [2024-09-11 16:08:33.938663] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:33.938671] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:34.015156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:34.015194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:34.015200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:34.015209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:34.135053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:34.215444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:34.215483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:34.215490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:34.215499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:34.222962] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7449, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:08:34.268554] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:34.335197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:34.341015] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:34.341054] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55862 [2024-09-11 16:08:34.423220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:34.423259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:34.423268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:34.423277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:34.481793] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:34.535325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:34.539160] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55862, magic:0x78563412 [2024-09-11 16:08:34.539184] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:34.539191] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:34.623497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:34.623529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:34.623537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:34.623546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:34.735441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:34.799922] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042114799917, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007708, add_bytes: 0 [2024-09-11 16:08:34.806641] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042114806637, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:08:34.823770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:34.823814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:34.823822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:34.823831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:34.935544] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:34.940836] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:34.940859] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:55870 [2024-09-11 16:08:35.024090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:35.024131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:35.024139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:35.024147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:35.135654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:35.138426] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:55870, magic:0x78563412 [2024-09-11 16:08:35.138450] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:35.138456] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:35.224368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:35.224405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:35.224412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:35.224420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:35.268748] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:35.335758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:35.424648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:35.424699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:35.424705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:35.424714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:35.482868] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:35.535870] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:35.540459] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:35.540484] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31700 [2024-09-11 16:08:35.624967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:35.625011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:35.625018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:35.625028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:35.736031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:35.738880] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31700, magic:0x78563412 [2024-09-11 16:08:35.738917] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:35.738925] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:35.807450] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042115807446, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007529, add_bytes: 0 [2024-09-11 16:08:35.814190] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042115814187, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:08:35.825345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:35.825378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:35.825386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:35.825395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:35.939959] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3789, replace_start_pos=2000000, replace_num=100000) [2024-09-11 16:08:35.940006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:36.025615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:36.025673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:36.025681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:36.025690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:36.140106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:36.141276] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:36.141311] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31710 [2024-09-11 16:08:36.225939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:36.225983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:36.225990] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:36.225999] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:36.234082] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8070, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:08:36.268963] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:36.339377] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31710, magic:0x78563412 [2024-09-11 16:08:36.339419] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:36.339426] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:36.340242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:36.434317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:36.434375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:36.434382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:36.434391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:36.483868] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:36.540368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:36.634609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:36.634645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:36.634650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:36.634659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:36.740518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:36.741802] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:36.741828] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31724 [2024-09-11 16:08:36.815114] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042116815110, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:08:36.821823] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042116821819, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:08:36.834981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:36.835021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:36.835028] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:36.835037] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:36.940172] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31724, magic:0x78563412 [2024-09-11 16:08:36.940209] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:36.940217] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:36.940628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:37.035258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:37.035295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:37.035321] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:37.035330] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:37.140794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:37.235626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:37.235663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:37.235671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:37.235680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:37.269103] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:37.340921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:37.342459] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:37.342485] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31730 [2024-09-11 16:08:37.436018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:37.436062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:37.436069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:37.436079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:37.484704] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:37.540622] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31730, magic:0x78563412 [2024-09-11 16:08:37.540658] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:37.540666] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:37.541042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:37.636375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:37.636420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:37.636428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:37.636456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:37.636673] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=97, refresh_score_time=63, wash_time=0) [2024-09-11 16:08:37.741164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:37.822730] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042117822726, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:08:37.829488] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042117829485, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:08:37.836999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:37.837038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:37.837046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:37.837054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:37.941298] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:37.942659] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:37.942692] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31740 [2024-09-11 16:08:38.037357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:38.037401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:38.037409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:38.037418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:38.141405] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31740, magic:0x78563412 [2024-09-11 16:08:38.141447] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:38.141471] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:38.144811] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3341, replace_start_pos=2100000, replace_num=100000) [2024-09-11 16:08:38.144845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:38.237656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:38.237699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:38.237708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:38.237717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:38.245691] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7961, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:08:38.269301] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:38.344930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:38.445967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:38.446005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:38.446013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:38.446023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:38.485460] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:38.542868] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:38.542929] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=55] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31746 [2024-09-11 16:08:38.545101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:38.646321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:38.646366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:38.646374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:38.646384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:38.741607] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31746, magic:0x78563412 [2024-09-11 16:08:38.741657] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:38.741665] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:38.745203] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:38.830295] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042118830291, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 16:08:38.837106] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042118837104, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:08:38.846616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:38.846656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:38.846663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:38.846672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:38.945328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:39.046991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:39.047035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:39.047042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:39.047051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:39.143601] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:39.143645] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31750 [2024-09-11 16:08:39.145469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:39.247280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:39.247340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:39.247348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:39.247357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:39.269497] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:39.342086] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31750, magic:0x78563412 [2024-09-11 16:08:39.342129] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:39.342136] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:39.345639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:39.447652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:39.447697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:39.447705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:39.447715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:39.486209] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:39.545840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:39.648059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:39.648099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:39.648107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:39.648116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:39.743929] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:39.743968] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31758 [2024-09-11 16:08:39.746027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:39.837960] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042119837956, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:08:39.844669] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042119844666, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:08:39.848353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:39.848374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:39.848382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:39.848392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:39.941467] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31758, magic:0x78563412 [2024-09-11 16:08:39.941509] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:39.941516] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:39.946196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:40.048646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:40.048687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:40.048694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:40.048703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:40.146303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:40.248972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:40.249017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:40.249025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:40.249034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:40.256704] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7657, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:08:40.269674] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:40.343332] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:40.343376] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31772 [2024-09-11 16:08:40.349713] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3295, replace_start_pos=2200000, replace_num=100000) [2024-09-11 16:08:40.349749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:40.457007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:40.457052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:40.457060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:40.457070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:40.486982] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:40.541865] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31772, magic:0x78563412 [2024-09-11 16:08:40.541913] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:40.541922] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:40.549840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:40.657371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:40.657415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:40.657424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:40.657433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:40.750026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:40.845533] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042120845529, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007573, add_bytes: 0 [2024-09-11 16:08:40.852345] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042120852341, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:08:40.857665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:40.857698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:40.857723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:40.857732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:40.944197] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:40.944243] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31776 [2024-09-11 16:08:40.950152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:41.058055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:41.058100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:41.058108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:41.058117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:41.142579] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31776, magic:0x78563412 [2024-09-11 16:08:41.142626] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:41.142634] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:41.150324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:41.258416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:41.258457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:41.258464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:41.258472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:41.269888] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:41.350461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:41.458691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:41.458734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:41.458758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:41.458767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:41.487742] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:41.544616] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:41.544661] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31778 [2024-09-11 16:08:41.550683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:41.659020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:41.659064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:41.659071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:41.659081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:41.689179] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:41.689222] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:41.689292] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=114, max_check_version=115, global_version=116) [2024-09-11 16:08:41.690978] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1685 [2024-09-11 16:08:41.691007] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:41.691038] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:08:41.691089] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:08:41.691163] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:41.691245] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:08:41.691293] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:08:41.691306] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:08:41.691315] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:08:41.691346] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:08:41.691394] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:08:41.691411] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:08:41.742882] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31778, magic:0x78563412 [2024-09-11 16:08:41.742957] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=65] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:41.742967] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:41.750859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:41.853196] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042121853192, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:08:41.859305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:41.859341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:41.859348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:41.859357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:41.859891] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042121859890, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:08:41.951073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:42.059597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:42.059642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:42.059650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:42.059658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:42.144761] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:42.144807] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31788 [2024-09-11 16:08:42.151210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:42.259899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:42.259956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:42.259977] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:42.259987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:42.267777] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7778, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:08:42.270050] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=90] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:42.343555] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31788, magic:0x78563412 [2024-09-11 16:08:42.343597] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:42.343606] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:42.351332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:42.468098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:42.468142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:42.468150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:42.468159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:42.488861] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:42.555860] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4393, replace_start_pos=2300000, replace_num=100000) [2024-09-11 16:08:42.555916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:42.668460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:42.668506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:42.668514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:42.668523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:42.745834] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:42.745878] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31796 [2024-09-11 16:08:42.756021] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:42.860808] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042122860803, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:08:42.867510] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042122867508, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:08:42.868753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:42.868780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:42.868788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:42.868798] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:42.944080] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31796, magic:0x78563412 [2024-09-11 16:08:42.944116] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:42.944123] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:42.956189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:43.069043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:43.069084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:43.069092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:43.069100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:43.156320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:43.269328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:43.269367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:43.269373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:43.269382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:43.270164] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:43.345474] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:43.345511] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31800 [2024-09-11 16:08:43.356444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:43.469703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:43.469747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:43.469755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:43.469764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:43.489775] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:43.544219] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31800, magic:0x78563412 [2024-09-11 16:08:43.544265] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:43.544273] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:43.556559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:43.670033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:43.670076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:43.670084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:43.670095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:43.756670] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:43.868458] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726042123868454, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007651, add_bytes: 0 [2024-09-11 16:08:43.870328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:43.870361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:43.870368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:43.870376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:43.875182] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042123875180, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:08:43.946306] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:43.946349] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31816 [2024-09-11 16:08:43.956861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:44.070622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:44.070666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:44.070674] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:44.070682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:44.144717] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31816, magic:0x78563412 [2024-09-11 16:08:44.144753] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:44.144760] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:44.157066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:44.270281] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:44.270940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:44.270973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:44.270982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:44.270991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:44.279324] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8320, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:08:44.357182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:44.479662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:44.479703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:44.479711] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:44.479720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:44.490551] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:44.547078] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:44.547121] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31830 [2024-09-11 16:08:44.557320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:44.680062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:44.680108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:44.680116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:44.680126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:44.745458] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31830, magic:0x78563412 [2024-09-11 16:08:44.745498] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:44.745504] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:44.760753] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3320, replace_start_pos=2400000, replace_num=100000) [2024-09-11 16:08:44.760794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:44.876098] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726042124876094, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 16:08:44.880357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:44.880391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:44.880417] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:44.880429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:44.882874] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042124882872, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:08:44.960875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:45.080689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:45.080735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:45.080742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:45.080752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:45.147339] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:45.147385] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:31846 [2024-09-11 16:08:45.160989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:45.270421] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:45.281024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:45.281061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:45.281068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:45.281078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:45.345807] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:31846, magic:0x78563412 [2024-09-11 16:08:45.345849] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:45.345856] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:45.361110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:45.481294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:45.481335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:45.481341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:45.481348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:45.491447] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:45.561249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:45.681591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:45.681628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:45.681636] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:45.681645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:45.748320] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:45.748365] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43046 [2024-09-11 16:08:45.761370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:45.881898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:45.881962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:45.881969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:45.881977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:45.883666] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042125883664, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:08:45.890426] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726042125890423, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:08:45.946339] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43046, magic:0x78563412 [2024-09-11 16:08:45.946380] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:45.946389] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:45.961483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:46.082348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:46.082419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:46.082427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:46.082437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:46.161592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:46.270665] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:46.282672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:46.282714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:46.282722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:46.282731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:46.291195] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8451, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:08:46.347796] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:46.347837] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43058 [2024-09-11 16:08:46.361711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:46.491434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:46.491477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:46.491484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:46.491493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:46.492457] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:46.546545] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43058, magic:0x78563412 [2024-09-11 16:08:46.546583] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:46.546590] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:46.561899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:46.691792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:46.691855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:46.691864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:46.691874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:46.762106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:46.891285] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042126891281, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:08:46.892176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:46.892210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:46.892219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:46.892228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:46.898035] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042126898032, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:08:46.949315] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:46.949359] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43074 [2024-09-11 16:08:46.966628] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4394, replace_start_pos=2500000, replace_num=100000) [2024-09-11 16:08:46.966667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:47.092520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:47.092565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:47.092573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:47.092582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:47.146322] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43074, magic:0x78563412 [2024-09-11 16:08:47.146363] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:47.146372] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:47.166756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:47.270858] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:47.292943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:47.292986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:47.292993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:47.293002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:47.366877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:47.493282] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:47.493315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:47.493386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:47.493394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:47.493403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:47.548319] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:47.548357] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43076 [2024-09-11 16:08:47.567007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:47.693621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:47.693660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:47.693669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:47.693679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:47.746593] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43076, magic:0x78563412 [2024-09-11 16:08:47.746650] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:47.746658] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:47.767124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:47.893987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:47.894028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:47.894035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:47.894045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:47.898931] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042127898929, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007648, add_bytes: 0 [2024-09-11 16:08:47.905679] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042127905676, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 16:08:47.967240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:48.094260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:48.094305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:48.094312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:48.094322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:48.149175] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:48.149220] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43078 [2024-09-11 16:08:48.167360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:48.270991] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:48.294546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:48.294593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:48.294600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:48.294609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:48.302775] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8153, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:08:48.347319] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43078, magic:0x78563412 [2024-09-11 16:08:48.347356] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:48.347362] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:48.367475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:48.494177] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:48.503044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:48.503073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:48.503079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:48.503103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:48.567591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:48.703402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:48.703446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:48.703454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:48.703464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:48.748834] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:48.748878] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43088 [2024-09-11 16:08:48.767730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:48.903791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:48.903869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:48.903879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:48.903888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:48.906452] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042128906449, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007520, add_bytes: 0 [2024-09-11 16:08:48.913201] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042128913198, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007522, add_bytes: 0 [2024-09-11 16:08:48.947601] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43088, magic:0x78563412 [2024-09-11 16:08:48.947644] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:48.947651] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:48.967863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:49.104157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:49.104198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:49.104206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:49.104215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:49.171983] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3997, replace_start_pos=2600000, replace_num=100000) [2024-09-11 16:08:49.172037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:49.271155] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:49.304532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:49.304577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:49.304602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:49.304612] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:49.349063] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:49.349109] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43102 [2024-09-11 16:08:49.372132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:49.494933] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:49.504852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:49.504891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:49.504899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:49.504930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:49.547309] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43102, magic:0x78563412 [2024-09-11 16:08:49.547352] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:49.547360] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:49.572263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:49.705228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:49.705269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:49.705277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:49.705287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:49.772390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:49.905528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:49.905573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:49.905580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:49.905590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:49.914147] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042129914144, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 16:08:49.920843] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042129920840, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007642, add_bytes: 0 [2024-09-11 16:08:49.948941] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:49.948973] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43108 [2024-09-11 16:08:49.972515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:50.105900] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:50.105974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:50.105982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:50.105992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:50.146513] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43108, magic:0x78563412 [2024-09-11 16:08:50.146558] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:50.146566] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:50.172639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:50.271336] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:50.306222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:50.306267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:50.306274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:50.306284] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:50.314130] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7819, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:08:50.372767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:50.495898] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:50.514446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:50.514489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:50.514516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:50.514526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:50.548480] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:50.548519] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43124 [2024-09-11 16:08:50.572884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:50.714827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:50.714872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:50.714881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:50.714891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:50.747124] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43124, magic:0x78563412 [2024-09-11 16:08:50.747168] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:50.747176] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:50.773006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:50.915206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:50.915251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:50.915259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:50.915268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:50.921671] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042130921668, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007524, add_bytes: 0 [2024-09-11 16:08:50.928456] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042130928453, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:08:50.973100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:51.115580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:51.115624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:51.115632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:51.115642] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:51.149651] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:51.149698] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43140 [2024-09-11 16:08:51.173235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:51.271555] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:51.315980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:51.316025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:51.316033] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:51.316042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:51.347702] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43140, magic:0x78563412 [2024-09-11 16:08:51.347738] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:51.347744] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:51.377723] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4357, replace_start_pos=2700000, replace_num=100000) [2024-09-11 16:08:51.377771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:51.496818] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:51.516269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:51.516308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:51.516316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:51.516325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:51.577942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:51.704794] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:51.704846] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:08:51.704951] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=115, max_check_version=116, global_version=117) [2024-09-11 16:08:51.706984] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2032 [2024-09-11 16:08:51.707024] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:51.707061] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:08:51.707105] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:08:51.707210] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:08:51.707319] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:08:51.707369] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:08:51.707380] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:08:51.707400] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:08:51.707436] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:08:51.707496] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:08:51.707518] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:08:51.716576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:51.716610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:51.716619] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:51.716628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:51.748987] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:51.749031] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43142 [2024-09-11 16:08:51.778128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:51.916964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:51.917031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:51.917039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:51.917048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:51.929284] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042131929280, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:08:51.936139] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042131936136, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:08:51.946957] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43142, magic:0x78563412 [2024-09-11 16:08:51.946996] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:51.947003] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:51.978264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:52.117277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:52.117323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:52.117331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:52.117341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:52.178480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:52.271757] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:52.317570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:52.317614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:52.317622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:52.317652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:52.326081] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8416, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:08:52.349028] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:52.349073] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43150 [2024-09-11 16:08:52.378607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:52.497647] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:52.526330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:52.526373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:52.526381] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:52.526391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:52.547514] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43150, magic:0x78563412 [2024-09-11 16:08:52.547552] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:52.547560] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:52.578730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:52.726634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:52.726677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:52.726684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:52.726694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:52.778855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:52.926967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:52.927014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:52.927023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:52.927031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:52.936916] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042132936911, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:08:52.943732] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042132943729, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:08:52.949787] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:52.949832] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43162 [2024-09-11 16:08:52.979066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:53.127289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:53.127333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:53.127340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:53.127349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:53.148114] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43162, magic:0x78563412 [2024-09-11 16:08:53.148158] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:53.148166] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:53.179247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:53.271952] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:53.327564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:53.327601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:53.327608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:53.327616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:53.379380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:53.498836] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:53.527867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:53.527928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:53.527937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:53.527966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:53.549966] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:53.550011] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43164 [2024-09-11 16:08:53.583541] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4039, replace_start_pos=2800000, replace_num=100000) [2024-09-11 16:08:53.583587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:53.728219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:53.728264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:53.728272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:53.728282] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:53.748124] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43164, magic:0x78563412 [2024-09-11 16:08:53.748152] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:53.748158] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:53.783737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:53.928509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:53.928556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:53.928581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:53.928591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:53.944539] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042133944536, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:08:53.951353] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042133951348, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:08:53.983862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:54.128834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:54.128884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:54.128890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:54.128898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:54.150711] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:54.150757] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43168 [2024-09-11 16:08:54.184049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:54.272068] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:54.329152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:54.329197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:54.329205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:54.329214] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:54.337700] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8472, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:08:54.348760] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43168, magic:0x78563412 [2024-09-11 16:08:54.348796] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:54.348803] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:54.384239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:54.500161] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:54.538058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:54.538102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:54.538110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:54.538120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:54.584418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:54.738356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:54.738386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:54.738393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:54.738401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:54.749886] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:54.749945] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43184 [2024-09-11 16:08:54.784547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:54.938703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:54.938749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:54.938757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:54.938767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:54.948291] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43184, magic:0x78563412 [2024-09-11 16:08:54.948322] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:54.948329] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:54.952141] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042134952138, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:08:54.958991] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042134958987, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 16:08:54.984724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:55.139083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:55.139127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:55.139135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:55.139144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:55.184944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:55.272249] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:55.339485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:55.339526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:55.339534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:55.339544] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:55.350364] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:55.350408] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:43190 [2024-09-11 16:08:55.385077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:55.501443] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:55.539780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:55.539845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:55.539856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:55.539869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:55.548852] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:43190, magic:0x78563412 [2024-09-11 16:08:55.548885] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:55.548894] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:55.585199] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:55.740101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:55.740158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:55.740166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:55.740175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:55.789178] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3855, replace_start_pos=2900000, replace_num=100000) [2024-09-11 16:08:55.789214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:55.940475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:55.940522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:55.940530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:55.940540] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:55.951263] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:55.951306] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58406 [2024-09-11 16:08:55.959819] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042135959816, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:08:55.966515] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042135966511, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007524, add_bytes: 0 [2024-09-11 16:08:55.989366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:56.140834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:56.140878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:56.140887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:56.140897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:56.149482] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58406, magic:0x78563412 [2024-09-11 16:08:56.149525] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:56.149533] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:56.189542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:56.272412] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:56.341237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:56.341280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:56.341288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:56.341297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:56.349572] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8261, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:08:56.389733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:56.502763] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:56.549892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:56.549964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:56.549972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:56.549983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:56.550191] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:08:56.551358] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:56.551384] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58414 [2024-09-11 16:08:56.589870] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:56.749887] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58414, magic:0x78563412 [2024-09-11 16:08:56.749935] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:56.749956] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:56.750407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:56.750434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:56.750440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:56.750447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:56.790069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:56.950739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:56.950783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:56.950791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:56.950801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:56.967438] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042136967434, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:08:56.974128] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042136974125, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:08:56.990195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:57.151104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:57.151147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:57.151154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:57.151164] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:57.151458] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:57.151491] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58420 [2024-09-11 16:08:57.190321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:57.272616] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:57.350267] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58420, magic:0x78563412 [2024-09-11 16:08:57.350309] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:57.350318] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:57.351399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:57.351424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:57.351431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:57.351440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:57.390451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:57.503922] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:57.551750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:57.551793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:57.551801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:57.551811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:57.590618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:57.752102] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:57.752138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:57.752154] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=45] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58434 [2024-09-11 16:08:57.752161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:57.752172] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:57.752184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:57.790739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:57.950638] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58434, magic:0x78563412 [2024-09-11 16:08:57.950678] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:57.950686] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:57.952431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:57.952459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:57.952466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:57.952474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:57.952688] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=59, refresh_score_time=64, wash_time=0) [2024-09-11 16:08:57.975022] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042137975018, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007584, add_bytes: 0 [2024-09-11 16:08:57.981743] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042137981740, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:08:57.995268] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4338, replace_start_pos=3000000, replace_num=100000) [2024-09-11 16:08:57.995306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:08:58.152928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:58.152963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:58.152970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:58.152979] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:58.195458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:08:58.272795] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:58.353183] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:58.353216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:58.353229] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58448 [2024-09-11 16:08:58.353233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:58.353242] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:58.353251] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:58.359798] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6531, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:08:58.395605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:08:58.505199] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:58.551301] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58448, magic:0x78563412 [2024-09-11 16:08:58.551344] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:58.551352] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:58.560114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:58.560154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:58.560162] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:58.560173] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:58.595710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:08:58.760473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:58.760515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:58.760523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:58.760532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:58.795882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:08:58.952845] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:58.952957] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=106] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58462 [2024-09-11 16:08:58.960835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:58.960872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:58.960880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:58.960890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:58.982671] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042138982668, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007650, add_bytes: 0 [2024-09-11 16:08:58.989364] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042138989360, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:08:58.996081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:08:59.151445] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58462, magic:0x78563412 [2024-09-11 16:08:59.151487] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:59.151496] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:59.161223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:59.161263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:59.161271] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:59.161280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:59.196260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:08:59.272933] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:08:59.361584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:59.361647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:59.361656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:59.361666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:59.396451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:08:59.506556] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:08:59.553288] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:08:59.553332] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58464 [2024-09-11 16:08:59.561996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:59.562034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:59.562042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:59.562051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:59.596645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:08:59.751934] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58464, magic:0x78563412 [2024-09-11 16:08:59.751968] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:08:59.751974] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:08:59.762291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:59.762327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:59.762334] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:59.762343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:59.796770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:08:59.962590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:08:59.962628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:08:59.962636] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:08:59.962663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:08:59.990285] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042139990281, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:08:59.996886] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:08:59.996977] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042139996974, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:09:00.153747] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:00.153793] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58474 [2024-09-11 16:09:00.162929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:00.162973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:00.162982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:00.162993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:00.201360] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4341, replace_start_pos=3100000, replace_num=100000) [2024-09-11 16:09:00.201409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:00.273108] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:00.352421] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58474, magic:0x78563412 [2024-09-11 16:09:00.352463] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:00.352471] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:00.363324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:00.363367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:00.363378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:00.363404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:00.371523] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8104, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:09:00.401500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:00.507889] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:00.571853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:00.571926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:00.571935] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:00.571945] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:00.601628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:00.754383] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:00.754428] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58490 [2024-09-11 16:09:00.772246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:00.772290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:00.772298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:00.772308] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:00.801816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:00.953018] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58490, magic:0x78563412 [2024-09-11 16:09:00.953059] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:00.953067] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:00.972614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:00.972660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:00.972668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:00.972678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:00.991926] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:09:00.997919] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042140997916, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:09:00.997958] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:09:01.001928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:01.004608] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042141004605, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:09:01.173054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:01.173099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:01.173107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:01.173116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:01.202062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:01.273323] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:01.354818] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:01.354864] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58504 [2024-09-11 16:09:01.373422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:01.373466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:01.373474] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:01.373484] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:01.402189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:01.509340] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=122] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:01.553224] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58504, magic:0x78563412 [2024-09-11 16:09:01.553269] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:01.553277] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:01.573780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:01.573844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:01.573853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:01.573862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:01.602386] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:01.719486] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:01.719538] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:01.719616] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=116, max_check_version=117, global_version=118) [2024-09-11 16:09:01.721544] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1927 [2024-09-11 16:09:01.721578] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:01.721613] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:09:01.721669] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:09:01.721742] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:01.721825] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:09:01.721868] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:09:01.721882] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:09:01.721891] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:09:01.721932] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:09:01.721984] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:09:01.722003] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:09:01.774155] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:01.774200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:01.774208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:01.774217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:01.802579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:01.955708] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:01.955752] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58508 [2024-09-11 16:09:01.974523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:01.974563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:01.974571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:01.974581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:02.002781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:02.005528] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042142005525, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:09:02.012279] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042142012276, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:09:02.153880] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58508, magic:0x78563412 [2024-09-11 16:09:02.153938] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=52] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:02.153947] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:02.174889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:02.174983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=93][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:02.174991] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:02.175001] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:02.202925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:02.273530] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:02.375309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:02.375355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:02.375363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:02.375373] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:02.383910] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8522, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:09:02.407036] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3917, replace_start_pos=3200000, replace_num=100000) [2024-09-11 16:09:02.407082] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:02.510802] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:02.555531] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:02.555576] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58524 [2024-09-11 16:09:02.584231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:02.584272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:02.584280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:02.584289] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:02.607165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:02.754138] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58524, magic:0x78563412 [2024-09-11 16:09:02.754180] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:02.754188] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:02.784535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:02.784579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:02.784586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:02.784595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:02.807343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:02.984896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:02.984980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=83][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:02.984988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:02.984998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:03.007587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:03.013131] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042143013128, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:09:03.019914] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042143019897, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:09:03.154662] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:03.154698] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58530 [2024-09-11 16:09:03.185295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:03.185342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:03.185351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:03.185360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:03.207772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:03.273744] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:03.353529] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58530, magic:0x78563412 [2024-09-11 16:09:03.353564] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:03.353570] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:03.385694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:03.385742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:03.385750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:03.385760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:03.407971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:03.512128] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:03.586088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:03.586135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:03.586143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:03.586152] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:03.608097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:03.755860] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:03.755896] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58540 [2024-09-11 16:09:03.786450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:03.786494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:03.786502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:03.786513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:03.808282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:03.952926] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58540, magic:0x78563412 [2024-09-11 16:09:03.952974] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:03.952987] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=13][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:03.986824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:03.986867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:03.986875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:03.986899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:04.008473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:04.020746] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042144020741, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:09:04.027454] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042144027451, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:09:04.187243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:04.187291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:04.187299] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:04.187309] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:04.208665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:04.273925] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:04.354847] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:04.354892] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58542 [2024-09-11 16:09:04.387647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:04.387694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:04.387702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:04.387712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:04.396201] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8475, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:09:04.408862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:04.513276] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:04.553385] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58542, magic:0x78563412 [2024-09-11 16:09:04.553428] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:04.553435] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:04.596558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:04.596619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:04.596628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:04.596637] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:04.613056] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3987, replace_start_pos=3300000, replace_num=100000) [2024-09-11 16:09:04.613101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:04.796969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:04.797011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:04.797019] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:04.797028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:04.813270] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:04.955493] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:04.955527] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58544 [2024-09-11 16:09:04.997330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:04.997372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:04.997380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:04.997390] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:05.013409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:05.028365] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042145028361, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:09:05.035142] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042145035138, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:09:05.153959] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58544, magic:0x78563412 [2024-09-11 16:09:05.154001] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:05.154009] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:05.197695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:05.197739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:05.197746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:05.197756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:05.213615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:05.274121] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:05.398035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:05.398078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:05.398086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:05.398096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:05.413854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:05.514652] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:05.556158] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:05.556201] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6146 [2024-09-11 16:09:05.598403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:05.598448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:05.598456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:05.598465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:05.614045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:05.754405] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6146, magic:0x78563412 [2024-09-11 16:09:05.754447] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:05.754455] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:05.798714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:05.798758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:05.798765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:05.798775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:05.814177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:05.999040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:05.999084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:05.999092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:05.999101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:06.014292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:06.035919] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042146035916, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:09:06.042672] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042146042668, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 16:09:06.156140] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:06.156185] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6152 [2024-09-11 16:09:06.199386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:06.199444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:06.199450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:06.199458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:06.214420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:06.274273] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:06.354680] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6152, magic:0x78563412 [2024-09-11 16:09:06.354721] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:06.354729] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:06.399782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:06.399821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:06.399828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:06.399837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:06.408373] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8522, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:09:06.414535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:06.516009] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:06.608642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:06.608688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:06.608696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:06.608706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:06.614654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:06.756670] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:06.756714] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6160 [2024-09-11 16:09:06.808944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:06.808992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:06.808999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:06.809008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:06.818157] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3385, replace_start_pos=3400000, replace_num=100000) [2024-09-11 16:09:06.818192] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:06.955326] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6160, magic:0x78563412 [2024-09-11 16:09:06.955368] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:06.955375] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:07.009306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:07.009349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:07.009357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:07.009367] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:07.018271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:07.043538] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042147043534, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:09:07.050295] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042147050293, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:09:07.209681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:07.209728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:07.209736] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:07.209766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:07.218387] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:07.274399] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:07.356896] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:07.356961] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=60] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6164 [2024-09-11 16:09:07.410032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:07.410077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:07.410085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:07.410094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:07.418499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:07.516956] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:07.554591] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6164, magic:0x78563412 [2024-09-11 16:09:07.554634] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:07.554641] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:07.610316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:07.610350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:07.610355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:07.610363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:07.618666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:07.810669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:07.810714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:07.810722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:07.810731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:07.818831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:07.956897] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:07.956961] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=58] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6178 [2024-09-11 16:09:08.011027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:08.011072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:08.011079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:08.011089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:08.019019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:08.051173] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042148051168, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:09:08.057920] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042148057899, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:09:08.155019] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6178, magic:0x78563412 [2024-09-11 16:09:08.155057] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:08.155063] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:08.211404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:08.211452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:08.211460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:08.211470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:08.219226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:08.274589] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:08.411783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:08.411827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:08.411836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:08.411846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:08.419429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:08.419559] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7699, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:09:08.518012] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:08.556866] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:08.556938] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=66] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6192 [2024-09-11 16:09:08.619620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:08.619868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:08.619918] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:08.619927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:08.619936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:08.755251] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=12] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6192, magic:0x78563412 [2024-09-11 16:09:08.755283] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:08.755288] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:08.819745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:08.820233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:08.820266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:08.820275] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:08.820284] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:09.020630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:09.020685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:09.020700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:09.020710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:09.024352] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4428, replace_start_pos=3500000, replace_num=100000) [2024-09-11 16:09:09.024385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:09.058767] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042149058763, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 16:09:09.065526] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042149065523, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:09:09.157253] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:09.157297] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6208 [2024-09-11 16:09:09.221040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:09.221085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:09.221093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:09.221103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:09.224467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:09.274801] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:09.355948] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6208, magic:0x78563412 [2024-09-11 16:09:09.355994] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:09.356018] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:09.421405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:09.421445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:09.421453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:09.421463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:09.424617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:09.519111] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:09.621768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:09.621813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:09.621821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:09.621831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:09.624785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:09.757098] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:09.757142] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6220 [2024-09-11 16:09:09.822068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:09.822114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:09.822122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:09.822131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:09.824961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:09.955356] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6220, magic:0x78563412 [2024-09-11 16:09:09.955395] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:09.955403] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:10.022439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:10.022484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:10.022510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:10.022521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:10.025124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:10.066393] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042150066389, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:09:10.073156] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042150073151, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:09:10.222762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:10.222807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:10.222816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:10.222826] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:10.225321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:10.274982] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:10.357644] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:10.357687] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6234 [2024-09-11 16:09:10.423074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:10.423113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:10.423121] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:10.423130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:10.425481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:10.431223] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8080, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:09:10.520008] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:10.555939] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6234, magic:0x78563412 [2024-09-11 16:09:10.555983] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:10.555992] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:10.625676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:10.631548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:10.631591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:10.631599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:10.631608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:10.825871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:10.831842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:10.831872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:10.831879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:10.831888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:10.956807] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:10.956850] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6250 [2024-09-11 16:09:11.026015] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:11.032212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:11.032252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:11.032260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:11.032269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:11.074060] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042151074057, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:09:11.080770] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042151080767, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:09:11.155030] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6250, magic:0x78563412 [2024-09-11 16:09:11.155068] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:11.155074] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:11.230181] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4036, replace_start_pos=3600000, replace_num=100000) [2024-09-11 16:09:11.230223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:11.232561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:11.232586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:11.232594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:11.232604] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:11.275205] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=84] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:11.430372] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:11.432938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:11.432968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:11.432976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:11.432985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:11.520776] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:11.555952] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:11.555998] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6254 [2024-09-11 16:09:11.630511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:11.633289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:11.633319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:11.633327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:11.633358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:11.735029] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:11.735071] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:11.735148] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=117, max_check_version=118, global_version=119) [2024-09-11 16:09:11.736998] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1849 [2024-09-11 16:09:11.737040] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:11.737073] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:09:11.737108] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:09:11.737204] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:11.737292] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:09:11.737338] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:09:11.737348] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:09:11.737361] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:09:11.737394] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:09:11.737446] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:09:11.737464] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:09:11.754363] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6254, magic:0x78563412 [2024-09-11 16:09:11.754404] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:11.754411] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:11.830695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:11.833607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:11.833645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:11.833653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:11.833662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:12.030931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:12.034004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:12.034032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:12.034040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:12.034049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:12.081699] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726042152081694, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:09:12.088372] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042152088369, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:09:12.154977] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:12.155023] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6268 [2024-09-11 16:09:12.231107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:12.234272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:12.234297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:12.234304] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:12.234313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:12.275340] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:12.353772] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6268, magic:0x78563412 [2024-09-11 16:09:12.353812] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:12.353818] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:12.431292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:12.434612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:12.434643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:12.434651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:12.434660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:12.443166] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8493, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:09:12.521799] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:12.631430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:12.643486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:12.643531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:12.643539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:12.643549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:12.756462] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:12.756503] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6278 [2024-09-11 16:09:12.831614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:12.843777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:12.843818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:12.843825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:12.843835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:12.954366] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6278, magic:0x78563412 [2024-09-11 16:09:12.954408] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:12.954415] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:13.031804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:13.044131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:13.044175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:13.044183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:13.044193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:13.089325] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042153089321, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:09:13.095997] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042153095993, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:09:13.232010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:13.244424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:13.244469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:13.244477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:13.244486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:13.275537] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:13.356744] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:13.356790] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6294 [2024-09-11 16:09:13.436333] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4202, replace_start_pos=3700000, replace_num=100000) [2024-09-11 16:09:13.436376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:13.444718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:13.444762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:13.444770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:13.444800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:13.523003] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:13.554699] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6294, magic:0x78563412 [2024-09-11 16:09:13.554749] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:13.554757] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:13.636469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:13.645119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:13.645158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:13.645166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:13.645175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:13.836652] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:13.845477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:13.845523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:13.845532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:13.845541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:13.956860] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:13.956922] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6302 [2024-09-11 16:09:14.036833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:14.045839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:14.045883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:14.045891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:14.045919] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:14.096841] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042154096838, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007517, add_bytes: 0 [2024-09-11 16:09:14.103666] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042154103664, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:09:14.155413] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6302, magic:0x78563412 [2024-09-11 16:09:14.155457] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:14.155464] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:14.236965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:14.246144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:14.246180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:14.246185] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:14.246193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:14.275729] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:14.437098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:14.446480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:14.446524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:14.446531] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:14.446542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:14.455040] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8484, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:09:14.524012] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:14.557724] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:14.557770] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6308 [2024-09-11 16:09:14.637219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:14.655362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:14.655398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:14.655405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:14.655428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:14.755855] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6308, magic:0x78563412 [2024-09-11 16:09:14.755896] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:14.755950] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:14.837411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:14.855666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:14.855702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:14.855710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:14.855719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:15.037517] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:15.055950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:15.055981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:15.055987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:15.055996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:15.104471] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042155104466, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:09:15.111286] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042155111283, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:09:15.157749] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:15.157794] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6314 [2024-09-11 16:09:15.237632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:15.256290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:15.256329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:15.256336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:15.256346] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:15.275856] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:15.356094] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6314, magic:0x78563412 [2024-09-11 16:09:15.356136] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:15.356143] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:15.437740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:15.456645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:15.456682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:15.456690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:15.456720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:15.525045] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:15.641268] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3414, replace_start_pos=3800000, replace_num=100000) [2024-09-11 16:09:15.641314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:15.657033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:15.657072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:15.657080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:15.657089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:15.758526] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:15.758571] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46896 [2024-09-11 16:09:15.841405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:15.857343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:15.857388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:15.857396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:15.857405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:15.956718] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46896, magic:0x78563412 [2024-09-11 16:09:15.956759] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:15.956767] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:16.041540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:16.057709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:16.057756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:16.057764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:16.057774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:16.112138] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042156112134, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:09:16.118923] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042156118919, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:09:16.241726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:16.258146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:16.258190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:16.258221] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:16.258231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:16.276076] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:16.359038] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:16.359082] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46904 [2024-09-11 16:09:16.441845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:16.458470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:16.458516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:16.458524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:16.458533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:16.466840] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8293, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:09:16.525978] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:16.557186] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46904, magic:0x78563412 [2024-09-11 16:09:16.557229] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:16.557237] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:16.641991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:16.667094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:16.667137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:16.667145] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:16.667154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:16.842124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:16.867399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:16.867446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:16.867470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:16.867480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:16.958891] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:16.958953] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46908 [2024-09-11 16:09:17.042241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:17.067720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:17.067764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:17.067772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:17.067781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:17.119759] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042157119755, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:09:17.126448] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042157126445, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007526, add_bytes: 0 [2024-09-11 16:09:17.156753] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46908, magic:0x78563412 [2024-09-11 16:09:17.156798] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:17.156805] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:17.242355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:17.268049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:17.268089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:17.268096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:17.268122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:17.276226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:17.442466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:17.468360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:17.468398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:17.468406] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:17.468415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:17.527418] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:17.557741] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:17.557786] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46924 [2024-09-11 16:09:17.642621] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:17.668622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:17.668661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:17.668667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:17.668675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:17.756281] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46924, magic:0x78563412 [2024-09-11 16:09:17.756321] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:17.756329] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:17.846060] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3296, replace_start_pos=3900000, replace_num=100000) [2024-09-11 16:09:17.846106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:17.868899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:17.868962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:17.868969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:17.868978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:18.046189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:18.069310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:18.069349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:18.069357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:18.069366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:18.127312] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042158127308, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:09:18.134161] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042158134158, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007713, add_bytes: 0 [2024-09-11 16:09:18.157555] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:18.157595] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46932 [2024-09-11 16:09:18.246305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:18.269588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:18.269631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:18.269639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:18.269648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:18.269863] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=76, refresh_score_time=63, wash_time=0) [2024-09-11 16:09:18.276399] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:18.356322] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46932, magic:0x78563412 [2024-09-11 16:09:18.356361] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:18.356383] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:18.446445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:18.470058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:18.470099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:18.470106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:18.470116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:18.478813] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8684, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:09:18.528609] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:18.646580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:18.679120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:18.679153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:18.679160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:18.679169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:18.759621] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:18.759659] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46934 [2024-09-11 16:09:18.846693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:18.879467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:18.879511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:18.879519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:18.879529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:18.956970] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46934, magic:0x78563412 [2024-09-11 16:09:18.957012] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:18.957020] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:19.046846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:19.079859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:19.079938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:19.079947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:19.079956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:19.134923] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042159134919, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:09:19.141694] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042159141691, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007533, add_bytes: 0 [2024-09-11 16:09:19.247002] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:19.276599] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:19.280252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:19.280281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:19.280289] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:19.280299] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:19.359414] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:19.359459] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46940 [2024-09-11 16:09:19.447118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:19.480514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:19.480546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:19.480562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:19.480571] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:19.529739] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:19.557358] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46940, magic:0x78563412 [2024-09-11 16:09:19.557402] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:19.557426] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:19.647314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:19.680864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:19.680928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:19.680938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:19.680948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:19.680963] INFO run1 (ob_timer.cpp:374) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] dump timer info(this=0x7f529d2ad7f0, tasks_num=0, wakeup_time=102817335681) [2024-09-11 16:09:19.847430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:19.881189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:19.881224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:19.881231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:19.881240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:19.959249] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:19.959288] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46952 [2024-09-11 16:09:20.051695] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4059, replace_start_pos=4000000, replace_num=100000) [2024-09-11 16:09:20.051734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:20.081494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:20.081540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:20.081566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:20.081576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:20.142539] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042160142536, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:09:20.149371] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042160149367, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:09:20.157758] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46952, magic:0x78563412 [2024-09-11 16:09:20.157797] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:20.157805] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:20.251923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:20.276714] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:20.281804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:20.281831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:20.281839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:20.281847] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:20.452111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:20.482155] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:20.482201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:20.482210] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:20.482219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:20.490532] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8277, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:09:20.531022] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:20.559388] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:20.559431] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46968 [2024-09-11 16:09:20.652290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:20.690781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:20.690815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:20.690823] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:20.690832] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:20.757979] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46968, magic:0x78563412 [2024-09-11 16:09:20.758023] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:20.758030] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:20.852458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:20.891069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:20.891108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:20.891116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:20.891125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:21.052580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:21.091441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:21.091483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:21.091492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:21.091501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:21.150214] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042161150210, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:09:21.156985] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042161156981, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:09:21.159643] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:21.159673] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46976 [2024-09-11 16:09:21.252762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:21.276914] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:21.291803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:21.291850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:21.291858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:21.291868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:21.358464] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46976, magic:0x78563412 [2024-09-11 16:09:21.358507] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:21.358516] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:21.452882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:21.492200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:21.492245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:21.492253] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:21.492263] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:21.532148] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:21.653015] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:21.692566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:21.692610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:21.692618] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:21.692627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:21.751341] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:21.751389] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:21.751467] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=118, max_check_version=119, global_version=120) [2024-09-11 16:09:21.753527] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2058 [2024-09-11 16:09:21.753566] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:21.753601] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:09:21.753639] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:09:21.753722] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:21.753841] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:09:21.753885] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:09:21.753894] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:09:21.753915] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:09:21.753951] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:09:21.754000] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:09:21.754017] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:09:21.760701] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:21.760734] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46988 [2024-09-11 16:09:21.853176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:21.892976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:21.893022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:21.893029] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:21.893039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:21.959164] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46988, magic:0x78563412 [2024-09-11 16:09:21.959200] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:21.959209] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:22.053403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:22.093293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:22.093339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:22.093347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:22.093356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:22.157779] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726042162157774, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:09:22.164533] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042162164529, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:09:22.257960] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4372, replace_start_pos=4100000, replace_num=100000) [2024-09-11 16:09:22.258002] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:22.277031] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:22.293655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:22.293699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:22.293707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:22.293716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:22.360637] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:22.360682] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46990 [2024-09-11 16:09:22.458162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:22.493986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:22.494050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:22.494058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:22.494067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:22.501165] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7084, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:09:22.532966] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:22.559500] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46990, magic:0x78563412 [2024-09-11 16:09:22.559543] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:22.559551] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:22.658347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:22.701477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:22.701518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:22.701527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:22.701536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:22.858544] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:22.901828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:22.901870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:22.901877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:22.901885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:22.961781] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:22.961825] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:46992 [2024-09-11 16:09:23.058668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:23.102189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:23.102236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:23.102261] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:23.102271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:23.160074] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:46992, magic:0x78563412 [2024-09-11 16:09:23.160110] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:23.160118] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:23.165385] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042163165383, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:09:23.172216] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042163172212, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:09:23.258860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:23.277158] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:23.302597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:23.302643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:23.302651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:23.302661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:23.459065] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:23.502996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:23.503041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:23.503050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:23.503059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:23.533919] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:23.562297] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:23.562347] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=44] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47004 [2024-09-11 16:09:23.659276] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:23.703311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:23.703372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:23.703380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:23.703389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:23.760633] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47004, magic:0x78563412 [2024-09-11 16:09:23.760670] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:23.760678] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:23.859472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:23.903687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:23.903734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:23.903742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:23.903752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:24.059600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:24.104007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:24.104049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:24.104056] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:24.104087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:24.161465] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:24.161510] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47016 [2024-09-11 16:09:24.173075] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042164173072, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:09:24.179768] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042164179765, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:09:24.259730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:24.277276] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:24.304391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:24.304439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:24.304447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:24.304457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:24.360074] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47016, magic:0x78563412 [2024-09-11 16:09:24.360116] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:24.360124] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:24.464147] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4297, replace_start_pos=4200000, replace_num=100000) [2024-09-11 16:09:24.464193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:24.504777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:24.504823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:24.504832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:24.504841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:24.512062] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7207, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:09:24.534714] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:24.664393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:24.712330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:24.712371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:24.712378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:24.712402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:24.761681] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:24.761726] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47030 [2024-09-11 16:09:24.864578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:24.912704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:24.912750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:24.912758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:24.912768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:24.960240] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47030, magic:0x78563412 [2024-09-11 16:09:24.960275] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:24.960281] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:25.064760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:25.113079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:25.113127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:25.113135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:25.113145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:25.180686] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042165180682, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:09:25.187378] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042165187375, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:09:25.264987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:25.277399] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:25.313394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:25.313440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:25.313448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:25.313457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:25.362017] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:25.362063] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:47046 [2024-09-11 16:09:25.465110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:25.513699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:25.513742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:25.513750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:25.513758] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:25.535660] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:25.560749] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:47046, magic:0x78563412 [2024-09-11 16:09:25.560788] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:25.560795] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:25.665228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:25.714081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:25.714124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:25.714132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:25.714142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:25.865399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:25.914439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:25.914485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:25.914493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:25.914503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:25.962954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:25.962999] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14108 [2024-09-11 16:09:26.065541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:26.114763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:26.114808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:26.114815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:26.114825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:26.161216] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14108, magic:0x78563412 [2024-09-11 16:09:26.161259] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:26.161266] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:26.188252] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042166188248, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:09:26.194992] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726042166194988, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:09:26.265673] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:26.277545] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:26.315144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:26.315211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:26.315220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:26.315229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:26.465787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:26.515532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:26.515577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:26.515585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:26.515595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:26.523470] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7862, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:09:26.536557] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:26.563132] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:26.563177] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14116 [2024-09-11 16:09:26.670317] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4348, replace_start_pos=4300000, replace_num=100000) [2024-09-11 16:09:26.670364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:26.723713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:26.723758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:26.723766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:26.723776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:26.724002] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:09:26.761516] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14116, magic:0x78563412 [2024-09-11 16:09:26.761556] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:26.761562] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:26.870533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:26.924233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:26.924279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:26.924286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:26.924295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:27.070674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:27.124518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:27.124559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:27.124566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:27.124574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:27.164186] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:27.164221] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14124 [2024-09-11 16:09:27.195928] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042167195924, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:09:27.202690] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042167202685, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 16:09:27.270798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:27.277657] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:27.324837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:27.324874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:27.324882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:27.324929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:27.362467] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14124, magic:0x78563412 [2024-09-11 16:09:27.362508] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:27.362516] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:27.470974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:27.525221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:27.525266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:27.525274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:27.525284] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:27.537653] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:27.671119] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:27.725597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:27.725642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:27.725650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:27.725661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:27.766703] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:27.766749] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14126 [2024-09-11 16:09:27.871237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:27.925933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:27.925977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:27.925985] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:27.925995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:27.962684] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14126, magic:0x78563412 [2024-09-11 16:09:27.962726] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:27.962734] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:28.071356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:28.126317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:28.126366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:28.126373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:28.126383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:28.203536] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042168203532, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:09:28.210312] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042168210308, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:09:28.271529] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:28.277751] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=26] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:28.326630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:28.326676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:28.326685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:28.326698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:28.365171] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:28.365212] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14128 [2024-09-11 16:09:28.471648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:28.526949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:28.526993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:28.527001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:28.527010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:28.535579] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8556, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:09:28.538606] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:28.563284] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14128, magic:0x78563412 [2024-09-11 16:09:28.563326] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:28.563335] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:28.671825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:28.735843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:28.735889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:28.735897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:28.735929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:28.876319] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4355, replace_start_pos=4400000, replace_num=100000) [2024-09-11 16:09:28.876367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:28.936211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:28.936251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:28.936259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:28.936269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:28.965112] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:28.965157] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14140 [2024-09-11 16:09:29.076469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:29.136492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:29.136548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:29.136562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:29.136572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:29.163671] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14140, magic:0x78563412 [2024-09-11 16:09:29.163708] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:29.163717] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:29.211079] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042169211075, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:09:29.217921] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042169217918, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:09:29.276682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:29.277877] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:29.336801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:29.336843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:29.336852] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:29.336860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:29.476800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:29.537080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:29.537119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:29.537144] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:29.537154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:29.539533] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:29.565666] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:29.565711] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14146 [2024-09-11 16:09:29.676961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:29.737373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:29.737414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:29.737421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:29.737429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:29.764122] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14146, magic:0x78563412 [2024-09-11 16:09:29.764161] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:29.764170] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:29.877150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:29.937737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:29.937782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:29.937791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:29.937800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:30.077296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:30.138050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:30.138087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:30.138095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:30.138104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:30.165134] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:30.165178] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14156 [2024-09-11 16:09:30.218764] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042170218760, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:09:30.225550] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042170225546, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:09:30.277551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:30.278044] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:30.338408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:30.338455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:30.338465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:30.338479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:30.363641] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14156, magic:0x78563412 [2024-09-11 16:09:30.363675] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:30.363683] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:30.477716] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:30.538725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:30.538763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:30.538770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:30.538779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:30.540469] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:30.547055] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8244, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:09:30.677843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:30.747300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:30.747342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:30.747366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:30.747375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:30.765735] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:30.765770] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14162 [2024-09-11 16:09:30.878027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:30.947612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:30.947652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:30.947659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:30.947668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:30.964014] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14162, magic:0x78563412 [2024-09-11 16:09:30.964057] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:30.964065] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:31.082505] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4349, replace_start_pos=4500000, replace_num=100000) [2024-09-11 16:09:31.082554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:31.147999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:31.148047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:31.148055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:31.148064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:31.226334] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042171226329, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007569, add_bytes: 0 [2024-09-11 16:09:31.233095] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042171233090, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:09:31.278243] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:31.282657] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:31.348376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:31.348421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:31.348429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:31.348439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:31.366384] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:31.366430] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14166 [2024-09-11 16:09:31.482843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:31.541360] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:31.548824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:31.548864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:31.548872] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:31.548881] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:31.564569] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14166, magic:0x78563412 [2024-09-11 16:09:31.564612] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:31.564619] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:31.683025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:31.749095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:31.749130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:31.749136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:31.749156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:31.766583] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:31.766619] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:31.766688] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] update_check_range(min_check_version=119, max_check_version=120, global_version=121) [2024-09-11 16:09:31.768432] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1744 [2024-09-11 16:09:31.768469] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:31.768501] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:09:31.768535] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:09:31.768635] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:31.768717] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:09:31.768761] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:09:31.768771] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:09:31.768782] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:09:31.768815] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:09:31.768863] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:09:31.768884] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:09:31.883161] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:31.949380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:31.949417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:31.949424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:31.949434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:31.966952] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:31.966989] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14170 [2024-09-11 16:09:32.083285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:32.149643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:32.149687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:32.149695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:32.149704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:32.163929] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14170, magic:0x78563412 [2024-09-11 16:09:32.163973] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:32.163981] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:32.234009] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042172234004, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:09:32.240698] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042172240693, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:09:32.278359] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:32.283422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:32.349964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:32.350010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:32.350017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:32.350027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:32.483551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:32.542426] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:32.550250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:32.550293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:32.550301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:32.550310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:32.558847] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8524, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:09:32.565703] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:32.565740] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14172 [2024-09-11 16:09:32.683675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:32.759227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:32.759271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:32.759278] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:32.759288] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:32.764338] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14172, magic:0x78563412 [2024-09-11 16:09:32.764371] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:32.764379] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:32.883804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:32.959514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:32.959557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:32.959564] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:32.959571] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:33.083920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:33.159864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:33.159927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:33.159938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:33.159947] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:33.166533] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:33.166568] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14186 [2024-09-11 16:09:33.241552] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042173241548, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:09:33.248366] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042173248363, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:09:33.278475] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:33.288517] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4413, replace_start_pos=4600000, replace_num=100000) [2024-09-11 16:09:33.288557] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:33.360170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:33.360209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:33.360215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:33.360222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:33.364976] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14186, magic:0x78563412 [2024-09-11 16:09:33.365009] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:33.365017] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:33.488664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:33.543604] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:33.560556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:33.560599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:33.560608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:33.560617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:33.688804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:33.760851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:33.760891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:33.760931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:33.760942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:33.766954] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:33.766991] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14188 [2024-09-11 16:09:33.888927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:33.961174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:33.961212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:33.961220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:33.961229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:33.965370] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14188, magic:0x78563412 [2024-09-11 16:09:33.965397] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:33.965405] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:34.089046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:34.161467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:34.161521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:34.161528] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:34.161536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:34.249159] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042174249155, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:09:34.255936] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042174255933, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:09:34.278584] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:34.289185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:34.361835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:34.361881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:34.361889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:34.361899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:34.367647] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:34.367687] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14192 [2024-09-11 16:09:34.489304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:34.544636] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:34.562225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:34.562271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:34.562279] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:34.562288] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:34.565648] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14192, magic:0x78563412 [2024-09-11 16:09:34.565683] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:34.565692] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:34.570564] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8263, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:09:34.689491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:34.770830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:34.770877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:34.770886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:34.770931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:34.889678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:34.967850] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:34.967888] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:14196 [2024-09-11 16:09:34.971156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:34.971183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:34.971190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:34.971198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:35.089862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:35.166266] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:14196, magic:0x78563412 [2024-09-11 16:09:35.166310] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:35.166317] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:35.171413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:35.171451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:35.171457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:35.171465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:35.256775] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726042175256771, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:09:35.263615] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042175263611, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:09:35.278703] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:35.290028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:35.371702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:35.371746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:35.371754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:35.371763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:35.494539] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4370, replace_start_pos=4700000, replace_num=100000) [2024-09-11 16:09:35.494579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:35.545872] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:35.568082] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:35.568124] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64920 [2024-09-11 16:09:35.572008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:35.572036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:35.572042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:35.572049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:35.694682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:35.766567] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64920, magic:0x78563412 [2024-09-11 16:09:35.766611] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:35.766619] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:35.772272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:35.772300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:35.772307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:35.772316] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:35.894868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:35.972627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:35.972675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:35.972683] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:35.972692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:36.095017] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:36.168283] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:36.168329] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64936 [2024-09-11 16:09:36.172967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:36.173000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:36.173008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:36.173017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:36.264530] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042176264526, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007755, add_bytes: 0 [2024-09-11 16:09:36.271149] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726042176271145, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 16:09:36.278918] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:36.295156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:36.367116] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64936, magic:0x78563412 [2024-09-11 16:09:36.367153] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:36.367159] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:36.373232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:36.373266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:36.373272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:36.373280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:36.495276] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:36.547199] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:36.573582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:36.573628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:36.573636] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:36.573645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:36.581166] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7508, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:09:36.695417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:36.769435] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=19] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:36.769482] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64942 [2024-09-11 16:09:36.781484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:36.781525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:36.781533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:36.781542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:36.895539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:36.967468] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64942, magic:0x78563412 [2024-09-11 16:09:36.967511] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:36.967519] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:36.981772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:36.981828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:36.981836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:36.981845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:37.095654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:37.182192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:37.182238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:37.182247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:37.182256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:37.272008] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042177272004, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007478, add_bytes: 0 [2024-09-11 16:09:37.278782] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042177278779, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:09:37.279034] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:37.295779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:37.369351] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:37.369399] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=43] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64946 [2024-09-11 16:09:37.382553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:37.382598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:37.382606] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:37.382616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:37.495891] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:37.548070] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:37.567947] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64946, magic:0x78563412 [2024-09-11 16:09:37.567988] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:37.567996] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:37.582944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:37.582981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:37.582988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:37.582997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:37.700083] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4052, replace_start_pos=4800000, replace_num=100000) [2024-09-11 16:09:37.700123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:37.783325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:37.783369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:37.783377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:37.783386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:37.900220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:37.969327] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:37.969372] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64954 [2024-09-11 16:09:37.983675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:37.983719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:37.983726] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:37.983734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:38.100399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:38.166525] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64954, magic:0x78563412 [2024-09-11 16:09:38.166570] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:38.166578] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:38.184001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:38.184042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:38.184049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:38.184058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:38.279121] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=19] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:38.279623] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042178279621, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:09:38.286390] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042178286387, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:09:38.300601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:38.384350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:38.384393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:38.384400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:38.384410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:38.500733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:38.549127] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:38.569063] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:38.569108] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64966 [2024-09-11 16:09:38.584707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:38.584747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:38.584755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:38.584765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:38.585020] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash time detail, (compute_wash_size_time=92, refresh_score_time=61, wash_time=0) [2024-09-11 16:09:38.592618] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7580, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:09:38.700932] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:38.767083] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64966, magic:0x78563412 [2024-09-11 16:09:38.767125] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:38.767133] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:38.792844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:38.792886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:38.792893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:38.792932] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:38.901063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:38.993141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:38.993185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:38.993193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:38.993202] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:39.101239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:39.169551] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:39.169604] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=47] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64970 [2024-09-11 16:09:39.193441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:39.193485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:39.193492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:39.193501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:39.279248] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:39.287238] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726042179287237, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:09:39.294006] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042179294003, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:09:39.301353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:39.367658] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64970, magic:0x78563412 [2024-09-11 16:09:39.367695] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:39.367700] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:39.393732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:39.393765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:39.393770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:39.393777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:39.501471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:39.550099] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:39.594074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:39.594119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:39.594127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:39.594137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:39.701591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:39.769501] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:39.769560] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64978 [2024-09-11 16:09:39.794364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:39.794401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:39.794409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:39.794418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:39.906031] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4267, replace_start_pos=4900000, replace_num=100000) [2024-09-11 16:09:39.906075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:39.968062] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64978, magic:0x78563412 [2024-09-11 16:09:39.968098] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:39.968105] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:39.994648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:39.994686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:39.994693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:39.994702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:40.106153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:40.195019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:40.195063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:40.195071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:40.195102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:40.279356] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:40.294936] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042180294933, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 16:09:40.301632] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042180301628, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:09:40.306279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:40.370305] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:40.370352] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64980 [2024-09-11 16:09:40.395337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:40.395383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:40.395391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:40.395400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:40.506452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:40.551061] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:40.568389] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64980, magic:0x78563412 [2024-09-11 16:09:40.568431] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:40.568439] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:40.595628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:40.595671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:40.595679] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:40.595688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:40.603462] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7761, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:09:40.706582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:40.803696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:40.803750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:40.803756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:40.803764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:40.906695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:40.970377] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:40.970422] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64990 [2024-09-11 16:09:41.004079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:41.004124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:41.004132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:41.004142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:41.106874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:41.168937] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64990, magic:0x78563412 [2024-09-11 16:09:41.168979] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:41.168987] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:41.204451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:41.204496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:41.204504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:41.204514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:41.279503] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:41.302479] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042181302476, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:09:41.307012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:41.309242] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042181309239, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:09:41.404833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:41.404873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:41.404881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:41.404891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:41.507121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:41.552223] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:41.570661] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:41.570704] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64992 [2024-09-11 16:09:41.605235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:41.605274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:41.605282] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:41.605291] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:41.707254] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:41.769399] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64992, magic:0x78563412 [2024-09-11 16:09:41.769441] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:41.769449] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:41.782600] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:41.782657] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=55] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:41.782737] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=120, max_check_version=121, global_version=122) [2024-09-11 16:09:41.784846] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2107 [2024-09-11 16:09:41.784889] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:41.784939] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:09:41.784978] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:09:41.785061] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:41.785182] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:09:41.785243] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:09:41.785254] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:09:41.785265] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:09:41.785305] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:09:41.785368] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:09:41.785390] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:09:41.805590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:41.805630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:41.805639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:41.805649] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:41.907395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:42.005873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:42.005934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:42.005942] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:42.005949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:42.111855] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4329, replace_start_pos=5000000, replace_num=100000) [2024-09-11 16:09:42.111910] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:42.170143] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:42.170188] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:64998 [2024-09-11 16:09:42.206197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:42.206241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:42.206248] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:42.206257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:42.279688] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:42.310154] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042182310151, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:09:42.311996] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:42.316853] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042182316850, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:09:42.368884] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=21] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:64998, magic:0x78563412 [2024-09-11 16:09:42.368942] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=53] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:42.368949] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:42.406487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:42.406530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:42.406537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:42.406544] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:42.512173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:42.553657] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:42.606841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:42.606887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:42.606895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:42.606927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:42.615445] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8501, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:09:42.712306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:42.770648] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:42.770694] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:65004 [2024-09-11 16:09:42.815764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:42.815808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:42.815816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:42.815825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:42.912447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:42.969305] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:65004, magic:0x78563412 [2024-09-11 16:09:42.969346] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:42.969354] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:43.016130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:43.016175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:43.016183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:43.016193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:43.112568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:43.216496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:43.216542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:43.216550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:43.216577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:43.279880] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:43.312683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:43.317786] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042183317783, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:09:43.324477] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042183324473, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:09:43.371590] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:43.371635] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:65020 [2024-09-11 16:09:43.416885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:43.416950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:43.416958] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:43.416967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:43.512856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:43.554660] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:43.569806] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:65020, magic:0x78563412 [2024-09-11 16:09:43.569848] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:43.569856] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:43.617278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:43.617320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:43.617328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:43.617338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:43.713070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:43.817584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:43.817631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:43.817655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:43.817664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:43.913183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:43.971793] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:43.971832] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:65026 [2024-09-11 16:09:44.017976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:44.018021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:44.018029] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:44.018038] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:44.113307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:44.170296] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:65026, magic:0x78563412 [2024-09-11 16:09:44.170354] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:44.172027] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=1672][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:44.218271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:44.218314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:44.218320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:44.218328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:44.280025] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:44.317810] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4385, replace_start_pos=5100000, replace_num=100000) [2024-09-11 16:09:44.317856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:44.325394] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042184325390, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:09:44.332078] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042184332075, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:09:44.418544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:44.418588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:44.418594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:44.418601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:44.517947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:44.555757] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:44.572349] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:44.572394] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:65034 [2024-09-11 16:09:44.618828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:44.618873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:44.618880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:44.618889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:44.627329] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8404, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:09:44.718064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:44.770860] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:65034, magic:0x78563412 [2024-09-11 16:09:44.770923] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:44.770934] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:44.827684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:44.827730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:44.827760] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:44.827771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:44.918182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:45.028093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:45.028141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:45.028151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:45.028161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:45.118315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:45.173348] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:45.173391] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:65044 [2024-09-11 16:09:45.228472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:45.228514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:45.228522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:45.228531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:45.280230] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:45.318434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:45.333006] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042185333003, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:09:45.339707] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042185339704, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:09:45.371406] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:65044, magic:0x78563412 [2024-09-11 16:09:45.371450] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:45.371457] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:45.428828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:45.428867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:45.428876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:45.428886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:45.518549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:45.556803] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:45.629121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:45.629167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:45.629174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:45.629183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:45.718675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:45.773122] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:45.773161] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58334 [2024-09-11 16:09:45.829510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:45.829555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:45.829563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:45.829574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:45.918783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:45.970597] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58334, magic:0x78563412 [2024-09-11 16:09:45.970635] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:45.970643] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:46.029877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:46.029939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:46.029948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:46.029958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:46.118891] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:46.230193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:46.230236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:46.230244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:46.230253] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:46.280440] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:46.319043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:46.340619] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042186340615, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:09:46.347322] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042186347318, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:09:46.372973] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:46.373016] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58346 [2024-09-11 16:09:46.430550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:46.430595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:46.430604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:46.430634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:46.523081] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3919, replace_start_pos=5200000, replace_num=100000) [2024-09-11 16:09:46.523130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:46.558133] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:46.571534] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58346, magic:0x78563412 [2024-09-11 16:09:46.571596] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:46.571605] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:46.630843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:46.630873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:46.630879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:46.630887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:46.637520] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6621, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:09:46.723227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:46.837842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:46.837887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:46.837895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:46.837927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:46.923348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:46.973136] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:46.973179] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58348 [2024-09-11 16:09:47.038223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:47.038266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:47.038274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:47.038301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:47.123537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:47.171855] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58348, magic:0x78563412 [2024-09-11 16:09:47.171899] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:47.171936] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:47.238541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:47.238581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:47.238588] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:47.238598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:47.280569] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:47.323733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:47.348168] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042187348164, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:09:47.355001] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042187354998, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:09:47.438899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:47.438963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:47.438971] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:47.438980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:47.523871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:47.559186] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:47.573836] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:47.573872] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58356 [2024-09-11 16:09:47.639284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:47.639327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:47.639350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:47.639360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:47.724023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=79] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:47.772186] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58356, magic:0x78563412 [2024-09-11 16:09:47.772228] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:47.772236] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:47.839599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:47.839641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:47.839649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:47.839659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:47.924135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:48.040006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:48.040051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:48.040059] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:48.040068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:48.124334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:48.172947] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:48.172987] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58370 [2024-09-11 16:09:48.240373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:48.240418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:48.240426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:48.240436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:48.280771] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:48.324456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:48.355779] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042188355776, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:09:48.362550] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042188362547, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:09:48.371501] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58370, magic:0x78563412 [2024-09-11 16:09:48.371534] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=28] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:48.371541] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:48.440750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:48.440796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:48.440805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:48.440814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:48.524581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:48.560361] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:48.641072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:48.641117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:48.641124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:48.641134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:48.648109] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6962, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:09:48.729025] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4323, replace_start_pos=5300000, replace_num=100000) [2024-09-11 16:09:48.729090] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:48.773605] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:48.773646] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58384 [2024-09-11 16:09:48.848353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:48.848400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:48.848408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:48.848417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:48.929173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:48.972011] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58384, magic:0x78563412 [2024-09-11 16:09:48.972065] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=48] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:48.972073] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:49.048721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:49.048766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:49.048775] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:49.048784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:49.129291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:49.249083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:49.249134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:49.249160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:49.249169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:49.280971] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:49.329408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:49.363470] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042189363466, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:09:49.370160] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042189370158, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:09:49.372621] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:49.372656] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58394 [2024-09-11 16:09:49.449420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:49.449464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:49.449471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:49.449481] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:49.529525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:49.561785] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:49.571242] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58394, magic:0x78563412 [2024-09-11 16:09:49.571281] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:49.571288] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:49.649781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:49.649827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:49.649835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:49.649845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:49.729639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:49.850138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:49.850205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:49.850214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:49.850224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:49.929753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:49.973251] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:49.973286] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58404 [2024-09-11 16:09:50.050438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:50.050478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:50.050484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:50.050492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:50.129890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:50.171713] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58404, magic:0x78563412 [2024-09-11 16:09:50.171752] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:50.171760] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:50.250804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:50.250848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:50.250856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:50.250865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:50.281096] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:50.330023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:50.371141] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042190371137, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:09:50.377779] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042190377775, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:09:50.451176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:50.451221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:50.451230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:50.451239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:50.530140] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:50.563082] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:50.573147] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:50.573191] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58416 [2024-09-11 16:09:50.651538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:50.651582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:50.651590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:50.651599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:50.658846] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7234, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:09:50.730251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:50.771955] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58416, magic:0x78563412 [2024-09-11 16:09:50.771994] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:50.772002] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:50.859179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:50.859222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:50.859230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:50.859256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:50.934795] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4406, replace_start_pos=5400000, replace_num=100000) [2024-09-11 16:09:50.934844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:51.059556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:51.059604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:51.059612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:51.059622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:51.135012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:51.174401] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:51.174445] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58428 [2024-09-11 16:09:51.259935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:51.259978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:51.259986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:51.259995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:51.281260] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:51.335217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:51.372679] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58428, magic:0x78563412 [2024-09-11 16:09:51.372742] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=59] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:51.372750] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:51.378693] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042191378691, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:09:51.385391] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042191385388, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:09:51.460289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:51.460333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:51.460341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:51.460351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:51.535419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:51.564255] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:51.660649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:51.660695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:51.660703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:51.660713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:51.735604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:51.775254] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:51.775296] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58438 [2024-09-11 16:09:51.800082] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:51.800130] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:09:51.800203] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=121, max_check_version=122, global_version=123) [2024-09-11 16:09:51.801929] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1724 [2024-09-11 16:09:51.801980] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:51.802012] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:09:51.802044] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:09:51.802118] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:09:51.802201] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:09:51.802260] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,280 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,896 used= 242,930 count= 931 avg_used= 260 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,280 used= 1,214,479 count= 14,563 avg_used= 83 mod=SUMMARY [2024-09-11 16:09:51.802270] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:09:51.802278] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:09:51.802310] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:09:51.802357] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:09:51.802374] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:09:51.861031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:51.861079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:51.861086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:51.861096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:51.935727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:51.973144] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58438, magic:0x78563412 [2024-09-11 16:09:51.973188] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:51.973197] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:52.061341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:52.061385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:52.061393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:52.061402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:52.135930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:52.261703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:52.261741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:52.261750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:52.261779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:52.281445] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:52.336067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:52.374729] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:52.374775] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58440 [2024-09-11 16:09:52.386253] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042192386249, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:09:52.393016] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042192393012, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:09:52.462078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:52.462122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:52.462129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:52.462139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:52.536255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:52.565204] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:52.573336] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58440, magic:0x78563412 [2024-09-11 16:09:52.573373] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:52.573380] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:52.662432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:52.662480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:52.662488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:52.662498] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:52.669784] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7273, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:09:52.736444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:52.870057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:52.870129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:52.870137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:52.870146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:52.936568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:52.975579] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:52.975624] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58446 [2024-09-11 16:09:53.070461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:53.070499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:53.070507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:53.070516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:53.141010] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4322, replace_start_pos=5500000, replace_num=100000) [2024-09-11 16:09:53.141062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:53.173860] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58446, magic:0x78563412 [2024-09-11 16:09:53.173899] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:53.173930] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:53.270812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:53.270857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:53.270865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:53.270891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:53.281645] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:53.341202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:53.393935] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042193393931, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:09:53.400633] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042193400630, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:09:53.471153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:53.471202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:53.471210] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:53.471219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:53.541329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:53.566428] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:53.576248] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:53.576294] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58454 [2024-09-11 16:09:53.671454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:53.671499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:53.671507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:53.671516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:53.741461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:53.774558] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58454, magic:0x78563412 [2024-09-11 16:09:53.774597] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:53.774604] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:53.871741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:53.871789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:53.871795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:53.871831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:53.941577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:54.072073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:54.072120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:54.072128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:54.072136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:54.141724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:54.176328] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:54.176370] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58458 [2024-09-11 16:09:54.272373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:54.272420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:54.272434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:54.272444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:54.281769] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:54.341934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:54.374991] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58458, magic:0x78563412 [2024-09-11 16:09:54.375033] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:54.375058] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:54.401591] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042194401588, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:09:54.408244] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042194408240, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:09:54.472751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:54.472795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:54.472803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:54.472812] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:54.542126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:54.567668] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:54.673128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:54.673167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:54.673173] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:54.673182] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:54.679805] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6611, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:09:54.742332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:54.777031] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:54.777074] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58472 [2024-09-11 16:09:54.880131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:54.880173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:54.880181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:54.880190] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:54.942515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:54.975645] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58472, magic:0x78563412 [2024-09-11 16:09:54.975690] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:54.975698] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:55.080489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:55.080533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:55.080541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:55.080551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:55.142644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:55.280849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:55.280894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:55.280920] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:55.280931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:55.281894] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:55.347166] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4340, replace_start_pos=5600000, replace_num=100000) [2024-09-11 16:09:55.347216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:55.377232] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:55.377275] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:58486 [2024-09-11 16:09:55.409168] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042195409163, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 16:09:55.415894] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042195415888, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007648, add_bytes: 0 [2024-09-11 16:09:55.481227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:55.481292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:55.481300] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:55.481310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:55.547362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:55.569190] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:55.575859] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:58486, magic:0x78563412 [2024-09-11 16:09:55.575899] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:55.575933] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=33][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:55.681548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:55.681588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:55.681596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:55.681605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:55.747550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:55.881837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:55.881882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:55.881890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:55.881899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:55.947736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:55.977337] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=10] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:55.977380] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59820 [2024-09-11 16:09:56.082146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:56.082190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:56.082198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:56.082226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:56.147862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:56.174643] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59820, magic:0x78563412 [2024-09-11 16:09:56.174682] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:56.174689] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:56.282058] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:56.282531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:56.282564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:56.282572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:56.282581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:56.347991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:56.416718] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042196416714, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:09:56.423538] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=76] PNIO [ratelimit] time: 1726042196423534, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007646, add_bytes: 0 [2024-09-11 16:09:56.482873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:56.482936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:56.482946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:56.482955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:56.548181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:56.570237] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:56.575233] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:56.575266] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59834 [2024-09-11 16:09:56.683191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:56.683233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:56.683256] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:56.683265] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:56.690300] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7022, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:09:56.748397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:56.773953] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59834, magic:0x78563412 [2024-09-11 16:09:56.773993] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:56.774001] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:56.890609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:56.890654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:56.890662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:56.890672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:56.890863] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:09:56.948578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:57.091161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:57.091202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:57.091210] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:57.091219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:57.148756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:57.176485] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:57.176531] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59840 [2024-09-11 16:09:57.282255] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:57.291536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:57.291579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:57.291587] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:57.291597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:57.348876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:57.374714] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59840, magic:0x78563412 [2024-09-11 16:09:57.374756] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:57.374763] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:57.424342] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042197424337, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:09:57.431214] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042197431210, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:09:57.491891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:57.491958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:57.491966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:57.491976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:57.553149] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4083, replace_start_pos=5700000, replace_num=100000) [2024-09-11 16:09:57.553202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:57.571046] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:57.692274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:57.692315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:57.692323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:57.692349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:57.753297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:09:57.776688] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:57.776734] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59854 [2024-09-11 16:09:57.892659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:57.892701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:57.892709] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:57.892718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:57.953432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:09:57.975072] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59854, magic:0x78563412 [2024-09-11 16:09:57.975114] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:57.975122] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:58.093051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:58.093096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:58.093103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:58.093112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:58.153565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:09:58.282439] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:58.293333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:58.293375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:58.293381] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:58.293389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:58.353704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:09:58.377099] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:58.377140] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59864 [2024-09-11 16:09:58.432009] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042198432004, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:09:58.438774] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042198438770, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:09:58.493604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:58.493647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:58.493653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:58.493661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:58.553825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:09:58.571995] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:58.575351] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59864, magic:0x78563412 [2024-09-11 16:09:58.575379] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:58.575385] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:58.693967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:58.694003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:58.694011] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:58.694020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:58.701363] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7330, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:09:58.753946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:09:58.901719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:58.901761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:58.901769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:58.901779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:58.902015] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=77, refresh_score_time=64, wash_time=0) [2024-09-11 16:09:58.954089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:09:58.984502] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:58.984547] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59880 [2024-09-11 16:09:59.102379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:59.102426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:59.102435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:59.102444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:59.154218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:09:59.176012] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59880, magic:0x78563412 [2024-09-11 16:09:59.176053] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:59.176060] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:59.282639] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:09:59.302748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:59.302791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:59.302799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:59.302809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:59.354351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:09:59.439630] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042199439626, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:09:59.446328] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042199446324, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:09:59.503113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:59.503158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:59.503165] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:59.503175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:59.554484] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:09:59.572980] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:09:59.577618] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:09:59.577653] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59894 [2024-09-11 16:09:59.703398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:59.703440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:59.703446] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:59.703453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:59.757929] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3322, replace_start_pos=5800000, replace_num=100000) [2024-09-11 16:09:59.757971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:09:59.776468] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59894, magic:0x78563412 [2024-09-11 16:09:59.776508] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:09:59.776535] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:09:59.903746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:09:59.903787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:09:59.903796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:09:59.903805] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:09:59.958117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:00.104038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:00.104073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:00.104080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:00.104087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:00.158301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:00.178440] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:00.178481] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59908 [2024-09-11 16:10:00.284317] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=1603] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:00.304410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:00.304448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:00.304456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:00.304465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:00.358499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:00.377004] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59908, magic:0x78563412 [2024-09-11 16:10:00.377045] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:00.377053] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:00.441235] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:10:00.447243] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042200447238, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:10:00.447288] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:10:00.451615] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:10:00.454017] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042200454015, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:10:00.454048] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:10:00.504775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:00.504813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:00.504822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:00.504831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:00.558692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:00.574153] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:00.705122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:00.705163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:00.705171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:00.705181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:00.713270] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8076, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:10:00.758877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:00.779303] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:00.779364] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=56] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59920 [2024-09-11 16:10:00.913598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:00.913643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:00.913651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:00.913661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:00.959079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:00.977573] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59920, magic:0x78563412 [2024-09-11 16:10:00.977614] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:00.977621] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:01.113977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:01.114022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:01.114030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:01.114039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:01.159269] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:01.284533] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:01.314348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:01.314390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:01.314398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:01.314408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:01.359481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:01.379107] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:01.379150] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59926 [2024-09-11 16:10:01.454873] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042201454869, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:10:01.461556] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042201461553, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007538, add_bytes: 0 [2024-09-11 16:10:01.514727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:01.514772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:01.514780] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:01.514790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:01.559669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:01.575551] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:01.577824] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59926, magic:0x78563412 [2024-09-11 16:10:01.577854] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:01.577863] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:01.715085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:01.715130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:01.715138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:01.715147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:01.759891] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:01.815382] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:01.815420] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:01.815488] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=122, max_check_version=123, global_version=124) [2024-09-11 16:10:01.817220] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1731 [2024-09-11 16:10:01.817254] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:01.817285] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:10:01.817318] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:10:01.817391] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:01.817485] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:10:01.817527] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:10:01.817536] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:10:01.817545] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:10:01.817576] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:10:01.817627] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:10:01.817646] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:10:01.915452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:01.915496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:01.915504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:01.915514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:01.964476] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4373, replace_start_pos=5900000, replace_num=100000) [2024-09-11 16:10:01.964527] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:01.979623] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:01.979663] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59928 [2024-09-11 16:10:02.115780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:02.115824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:02.115831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:02.115841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:02.164686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:02.178292] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59928, magic:0x78563412 [2024-09-11 16:10:02.178336] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:02.178344] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:02.284662] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:02.316081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:02.316124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:02.316131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:02.316141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:02.364851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:02.462481] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726042202462477, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:10:02.469172] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042202469169, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:10:02.516380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:02.516425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:02.516431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:02.516438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:02.564966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:02.576795] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:02.580461] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:02.580497] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=31] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59938 [2024-09-11 16:10:02.716666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:02.716710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:02.716718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:02.716727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:02.724888] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8132, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:10:02.765086] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:02.778860] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59938, magic:0x78563412 [2024-09-11 16:10:02.778890] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:02.778898] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:02.925169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:02.925222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:02.925231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:02.925241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:02.965207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:03.125466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:03.125510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:03.125517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:03.125525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:03.165326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:03.180931] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:03.180971] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59948 [2024-09-11 16:10:03.284875] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:03.325827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:03.325867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:03.325874] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:03.325882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:03.365456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:03.379285] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59948, magic:0x78563412 [2024-09-11 16:10:03.379328] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:03.379335] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:03.470093] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042203470089, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:10:03.476849] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042203476846, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:10:03.526153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:03.526198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:03.526206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:03.526215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:03.565581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:03.578056] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:03.726538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:03.726585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:03.726593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:03.726603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:03.765704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:03.781798] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:03.781841] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59952 [2024-09-11 16:10:03.926896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:03.926967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:03.926973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:03.926981] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:03.965811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:03.978674] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59952, magic:0x78563412 [2024-09-11 16:10:03.978709] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:03.978716] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:04.127207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:04.127252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:04.127260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:04.127269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:04.170288] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4355, replace_start_pos=6000000, replace_num=100000) [2024-09-11 16:10:04.170335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:04.285091] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:04.327500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:04.327549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:04.327557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:04.327567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:04.370423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:04.380749] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:04.380792] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59966 [2024-09-11 16:10:04.477659] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042204477654, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 16:10:04.484402] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042204484398, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:10:04.527830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:04.527873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:04.527881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:04.527891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:04.570538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:04.579034] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59966, magic:0x78563412 [2024-09-11 16:10:04.579060] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=20] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:04.579067] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:04.579181] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:04.728143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:04.728180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:04.728188] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:04.728197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:04.735450] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7240, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:10:04.770728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:04.935709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:04.935753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:04.935761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:04.935791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:04.970932] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:04.981366] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:04.981412] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:59970 [2024-09-11 16:10:05.136042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:05.136085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:05.136093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:05.136102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:05.171106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:05.179481] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:59970, magic:0x78563412 [2024-09-11 16:10:05.179515] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:05.179522] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:05.285231] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:05.336327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:05.336369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:05.336377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:05.336385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:05.371290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:05.485323] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042205485318, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:10:05.492088] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042205492085, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:10:05.536620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:05.536663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:05.536671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:05.536680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:05.571505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:05.580032] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:05.581762] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:05.581791] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6642 [2024-09-11 16:10:05.737019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:05.737065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:05.737074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:05.737084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:05.771687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:05.779918] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6642, magic:0x78563412 [2024-09-11 16:10:05.779953] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:05.779960] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:05.937413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:05.937458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:05.937466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:05.937476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:05.971875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:06.137772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:06.137817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:06.137825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:06.137834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:06.172109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=91] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:06.180369] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:06.180414] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6654 [2024-09-11 16:10:06.285439] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:06.338059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:06.338100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:06.338107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:06.338116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:06.376662] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4365, replace_start_pos=6100000, replace_num=100000) [2024-09-11 16:10:06.376711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:06.379179] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6654, magic:0x78563412 [2024-09-11 16:10:06.379207] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=22] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:06.379215] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:06.492948] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042206492944, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:10:06.499709] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042206499705, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:10:06.538414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:06.538458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:06.538465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:06.538475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:06.576864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:06.581135] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:06.738782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:06.738827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:06.738835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:06.738845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:06.745704] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6846, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:10:06.777064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:06.781498] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:06.781532] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6670 [2024-09-11 16:10:06.946056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:06.946094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:06.946101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:06.946111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:06.977246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:06.978510] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6670, magic:0x78563412 [2024-09-11 16:10:06.978541] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=26] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:06.978551] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=9][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:07.146415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:07.146460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:07.146468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:07.146477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:07.177367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:07.285643] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:07.346770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:07.346812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:07.346820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:07.346830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:07.377581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:07.379416] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=23] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:07.379445] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6684 [2024-09-11 16:10:07.500559] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726042207500555, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:10:07.507258] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042207507254, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:10:07.547131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:07.547174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:07.547182] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:07.547192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:07.577090] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6684, magic:0x78563412 [2024-09-11 16:10:07.577132] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:07.577140] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:07.577713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:07.582342] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:07.747455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:07.747499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:07.747507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:07.747516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:07.777873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:07.947813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:07.947858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:07.947866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:07.947876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:07.978022] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:07.978312] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:07.978334] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=17] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6700 [2024-09-11 16:10:08.148119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:08.148166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:08.148175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:08.148185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:08.176559] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6700, magic:0x78563412 [2024-09-11 16:10:08.176613] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=49] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:08.176619] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:08.178153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:08.285826] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:08.348493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:08.348532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:08.348541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:08.348551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:08.378257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:08.508184] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042208508180, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:10:08.514935] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042208514932, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:10:08.548793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:08.548842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:08.548850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:08.548859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:08.577730] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:08.577774] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6712 [2024-09-11 16:10:08.582755] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4376, replace_start_pos=6200000, replace_num=100000) [2024-09-11 16:10:08.582787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:08.583596] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:08.749174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:08.749220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:08.749228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:08.749238] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:08.757779] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8510, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:10:08.775948] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6712, magic:0x78563412 [2024-09-11 16:10:08.775990] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:08.775996] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:08.782893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:08.958089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:08.958131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:08.958139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:08.958149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:08.983094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:09.158443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:09.158488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:09.158496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:09.158506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:09.178085] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=4] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:09.178129] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6714 [2024-09-11 16:10:09.183220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:09.286023] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:09.358799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:09.358852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:09.358867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:09.358877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:09.375545] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6714, magic:0x78563412 [2024-09-11 16:10:09.375589] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:09.375596] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:09.383434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:09.515738] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042209515734, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:10:09.522548] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042209522545, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:10:09.559197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:09.559241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:09.559249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:09.559260] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:09.583547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:09.584866] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:09.759559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:09.759596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:09.759605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:09.759615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:09.776950] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:09.776993] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6728 [2024-09-11 16:10:09.783667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:09.959929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:09.959974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:09.959982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:09.959992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:09.975665] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6728, magic:0x78563412 [2024-09-11 16:10:09.975700] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=30] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:09.975707] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:09.983777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:10.160308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:10.160354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:10.160363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:10.160373] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:10.183938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:10.286136] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:10.360616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:10.360677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:10.360688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:10.360697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:10.377974] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:10.378015] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6744 [2024-09-11 16:10:10.384107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:10.523352] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042210523348, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:10:10.530108] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042210530104, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:10:10.560970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:10.561008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:10.561014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:10.561021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:10.576217] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6744, magic:0x78563412 [2024-09-11 16:10:10.576257] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:10.576266] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:10.584206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:10.585995] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:10.761259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:10.761303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:10.761311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:10.761320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:10.769751] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8417, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:10:10.787699] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3396, replace_start_pos=6300000, replace_num=100000) [2024-09-11 16:10:10.787741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:10.970040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:10.970084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:10.970108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:10.970117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:10.978830] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:10.978875] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6758 [2024-09-11 16:10:10.987927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:11.170335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:11.170378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:11.170384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:11.170391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:11.176983] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6758, magic:0x78563412 [2024-09-11 16:10:11.177016] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:11.177023] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:11.188106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:11.286287] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:11.370695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:11.370738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:11.370746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:11.370756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:11.388245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:11.531028] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042211531024, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:10:11.537737] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042211537733, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:10:11.571081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:11.571129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:11.571137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:11.571147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:11.581093] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:11.581140] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=41] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6766 [2024-09-11 16:10:11.587088] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:11.588435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:11.771380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:11.771429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:11.771437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:11.771447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:11.777097] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6766, magic:0x78563412 [2024-09-11 16:10:11.777120] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=18] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:11.777126] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:11.788538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:11.830372] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:11.830425] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:11.830505] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=123, max_check_version=124, global_version=125) [2024-09-11 16:10:11.832567] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2061 [2024-09-11 16:10:11.832641] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=59] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:11.832679] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:10:11.832716] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:10:11.832798] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:11.832924] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:10:11.832979] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:10:11.832990] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:10:11.833001] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:10:11.833037] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:10:11.833105] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:10:11.833138] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:10:11.971757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:11.971803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:11.971811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:11.971821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:11.988658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:12.172123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:12.172188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:12.172200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:12.172210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:12.179738] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:12.179780] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6776 [2024-09-11 16:10:12.188787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:12.286412] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:12.372470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:12.372531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:12.372539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:12.372548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:12.377949] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6776, magic:0x78563412 [2024-09-11 16:10:12.377997] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:12.378003] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:12.388917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:12.538660] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042212538656, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:10:12.545346] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042212545342, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:10:12.572792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:12.572834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:12.572842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:12.572851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:12.588090] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:12.589048] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:12.773076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:12.773117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:12.773123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:12.773130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:12.779536] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:12.779573] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6790 [2024-09-11 16:10:12.779640] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6499, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:10:12.789229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:12.978235] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6790, magic:0x78563412 [2024-09-11 16:10:12.978275] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:12.978283] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:12.979884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:12.979933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:12.979942] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:12.979951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:12.993764] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4354, replace_start_pos=6400000, replace_num=100000) [2024-09-11 16:10:12.993812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:13.180248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:13.180291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:13.180299] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:13.180309] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:13.193961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:13.286607] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:13.380122] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:13.380165] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=38] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6802 [2024-09-11 16:10:13.380539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:13.380581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:13.380587] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:13.380596] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:13.394078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:13.546263] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042213546259, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:10:13.552979] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042213552977, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:10:13.578897] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6802, magic:0x78563412 [2024-09-11 16:10:13.578952] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=51] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:13.578960] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:13.580822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:13.580852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:13.580859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:13.580868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:13.589129] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:13.594247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:13.781098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:13.781143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:13.781151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:13.781160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:13.794412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:13.980968] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:13.981010] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=36] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6804 [2024-09-11 16:10:13.981404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:13.981442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:13.981449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:13.981457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:13.994609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:14.179249] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6804, magic:0x78563412 [2024-09-11 16:10:14.179289] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:14.179296] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:14.181690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:14.181718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:14.181725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:14.181734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:14.194752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:14.286723] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:14.382049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:14.382108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:14.382123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:14.382133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:14.394933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:14.553870] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042214553865, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:10:14.560556] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042214560554, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007577, add_bytes: 0 [2024-09-11 16:10:14.581218] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:14.581256] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6814 [2024-09-11 16:10:14.582372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:14.582397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:14.582403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:14.582412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:14.589930] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:14.595131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:14.779660] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6814, magic:0x78563412 [2024-09-11 16:10:14.779698] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:14.779704] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:14.782628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:14.782655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:14.782661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:14.782668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:14.789329] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6649, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:10:14.795226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:14.989582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:14.989619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:14.989627] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:14.989636] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:14.995401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:15.181298] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:15.181338] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:6818 [2024-09-11 16:10:15.189893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:15.189963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:15.189972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:15.189981] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:15.199858] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4340, replace_start_pos=6500000, replace_num=100000) [2024-09-11 16:10:15.199898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:15.286851] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:15.379952] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:6818, magic:0x78563412 [2024-09-11 16:10:15.379998] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:15.380005] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:15.390218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:15.390258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:15.390266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:15.390275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:15.400002] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:15.561509] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726042215561505, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 16:10:15.568185] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042215568181, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:10:15.590520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:15.590562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:15.590569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:15.590578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:15.590678] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:15.600235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=82] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:15.782130] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:15.782175] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44750 [2024-09-11 16:10:15.790809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:15.790848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:15.790855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:15.790864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:15.800356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:15.980602] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44750, magic:0x78563412 [2024-09-11 16:10:15.980642] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:15.980650] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:15.991097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:15.991135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:15.991142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:15.991151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:16.000477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:16.191443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:16.191486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:16.191494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:16.191504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:16.200629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:16.287018] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=94] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:16.383622] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:16.383666] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44766 [2024-09-11 16:10:16.391812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:16.391842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:16.391849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:16.391859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:16.400814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:16.569101] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042216569097, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:10:16.575803] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042216575799, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:10:16.581787] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44766, magic:0x78563412 [2024-09-11 16:10:16.581817] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=25] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:16.581825] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=8][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:16.591573] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:16.592079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:16.592104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:16.592110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:16.592119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:16.600935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:16.792357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:16.792399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:16.792407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:16.792416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:16.800941] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8513, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:10:16.801063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:16.983598] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:16.983643] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44778 [2024-09-11 16:10:17.001199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:17.001246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:17.001253] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:17.001252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:17.001262] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:17.181267] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44778, magic:0x78563412 [2024-09-11 16:10:17.181311] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:17.181319] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:17.201421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:17.201590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:17.201624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:17.201633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:17.201643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:17.287142] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:17.401976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:17.402020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:17.402028] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:17.402037] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:17.405726] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4053, replace_start_pos=6600000, replace_num=100000) [2024-09-11 16:10:17.405756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:17.576721] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042217576717, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:10:17.583381] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:17.583404] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042217583401, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:10:17.583425] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44780 [2024-09-11 16:10:17.592762] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:17.602334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:17.602375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:17.602384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:17.602394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:17.605837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:17.781569] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=14] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44780, magic:0x78563412 [2024-09-11 16:10:17.781609] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=34] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:17.781616] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:17.802626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:17.802665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:17.802673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:17.802682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:17.805944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:18.003014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:18.003057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:18.003065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:18.003075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:18.006052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:18.183848] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:18.183894] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44786 [2024-09-11 16:10:18.203384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:18.203429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:18.203437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:18.203447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:18.206156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:18.287256] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:18.382187] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=27] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44786, magic:0x78563412 [2024-09-11 16:10:18.382227] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:18.382234] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:18.403689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:18.403733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:18.403740] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:18.403749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:18.406261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:18.584263] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042218584260, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:10:18.591105] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042218591101, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 16:10:18.593835] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:18.604098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:18.604139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:18.604147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:18.604158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:18.606430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:18.783993] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:18.784037] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=40] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44800 [2024-09-11 16:10:18.804464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:18.804508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:18.804516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:18.804526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:18.806612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:18.813010] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8470, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:10:18.982367] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44800, magic:0x78563412 [2024-09-11 16:10:18.982401] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=29] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:18.982406] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:19.006751] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:19.013322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:19.013356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:19.013362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:19.013370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:19.206869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:19.213681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:19.213719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:19.213727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:19.213736] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:19.213974] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=70, refresh_score_time=64, wash_time=0) [2024-09-11 16:10:19.287474] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=85] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:19.384603] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:19.384658] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=50] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44810 [2024-09-11 16:10:19.407011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:19.414319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:19.414364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:19.414372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:19.414381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:19.582989] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=24] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44810, magic:0x78563412 [2024-09-11 16:10:19.583029] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=35] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:19.583036] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:19.591948] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042219591945, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:10:19.594959] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:19.598662] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042219598660, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:10:19.611147] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4015, replace_start_pos=6700000, replace_num=100000) [2024-09-11 16:10:19.611194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:19.614685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:19.614720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:19.614728] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:19.614738] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:19.811281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:19.815056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:19.815090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:19.815098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:19.815107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:19.984701] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:19.984752] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=46] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44816 [2024-09-11 16:10:20.011423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:20.015403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:20.015438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:20.015446] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:20.015456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:20.183253] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44816, magic:0x78563412 [2024-09-11 16:10:20.183290] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=32] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:20.183298] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:20.211544] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:20.215691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:20.215747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:20.215754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:20.215764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:20.287601] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:20.411720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:20.416011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:20.416042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:20.416066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:20.416074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:20.585606] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:20.585650] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44828 [2024-09-11 16:10:20.596136] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:20.599568] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042220599565, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:10:20.606255] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042220606251, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007591, add_bytes: 0 [2024-09-11 16:10:20.611842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:20.616309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:20.616343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:20.616350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:20.616359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:20.783749] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=6] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44828, magic:0x78563412 [2024-09-11 16:10:20.783791] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=37] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:20.783799] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:20.811945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:20.816606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:20.816647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:20.816655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:20.816663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:20.823989] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7313, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:10:21.012062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:21.024311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:21.024365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:21.024374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:21.024383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:21.185601] INFO ussl_eloop_regist (ussl_eloop.c:41) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=5] [ussl] sock regist: 0x7f5282e051e0 fd=94 [2024-09-11 16:10:21.185648] INFO ussl_on_accept (ussl_listenfd.c:39) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=42] [ussl] accept new connection, fd:94, src_addr:10.31.35.6:44840 [2024-09-11 16:10:21.212177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:21.224694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:21.224741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:21.224749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:21.224759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:21.287808] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:21.383949] INFO acceptfd_handle_first_readable_event (handle-event.c:378) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7] [ussl] recv non-negotiation message, the fd will be dispatched, fd:94, src_addr:10.31.35.6:44840, magic:0x78563412 [2024-09-11 16:10:21.383994] INFO dispatch_accept_fd_to_certain_group (group.c:691) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=39] PNIO dispatch fd to oblistener, fd:94 [2024-09-11 16:10:21.384002] WDIAG remove_from_epoll_and_dispatch (handle-event.c:287) [74252][ussl_loop][T0][Y0-0000000000000000-0-0] [lt=7][errcode=0] [ussl] dispatch fd to default group failed, fd:94, ret:0 [2024-09-11 16:10:21.412298] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:21.425075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:21.425118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:21.425127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:21.425137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:21.597008] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:21.607181] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042221607176, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:10:21.612415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:21.613894] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042221613891, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 16:10:21.625461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:21.625501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:21.625508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:21.625518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:21.816727] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4191, replace_start_pos=6800000, replace_num=100000) [2024-09-11 16:10:21.816773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:21.825764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:21.825802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:21.825810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:21.825819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:21.845651] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:21.845703] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:21.845788] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=124, max_check_version=125, global_version=126) [2024-09-11 16:10:21.847739] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1950 [2024-09-11 16:10:21.847786] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:21.847819] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:10:21.847855] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:10:21.847947] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:21.848048] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:10:21.848098] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:10:21.848109] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:10:21.848119] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:10:21.848157] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:10:21.848214] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:10:21.848233] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:10:22.016855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:22.026125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:22.026164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:22.026171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:22.026181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:22.217010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:22.226393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:22.226437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:22.226444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:22.226466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:22.287992] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:22.417212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:22.426740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:22.426780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:22.426787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:22.426796] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:22.597866] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:22.614795] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042222614792, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:10:22.617330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:22.621491] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=69] PNIO [ratelimit] time: 1726042222621488, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:10:22.627088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:22.627127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:22.627153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:22.627162] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:22.817431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:22.827396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:22.827428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:22.827435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:22.827443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:22.836002] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8546, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:10:23.017560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:23.036320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:23.036364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:23.036373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:23.036383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:23.217727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=94] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:23.236714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:23.236752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:23.236760] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:23.236787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:23.288191] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:23.417854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:23.437090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:23.437131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:23.437142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:23.437152] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:23.598991] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:23.617973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:23.622344] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042223622341, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:10:23.629175] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042223629172, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:10:23.637458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:23.637499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:23.637506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:23.637514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:23.818101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:23.837751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:23.837797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:23.837805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:23.837814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:24.022431] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4144, replace_start_pos=6900000, replace_num=100000) [2024-09-11 16:10:24.022477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:24.038107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:24.038148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:24.038156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:24.038165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:24.222662] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:24.238398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:24.238435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:24.238442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:24.238451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:24.288314] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:24.422849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:24.438698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:24.438737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:24.438745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:24.438754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:24.599733] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:24.623066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=79] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:24.629959] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042224629956, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:10:24.636726] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042224636724, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:10:24.639065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:24.639098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:24.639106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:24.639115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:24.823179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:24.839386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:24.839424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:24.839431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:24.839438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:24.845964] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6514, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:10:25.023364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:25.046229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:25.046270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:25.046278] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:25.046287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:25.223579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:25.246596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:25.246642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:25.246649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:25.246658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:25.288461] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:25.423779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:25.446976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:25.447019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:25.447026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:25.447035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:25.600498] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:25.623937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:25.637596] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042225637592, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:10:25.644462] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042225644459, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007735, add_bytes: 0 [2024-09-11 16:10:25.647336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:25.647366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:25.647374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:25.647383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:25.824049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:25.847698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:25.847740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:25.847748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:25.847757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:26.024264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:26.048077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:26.048123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:26.048131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:26.048141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:26.228822] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4415, replace_start_pos=7000000, replace_num=100000) [2024-09-11 16:10:26.228869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:26.248480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:26.248525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:26.248533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:26.248543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:26.288624] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:26.428981] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:26.448836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:26.448881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:26.448889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:26.448899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:26.601255] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:26.629103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:26.645256] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042226645252, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007660, add_bytes: 0 [2024-09-11 16:10:26.649217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:26.649251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:26.649259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:26.649269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:26.652019] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042226652016, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:10:26.829228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:26.849511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:26.849554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:26.849578] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:26.849587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:26.856881] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7280, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:10:27.029355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:27.057218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:27.057262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:27.057270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:27.057279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:27.057472] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:10:27.229487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:27.257788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:27.257833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:27.257841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:27.257851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:27.288774] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:27.429616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:27.458112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:27.458173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:27.458181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:27.458190] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:27.602122] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:27.629736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:27.652873] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042227652869, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:10:27.658436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:27.658475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:27.658482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:27.658491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:27.659577] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042227659575, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:10:27.829872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:27.858729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:27.858773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:27.858781] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:27.858790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:28.030102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:28.059095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:28.059140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:28.059148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:28.059164] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:28.230248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:28.259471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:28.259516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:28.259525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:28.259534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:28.288971] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:28.433737] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3341, replace_start_pos=7100000, replace_num=100000) [2024-09-11 16:10:28.433783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:28.459842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:28.459888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:28.459896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:28.459929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:28.603084] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:28.633868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:28.660236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:28.660284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:28.660292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:28.660302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:28.660425] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=69] PNIO [ratelimit] time: 1726042228660421, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:10:28.667193] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042228667190, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:10:28.834002] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:28.860603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:28.860649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:28.860657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:28.860685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:28.868144] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7444, clean_start_pos=0, clean_num=200000) [2024-09-11 16:10:29.034129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:29.068462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:29.068504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:29.068512] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:29.068520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:29.234251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:29.268754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:29.268796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:29.268804] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:29.268814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:29.289168] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:29.434371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:29.469054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:29.469104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:29.469126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:29.469135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:29.604371] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:29.634480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:29.668049] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042229668044, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:10:29.669438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:29.669480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:29.669488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:29.669497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:29.674817] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042229674814, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:10:29.834610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:29.869798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:29.869835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:29.869842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:29.869852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:30.034793] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:30.070081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:30.070120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:30.070127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:30.070136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:30.234925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:30.270379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:30.270425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:30.270433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:30.270465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:30.289361] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:30.435067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:30.470767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:30.470812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:30.470819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:30.470829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:30.605254] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:30.639472] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4282, replace_start_pos=7200000, replace_num=100000) [2024-09-11 16:10:30.639511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:30.671151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:30.671190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:30.671197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:30.671207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:30.675746] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042230675743, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007699, add_bytes: 0 [2024-09-11 16:10:30.682423] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042230682420, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:10:30.839608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:30.871435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:30.871481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:30.871490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:30.871498] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:30.878917] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7404, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:10:31.039730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:31.079253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:31.079300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:31.079307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:31.079316] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:31.239926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:31.279549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:31.279595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:31.279602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:31.279612] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:31.289571] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=82] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:31.440119] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:31.479846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:31.479888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:31.479894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:31.479925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:31.606083] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:31.640257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:31.680145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:31.680182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:31.680189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:31.680199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:31.683274] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042231683271, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007528, add_bytes: 0 [2024-09-11 16:10:31.690102] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042231690099, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:10:31.840389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:31.861733] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:31.861786] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:31.861867] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=125, max_check_version=126, global_version=127) [2024-09-11 16:10:31.863876] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2008 [2024-09-11 16:10:31.863923] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:31.863955] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:10:31.863988] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:10:31.864085] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:31.864168] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:10:31.864212] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:10:31.864221] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:10:31.864232] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:10:31.864263] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:10:31.864311] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:10:31.864328] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:10:31.880417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:31.880457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:31.880465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:31.880474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:32.040504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:32.080775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:32.080819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:32.080846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:32.080857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:32.240629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:32.281149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:32.281189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:32.281197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:32.281206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:32.289740] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:32.440744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:32.481442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:32.481478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:32.481486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:32.481495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:32.607024] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:32.640861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:32.681783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:32.681822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:32.681830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:32.681839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:32.690928] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726042232690924, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007653, add_bytes: 0 [2024-09-11 16:10:32.697646] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042232697642, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:10:32.845147] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4156, replace_start_pos=7300000, replace_num=100000) [2024-09-11 16:10:32.845202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:32.882083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:32.882134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:32.882142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:32.882151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:32.889219] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7055, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:10:33.045357] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:33.089458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:33.089497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:33.089504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:33.089512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:33.245478] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:33.289762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:33.289805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:33.289813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:33.289822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:33.289931] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:33.445593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:33.490065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:33.490109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:33.490117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:33.490126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:33.608030] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:33.645737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:33.690356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:33.690399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:33.690407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:33.690423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:33.698521] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042233698518, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:10:33.705265] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042233705261, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:10:33.845865] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:33.890655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:33.890698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:33.890706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:33.890715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:34.046003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:34.091044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:34.091088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:34.091095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:34.091104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:34.246123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:34.290121] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:34.291360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:34.291391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:34.291399] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:34.291408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:34.446243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:34.491636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:34.491678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:34.491715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:34.491725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:34.609053] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:34.646363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:34.692070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:34.692115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:34.692123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:34.692132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:34.706120] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042234706116, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:10:34.712887] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042234712885, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:10:34.846486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:34.892425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:34.892467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:34.892475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:34.892502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:34.901120] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8604, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:10:35.050998] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4390, replace_start_pos=7400000, replace_num=100000) [2024-09-11 16:10:35.051041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:35.101449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:35.101494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:35.101502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:35.101512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:35.251129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:35.290337] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:35.301814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:35.301858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:35.301866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:35.301876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:35.451240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:35.502129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:35.502174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:35.502199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:35.502208] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:35.610309] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:35.651354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:35.702427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:35.702472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:35.702478] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:35.702486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:35.713738] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042235713733, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:10:35.720502] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042235720499, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:10:35.851476] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:35.902802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:35.902837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:35.902845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:35.902854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:36.051589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:36.103102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:36.103141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:36.103149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:36.103157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:36.251723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:36.290498] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:36.303404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:36.303467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:36.303475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:36.303484] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:36.451854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:36.503717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:36.503759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:36.503765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:36.503773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:36.611467] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:36.651999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:36.704041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:36.704084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:36.704091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:36.704100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:36.721353] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042236721349, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:10:36.728122] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042236728118, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:10:36.852140] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:36.904334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:36.904375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:36.904382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:36.904391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:36.912946] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8542, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:10:37.052277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:37.113228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:37.113273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:37.113280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:37.113290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:37.256113] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3644, replace_start_pos=7500000, replace_num=100000) [2024-09-11 16:10:37.256157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:37.290692] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:37.313545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:37.313588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:37.313595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:37.313604] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:37.456312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:37.513841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:37.513885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:37.513892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:37.513918] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:37.612355] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:37.656433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:37.714154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:37.714190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:37.714196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:37.714204] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:37.728964] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042237728961, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:10:37.735734] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042237735731, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:10:37.856556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:37.914535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:37.914576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:37.914585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:37.914595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:38.056680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:38.114951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:38.114995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:38.115003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:38.115013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:38.256794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:38.290869] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:38.315260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:38.315303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:38.315311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:38.315337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:38.456927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:38.515583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:38.515628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:38.515635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:38.515644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:38.613278] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:38.657056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:38.715890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:38.715965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:38.715972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:38.715982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:38.736655] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042238736651, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:10:38.743341] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042238743338, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:10:38.857180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:38.916223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:38.916261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:38.916268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:38.916278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:38.924828] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8537, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:10:39.057316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:39.125075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:39.125130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:39.125138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:39.125147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:39.257446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:39.291090] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:39.325375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:39.325417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:39.325425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:39.325434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:39.461920] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4359, replace_start_pos=7600000, replace_num=100000) [2024-09-11 16:10:39.461966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:39.525662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:39.525715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:39.525723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:39.525732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:39.525973] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=86, refresh_score_time=62, wash_time=0) [2024-09-11 16:10:39.614305] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:39.662060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:39.727732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=1537][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:39.727771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:39.727779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:39.727788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:39.744195] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042239744192, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:10:39.751085] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042239751081, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007743, add_bytes: 0 [2024-09-11 16:10:39.862213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:39.928096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:39.928140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:39.928148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:39.928157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:40.062338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:40.128454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:40.128493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:40.128501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:40.128510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:40.262457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:40.291269] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:40.328756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:40.328802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:40.328809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:40.328819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:40.462588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:40.529059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:40.529102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:40.529110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:40.529119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:40.615667] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:40.662794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:40.729420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:40.729466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:40.729489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:40.729503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:40.751830] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726042240751825, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:10:40.758586] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042240758583, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007502, add_bytes: 0 [2024-09-11 16:10:40.862924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:40.929811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:40.929859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:40.929867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:40.929877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:40.937089] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7198, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:10:41.063061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:41.137415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:41.137461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:41.137470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:41.137498] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:41.263188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:41.291484] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:41.337803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:41.337847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:41.337855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:41.337865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:41.463318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:41.538165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:41.538211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:41.538219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:41.538228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:41.616573] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:41.667823] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4360, replace_start_pos=7700000, replace_num=100000) [2024-09-11 16:10:41.667871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:41.738469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:41.738514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:41.738521] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:41.738530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:41.759430] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042241759426, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:10:41.766202] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042241766198, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:10:41.867961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:41.878685] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:41.878721] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:41.878802] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=126, max_check_version=127, global_version=128) [2024-09-11 16:10:41.880847] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2043 [2024-09-11 16:10:41.880885] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:41.880936] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:10:41.880975] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:10:41.881057] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:41.881182] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:10:41.881233] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:10:41.881244] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:10:41.881255] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:10:41.881296] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:10:41.881359] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:10:41.881381] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:10:41.938848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:41.938893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:41.938924] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:41.938935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:42.068113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:42.139180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:42.139228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:42.139235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:42.139245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:42.268231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:42.291616] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:42.339597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:42.339641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:42.339649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:42.339659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:42.468352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:42.539985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:42.540031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:42.540039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:42.540048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:42.617955] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:42.668472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:42.740296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:42.740342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:42.740351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:42.740360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:42.767133] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042242767130, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007704, add_bytes: 0 [2024-09-11 16:10:42.773819] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042242773815, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:10:42.868593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:42.940663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:42.940709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:42.940717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:42.940743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:42.948358] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7600, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:10:43.068726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:43.148679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:43.148726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:43.148734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:43.148743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:43.268924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:43.291820] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:43.349066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:43.349107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:43.349115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:43.349123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:43.469051] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:43.549356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:43.549399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:43.549407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:43.549416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:43.619317] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:43.669180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:43.749669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:43.749714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:43.749738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:43.749748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:43.774750] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042243774747, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:10:43.781444] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042243781441, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:10:43.873376] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4075, replace_start_pos=7800000, replace_num=100000) [2024-09-11 16:10:43.873419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:43.950004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:43.950042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:43.950050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:43.950060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:44.073509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:44.150289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:44.150336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:44.150345] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:44.150354] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:44.273620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:44.291927] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:44.350583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:44.350649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:44.350657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:44.350665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:44.473737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:44.550976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:44.551031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:44.551046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:44.551055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:44.620485] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:44.673856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:44.751299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:44.751343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:44.751350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:44.751359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:44.782300] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042244782296, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:10:44.789050] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042244789047, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:10:44.873973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:44.951590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:44.951635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:44.951643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:44.951652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:44.958803] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7138, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:10:45.074101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:45.159141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:45.159189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:45.159197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:45.159206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:45.274304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:45.292051] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:45.359432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:45.359476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:45.359483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:45.359493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:45.474515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:45.559794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:45.559839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:45.559847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:45.559857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:45.621641] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:45.674647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:45.760106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:45.760150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:45.760157] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:45.760167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:45.789927] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042245789923, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:10:45.796655] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042245796652, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:10:45.874766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:45.960474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:45.960519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:45.960527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:45.960537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:46.078935] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4045, replace_start_pos=7900000, replace_num=100000) [2024-09-11 16:10:46.078982] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:46.160773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:46.160813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:46.160821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:46.160830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:46.279063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:46.292188] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:46.361044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:46.361078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:46.361084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:46.361092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:46.479185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:46.561330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:46.561373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:46.561381] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:46.561390] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:46.622747] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:46.679319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:46.761622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:46.761662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:46.761669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:46.761678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:46.797588] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=75] PNIO [ratelimit] time: 1726042246797584, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 16:10:46.804349] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042246804345, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:10:46.879441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:46.961922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:46.961960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:46.961968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:46.961978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:46.969601] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7611, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:10:47.079562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:47.169854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:47.169898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:47.169949] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:47.169958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:47.279686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:47.292356] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:47.370264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:47.370308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:47.370316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:47.370326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:47.479811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:47.570567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:47.570617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:47.570625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:47.570634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:47.624122] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:47.679943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:47.770867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:47.770941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:47.770951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:47.770960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:47.805191] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042247805187, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:10:47.811957] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042247811954, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:10:47.880137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:47.971175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:47.971219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:47.971226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:47.971233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:48.080282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:48.171461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:48.171497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:48.171503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:48.171512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:48.284079] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3681, replace_start_pos=8000000, replace_num=100000) [2024-09-11 16:10:48.284120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:48.292470] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:48.371813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:48.371859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:48.371866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:48.371875] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:48.484202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:48.572169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:48.572234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:48.572244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:48.572254] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:48.625431] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:48.684318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:48.772482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:48.772519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:48.772526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:48.772534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:48.812819] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042248812815, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:10:48.819577] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042248819575, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:10:48.884449] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:48.972830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:48.972870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:48.972878] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:48.972888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:48.980085] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7184, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:10:49.084577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:49.180405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:49.180452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:49.180460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:49.180469] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:49.284684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:49.292657] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:49.380782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:49.380825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:49.380832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:49.380840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:49.484802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:49.581135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:49.581193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:49.581209] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:49.581219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:49.626851] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:49.684920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:49.781453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:49.781486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:49.781493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:49.781502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:49.820459] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042249820456, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2024-09-11 16:10:49.827123] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042249827119, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:10:49.885045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:49.981821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:49.981861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:49.981869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:49.981892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:50.085158] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:50.182152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:50.182198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:50.182207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:50.182217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:50.285271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:50.292920] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:50.382506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:50.382545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:50.382552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:50.382560] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:50.489139] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3691, replace_start_pos=8100000, replace_num=100000) [2024-09-11 16:10:50.489187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:50.582786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:50.582829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:50.582837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:50.582862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:50.627993] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:50.689281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:50.783089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:50.783134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:50.783156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:50.783163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:50.827984] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042250827979, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007523, add_bytes: 0 [2024-09-11 16:10:50.834815] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042250834811, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:10:50.889408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:50.983463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:50.983507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:50.983516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:50.983525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:50.990380] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6842, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:10:51.089595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:51.190725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:51.190772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:51.190780] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:51.190789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:51.289729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:51.293060] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:51.391093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:51.391153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:51.391161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:51.391171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:51.489873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:51.591481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:51.591526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:51.591534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:51.591543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:51.628726] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:51.690096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:51.791837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:51.791884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:51.791892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:51.791922] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:51.835606] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042251835602, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:10:51.842351] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042251842349, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007538, add_bytes: 0 [2024-09-11 16:10:51.890232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:51.895728] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:51.895777] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:10:51.895876] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=127, max_check_version=128, global_version=129) [2024-09-11 16:10:51.898064] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2187 [2024-09-11 16:10:51.898132] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:51.898169] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:10:51.898208] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:10:51.898295] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:10:51.898438] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:10:51.898496] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:10:51.898509] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:10:51.898522] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:10:51.898559] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:10:51.898639] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:10:51.898661] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:10:51.992183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:51.992226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:51.992234] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:51.992243] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:52.090359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:52.192546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:52.192593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:52.192601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:52.192609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:52.290563] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:52.293159] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=30] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:52.392950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:52.392992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:52.392999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:52.393026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:52.490752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:52.593251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:52.593321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:52.593329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:52.593338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:52.629559] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:52.695204] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=8200000, replace_num=100000) [2024-09-11 16:10:52.695255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:52.793581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:52.793625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:52.793632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:52.793641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:52.843216] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042252843213, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:10:52.850049] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042252850046, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 16:10:52.895410] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:52.993875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:52.993939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:52.993948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:52.993958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:53.001017] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7046, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:10:53.095530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:53.201279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:53.201325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:53.201333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:53.201343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:53.293282] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:53.295734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:53.401573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:53.401618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:53.401626] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:53.401636] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:53.495844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:53.602017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:53.602065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:53.602074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:53.602084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:53.630594] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:53.695961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:53.802322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:53.802367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:53.802376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:53.802386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:53.850824] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042253850819, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:10:53.857660] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042253857656, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:10:53.896156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:54.002630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:54.002676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:54.002684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:54.002694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:54.096282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:54.203057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:54.203104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:54.203111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:54.203121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:54.293400] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:54.296398] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:54.403367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:54.403410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:54.403418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:54.403428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:54.496505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:54.603736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:54.603793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:54.603809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:54.603819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:54.632026] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:54.696638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:54.804077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:54.804117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:54.804125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:54.804134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:54.858455] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042254858450, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:10:54.865280] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1726042254865276, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:10:54.900747] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3992, replace_start_pos=8300000, replace_num=100000) [2024-09-11 16:10:54.900790] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:55.004361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:55.004398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:55.004405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:55.004414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:55.012504] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8059, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:10:55.100874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:55.212757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:55.212801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:55.212808] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:55.212836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:55.293539] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:55.301018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:55.413071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:55.413115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:55.413122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:55.413132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:55.501132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:55.613457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:55.613501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:55.613509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:55.613519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:55.633226] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:55.701250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:55.813813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:55.813852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:55.813860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:55.813869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:55.866064] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042255866060, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:10:55.872835] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042255872831, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:10:55.901361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:56.014170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:56.014234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:56.014242] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:56.014252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:56.101480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:56.214549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:56.214593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:56.214601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:56.214610] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:56.293695] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:56.301615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:56.414839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:56.414881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:56.414889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:56.414898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:56.501732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:56.615229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:56.615267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:56.615276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:56.615303] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:56.634416] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:56.701855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:56.815662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:56.815706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:56.815730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:56.815739] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:56.873741] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042256873737, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:10:56.880447] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042256880445, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:10:56.901990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:57.016002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:57.016046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:57.016053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:57.016062] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:57.023934] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7858, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:10:57.105500] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3385, replace_start_pos=8400000, replace_num=100000) [2024-09-11 16:10:57.105540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:57.224284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:57.224332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:57.224341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:57.224352] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:57.224549] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:10:57.293846] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:57.305618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:57.424872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:57.424934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:57.424943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:57.424952] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:57.505741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:57.625197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:57.625232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:57.625239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:57.625248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:57.635699] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:57.705871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:10:57.825487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:57.825531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:57.825539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:57.825548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:57.881289] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042257881285, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:10:57.888122] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042257888119, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:10:57.906060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:10:58.025851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:58.025899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:58.025936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:58.025966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:58.106253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:10:58.226292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:58.226336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:58.226345] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:58.226355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:58.294031] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:58.306458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:10:58.426578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:58.426611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:58.426618] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:58.426626] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:58.506594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:10:58.626945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:58.626987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:58.626995] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:58.627004] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:58.636937] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:58.706729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:10:58.827317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:58.827363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:58.827372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:58.827399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:58.888969] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042258888965, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:10:58.895673] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042258895669, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:10:58.906857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:10:59.027698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:59.027744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:59.027752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:59.027762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:59.034970] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7194, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:10:59.106974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:10:59.235321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:59.235368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:59.235376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:59.235386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:59.294165] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:10:59.311521] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4417, replace_start_pos=8500000, replace_num=100000) [2024-09-11 16:10:59.311572] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:10:59.435626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:59.435671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:59.435679] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:59.435688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:59.511686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:10:59.635935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:59.635990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:59.636003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:59.636011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:59.638038] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:10:59.711814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:10:59.836250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:10:59.836292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:10:59.836298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:10:59.836305] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:10:59.836481] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=68, refresh_score_time=57, wash_time=0) [2024-09-11 16:10:59.896521] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042259896517, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:10:59.903286] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042259903282, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:10:59.911958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:00.036702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:00.036748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:00.036753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:00.036761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:00.112158] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:00.237044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:00.237088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:00.237096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:00.237105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:00.294284] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:00.312300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:00.437435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:00.437480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:00.437488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:00.437497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:00.512429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:00.637807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:00.637853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:00.637861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:00.637870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:00.638910] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:00.712603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:00.838109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:00.838153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:00.838160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:00.838169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:00.898193] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:11:00.904156] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042260904152, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:11:00.904197] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:11:00.908575] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:11:00.910923] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042260910920, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 16:11:00.910957] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:11:00.912724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:01.038478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:01.038522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:01.038530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:01.038540] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:01.045655] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7103, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:11:01.112832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:01.245899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:01.245966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:01.245975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:01.245984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:01.294499] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:01.312963] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:01.446312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:01.446355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:01.446364] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:01.446374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:01.517418] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=8600000, replace_num=100000) [2024-09-11 16:11:01.517459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:01.639844] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:01.646696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:01.646727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:01.646735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:01.646745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:01.717556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:01.847071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:01.847116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:01.847124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:01.847133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:01.911801] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042261911797, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007645, add_bytes: 0 [2024-09-11 16:11:01.912768] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:01.912808] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:01.912886] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=128, max_check_version=129, global_version=130) [2024-09-11 16:11:01.914880] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1993 [2024-09-11 16:11:01.914948] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:01.914984] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:11:01.915022] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:11:01.915105] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:01.915213] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:11:01.915267] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:11:01.915279] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:11:01.915290] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:11:01.915327] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:11:01.915391] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:11:01.915409] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:11:01.917705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:01.918535] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042261918534, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:11:02.047434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:02.047479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:02.047487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:02.047496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:02.117823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:02.247794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:02.247838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:02.247846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:02.247856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:02.294698] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:02.317964] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:02.448086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:02.448146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:02.448154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:02.448163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:02.518150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:02.640849] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=93] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:02.648385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:02.648414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:02.648420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:02.648428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:02.718341] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:02.848665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:02.848701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:02.848708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:02.848717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:02.918456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:02.919369] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042262919365, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 16:11:02.926133] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042262926130, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:11:03.048966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:03.049011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:03.049019] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:03.049027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:03.056599] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7559, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:11:03.118576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:03.256860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:03.256922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:03.256931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:03.256941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:03.294833] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:03.318765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:03.457165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:03.457201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:03.457207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:03.457215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:03.518941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:03.641956] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:03.657436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:03.657470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:03.657476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:03.657484] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:03.723419] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4344, replace_start_pos=8700000, replace_num=100000) [2024-09-11 16:11:03.723474] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:03.857779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:03.857823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:03.857832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:03.857841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:03.923558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:03.927048] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042263927045, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:11:03.933751] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042263933749, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:11:04.058155] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:04.058199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:04.058207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:04.058217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:04.123677] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:04.258519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:04.258562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:04.258571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:04.258581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:04.295030] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=16] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:04.323792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:04.458810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:04.458854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:04.458861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:04.458885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:04.523916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:04.643038] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:04.659152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:04.659199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:04.659220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:04.659230] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:04.724037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:04.859530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:04.859575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:04.859583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:04.859593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:04.924155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:04.934615] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042264934612, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:11:04.941371] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042264941368, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:11:05.059949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:05.059996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:05.060004] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:05.060013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:05.068043] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8016, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:11:05.124325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:05.268387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:05.268433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:05.268464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:05.268474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:05.295216] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:05.324448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:05.468776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:05.468820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:05.468828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:05.468837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:05.524613] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:05.643971] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:05.669142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:05.669187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:05.669195] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:05.669205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:05.724728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:05.869508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:05.869555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:05.869563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:05.869572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:05.929189] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4335, replace_start_pos=8800000, replace_num=100000) [2024-09-11 16:11:05.929236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:05.942220] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042265942216, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:11:05.948992] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042265948988, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:11:06.069881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:06.069952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:06.069961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:06.069971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:06.129327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:06.270221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:06.270267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:06.270276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:06.270285] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:06.295436] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:06.329496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:06.470600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:06.470647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:06.470655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:06.470665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:06.529621] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:06.644942] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:06.670991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:06.671037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:06.671045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:06.671055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:06.729780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:06.871377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:06.871423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:06.871431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:06.871441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:06.929924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:06.949874] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042266949870, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007654, add_bytes: 0 [2024-09-11 16:11:06.956666] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042266956663, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:11:07.071672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:07.071709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:07.071716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:07.071725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:07.078934] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7197, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:11:07.130096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:07.279187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:07.279222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:07.279230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:07.279239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:07.295635] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:07.330228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:07.479489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:07.479531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:07.479539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:07.479549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:07.530369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:07.645914] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:07.679847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:07.679892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:07.679921] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:07.679933] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:07.730496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:07.880168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:07.880213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:07.880220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:07.880229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:07.930620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:07.957557] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=93] PNIO [ratelimit] time: 1726042267957554, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:11:07.964228] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042267964225, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:11:08.080457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:08.080492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:08.080499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:08.080521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:08.134096] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3342, replace_start_pos=8900000, replace_num=100000) [2024-09-11 16:11:08.134137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:08.280752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:08.280795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:08.280801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:08.280810] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:08.295749] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:08.334287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:08.481062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:08.481101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:08.481108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:08.481117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:08.534460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:08.647004] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:08.681354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:08.681401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:08.681410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:08.681421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:08.734591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:08.881648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:08.881687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:08.881713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:08.881723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:08.934704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:08.965133] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042268965128, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 16:11:08.971846] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042268971842, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:11:09.081968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:09.082006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:09.082013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:09.082022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:09.089911] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7876, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:11:09.134823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:09.290158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:09.290192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:09.290198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:09.290206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:09.295848] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:09.334949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:09.490437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:09.490478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:09.490486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:09.490494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:09.535093] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:09.648098] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:09.690747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:09.690805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:09.690813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:09.690822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:09.735234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:09.891118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:09.891161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:09.891169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:09.891179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:09.935373] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:09.972767] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042269972763, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:11:09.979437] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042269979434, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:11:10.091481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:10.091526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:10.091535] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:10.091545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:10.135511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:10.291775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:10.291818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:10.291826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:10.291835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:10.295940] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=27] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:10.340094] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4392, replace_start_pos=9000000, replace_num=100000) [2024-09-11 16:11:10.340139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:10.492130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:10.492175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:10.492183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:10.492193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:10.540239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:10.649620] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:10.692441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:10.692484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:10.692492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:10.692501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:10.740370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:10.892801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:10.892845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:10.892853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:10.892864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:10.940576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:10.980293] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042270980290, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007527, add_bytes: 0 [2024-09-11 16:11:10.987063] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042270987060, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:11:11.093204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:11.093248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:11.093256] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:11.093266] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:11.100504] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7224, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:11:11.140764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:11.296137] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:11.300770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:11.300808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:11.300816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:11.300825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:11.340890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:11.501069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:11.501110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:11.501118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:11.501142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:11.541085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:11.650532] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:11.701385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:11.701429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:11.701453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:11.701463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:11.741219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:11.901796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:11.901841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:11.901849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:11.901858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:11.929542] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:11.929593] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:11.929673] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=129, max_check_version=130, global_version=131) [2024-09-11 16:11:11.931667] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1993 [2024-09-11 16:11:11.931706] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:11.931741] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:11:11.931800] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:11:11.931882] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:11.932003] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:11:11.932058] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:11:11.932073] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:11:11.932085] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:11:11.932121] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:11:11.932181] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:11:11.932203] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:11:11.941351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:11.987932] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042271987928, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 16:11:11.994672] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042271994668, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:11:12.102111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:12.102151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:12.102158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:12.102168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:12.141529] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:12.296327] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:12.302419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:12.302456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:12.302463] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:12.302472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:12.341709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:12.502781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:12.502825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:12.502833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:12.502843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:12.546042] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4213, replace_start_pos=9100000, replace_num=100000) [2024-09-11 16:11:12.546106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:12.651535] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:12.703145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:12.703192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:12.703200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:12.703227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:12.746263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:12.903464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:12.903509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:12.903517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:12.903525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:12.946394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:12.995625] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726042272995621, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:11:13.002405] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042273002402, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007734, add_bytes: 0 [2024-09-11 16:11:13.103771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:13.103819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:13.103826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:13.103835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:13.111124] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7276, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:11:13.146576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:13.296524] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:13.311469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:13.311511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:13.311538] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:13.311548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:13.346690] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:13.511855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:13.511923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:13.511934] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:13.511944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:13.546804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:13.652595] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:13.712188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:13.712235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:13.712243] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:13.712252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:13.746931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:13.912503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:13.912544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:13.912552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:13.912561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:13.947049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:14.003157] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042274003153, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007532, add_bytes: 0 [2024-09-11 16:11:14.009922] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042274009918, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007516, add_bytes: 0 [2024-09-11 16:11:14.112801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:14.112867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:14.112875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:14.112885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:14.147165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:14.296706] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:14.313127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:14.313170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:14.313178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:14.313186] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:14.347277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:14.513423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:14.513469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:14.513478] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:14.513496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:14.547395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:14.653699] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:14.713729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:14.713766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:14.713772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:14.713781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:14.750820] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3298, replace_start_pos=9200000, replace_num=100000) [2024-09-11 16:11:14.750874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:14.914086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:14.914130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:14.914137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:14.914147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:14.951055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:15.010783] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042275010778, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:11:15.017603] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042275017601, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:11:15.114440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:15.114483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:15.114491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:15.114500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:15.122366] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7852, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:11:15.151235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:15.296847] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:15.322620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:15.322662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:15.322670] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:15.322679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:15.351411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:15.522934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:15.522970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:15.522976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:15.522984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:15.551583] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:15.654681] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:15.723286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:15.723329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:15.723337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:15.723346] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:15.751759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:15.923646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:15.923688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:15.923696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:15.923706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:15.951890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:16.018448] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042276018444, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:11:16.025147] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042276025143, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:11:16.123955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:16.123999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:16.124007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:16.124016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:16.152094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:16.297009] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=90] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:16.324259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:16.324297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:16.324304] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:16.324313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:16.352209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:16.524610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:16.524656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:16.524664] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:16.524674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:16.552324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:16.655596] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:16.724980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:16.725024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:16.725031] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:16.725040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:16.752441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:16.925336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:16.925381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:16.925389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:16.925398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:16.955866] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3310, replace_start_pos=9300000, replace_num=100000) [2024-09-11 16:11:16.955911] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:17.025987] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042277025984, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007540, add_bytes: 0 [2024-09-11 16:11:17.032834] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042277032831, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:11:17.125640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:17.125677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:17.125684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:17.125693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:17.133229] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7523, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:11:17.155993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:17.297150] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:17.333540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:17.333583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:17.333591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:17.333601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:17.356114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:17.533966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:17.534012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:17.534036] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:17.534045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:17.556232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:17.656610] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:17.734343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:17.734388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:17.734396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:17.734406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:17.756346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:17.934649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:17.934693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:17.934700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:17.934709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:17.956462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:18.033609] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042278033605, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:11:18.040442] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042278040438, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:11:18.135051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:18.135096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:18.135104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:18.135113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:18.156576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:18.297385] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:18.335404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:18.335443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:18.335451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:18.335461] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:18.356692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:18.535757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:18.535801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:18.535809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:18.535819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:18.556804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:18.657654] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:18.736051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:18.736093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:18.736101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:18.736109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:18.756922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:18.936400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:18.936438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:18.936447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:18.936456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:18.957040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:19.041237] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042279041233, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:11:19.048073] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042279048070, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:11:19.136752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:19.136797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:19.136805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:19.136815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:19.144380] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7552, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:11:19.160824] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3675, replace_start_pos=9400000, replace_num=100000) [2024-09-11 16:11:19.160868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:19.297547] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:19.344649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:19.344688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:19.344695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:19.344704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:19.360949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:19.544954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:19.545006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:19.545014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:19.545024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:19.561060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:19.658692] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:19.745269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:19.745310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:19.745318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:19.745344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:19.761169] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:19.945617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:19.945662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:19.945670] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:19.945680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:19.961307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:20.048865] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042280048861, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:11:20.055666] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042280055662, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:11:20.145974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:20.146013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:20.146021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:20.146030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:20.146240] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=72, refresh_score_time=61, wash_time=0) [2024-09-11 16:11:20.161424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:20.297679] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:20.346461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:20.346504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:20.346535] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:20.346545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:20.361613] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:20.546847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:20.546891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:20.546899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:20.546935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:20.561718] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:20.659524] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:20.747158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:20.747202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:20.747208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:20.747215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:20.761834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:20.947541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:20.947581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:20.947589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:20.947598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:20.961941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:21.056463] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726042281056458, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:11:21.063217] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042281063213, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:11:21.147830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:21.147886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:21.147894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:21.147924] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:21.156016] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8078, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:11:21.162053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:21.297897] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:21.356331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:21.356374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:21.356382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:21.356391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:21.366514] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4346, replace_start_pos=9500000, replace_num=100000) [2024-09-11 16:11:21.366557] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:21.556625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:21.556670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:21.556677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:21.556686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:21.566636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:21.660459] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:21.756951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:21.756996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:21.757004] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:21.757013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:21.766779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:21.947067] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:21.947120] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:21.947207] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] update_check_range(min_check_version=130, max_check_version=131, global_version=132) [2024-09-11 16:11:21.949238] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2031 [2024-09-11 16:11:21.949272] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:21.949307] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:11:21.949349] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:11:21.949471] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:21.949580] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:11:21.949630] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:11:21.949642] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:11:21.949653] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:11:21.949693] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:11:21.949753] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:11:21.949778] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:11:21.957245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:21.957280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:21.957287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:21.957294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:21.966893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:22.064083] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042282064079, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:11:22.070836] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042282070831, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:11:22.157527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:22.157571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:22.157595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:22.157604] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:22.167041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:22.298094] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:22.357829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:22.357873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:22.357881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:22.357889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:22.367162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:22.558142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:22.558185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:22.558193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:22.558203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:22.567274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:22.661286] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:22.758490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:22.758535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:22.758544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:22.758553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:22.767385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:22.958848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:22.958923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:22.958955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:22.958965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:22.967503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:23.071765] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042283071761, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:11:23.078454] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042283078450, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:11:23.159271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:23.159317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:23.159325] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:23.159334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:23.167624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:23.167724] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8376, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:11:23.298239] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:23.367739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:23.368061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:23.368095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:23.368103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:23.368112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:23.568407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:23.568475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:23.568484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:23.568495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:23.571195] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3339, replace_start_pos=9600000, replace_num=100000) [2024-09-11 16:11:23.571226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:23.662217] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:23.768794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:23.768838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:23.768846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:23.768856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:23.771296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:23.969148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:23.969192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:23.969200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:23.969210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:23.971401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:24.079375] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042284079370, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:11:24.086131] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042284086127, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:11:24.169456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:24.169504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:24.169512] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:24.169522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:24.171504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:24.298423] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:24.369778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:24.369823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:24.369831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:24.369840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:24.371604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:24.570085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:24.570130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:24.570138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:24.570147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:24.571714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:24.663316] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:24.770380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:24.770418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:24.770425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:24.770434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:24.771816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:24.970735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:24.970797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:24.970810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:24.970825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:24.971925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:25.086929] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042285086925, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:11:25.093696] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042285093692, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 16:11:25.172599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=586] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:25.172786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=1668][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:25.172819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:25.172827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:25.172837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:25.180971] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8118, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:11:25.298616] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:25.372789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:25.381239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:25.381278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:25.381285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:25.381294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:25.572984] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:25.581538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:25.581577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:25.581600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:25.581610] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:25.664183] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:25.776430] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3318, replace_start_pos=9700000, replace_num=100000) [2024-09-11 16:11:25.776476] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:25.781946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:25.781983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:25.781991] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:25.782000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:25.976645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:25.982305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:25.982344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:25.982351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:25.982360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:26.094545] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042286094541, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:11:26.101308] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042286101304, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:11:26.176770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:26.182659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:26.182695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:26.182704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:26.182714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:26.298841] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:26.376954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:26.383038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:26.383072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:26.383079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:26.383089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:26.577074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:26.583395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:26.583432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:26.583441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:26.583450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:26.665420] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:26.777214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:26.783770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:26.783809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:26.783817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:26.783827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:26.977403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:26.984166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:26.984203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:26.984211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:26.984221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:27.102151] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042287102146, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:11:27.108913] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042287108910, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:11:27.177527] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:27.184529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:27.184562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:27.184570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:27.184580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:27.192320] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7726, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:11:27.299023] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=98] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:27.377703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:27.392584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:27.392628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:27.392635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:27.392644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:27.392821] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:11:27.577884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:27.593060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:27.593104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:27.593112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:27.593139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:27.666709] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:27.778045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:27.793366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:27.793409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:27.793434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:27.793444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:27.982500] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4339, replace_start_pos=9800000, replace_num=100000) [2024-09-11 16:11:27.982548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:27.993667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:27.993705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:27.993711] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:27.993720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:28.109831] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042288109828, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:11:28.116544] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042288116540, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:11:28.182628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:28.193975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:28.194010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:28.194016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:28.194023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:28.299149] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:28.382821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:28.394251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:28.394287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:28.394293] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:28.394301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:28.583022] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:28.594525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:28.594566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:28.594575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:28.594584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:28.667799] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:28.783144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:28.794800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:28.794836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:28.794842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:28.794850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:28.983309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:28.995087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:28.995125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:28.995133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:28.995142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:29.117392] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042289117389, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:11:29.124155] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042289124151, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:11:29.183442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:29.195360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:29.195398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:29.195404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:29.195412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:29.202860] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7436, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:11:29.299293] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:29.383571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:29.403114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:29.403153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:29.403160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:29.403169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:29.583683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:29.603476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:29.603524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:29.603532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:29.603542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:29.668836] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:29.783858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:29.803756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:29.803797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:29.803802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:29.803810] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:29.983966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:30.004142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:30.004191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:30.004200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:30.004209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:30.125001] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042290124996, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:11:30.131761] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042290131758, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:11:30.188449] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4347, replace_start_pos=9900000, replace_num=100000) [2024-09-11 16:11:30.188497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:30.204507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:30.204548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:30.204556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:30.204566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:30.299464] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:30.388588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:30.404880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:30.404962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:30.404973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:30.405000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:30.588715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:30.605300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:30.605339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:30.605347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:30.605357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:30.669974] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:30.788850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:30.805661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:30.805708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:30.805716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:30.805727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:30.988998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:31.006067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:31.006103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:31.006111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:31.006121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:31.132695] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042291132690, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007694, add_bytes: 0 [2024-09-11 16:11:31.139446] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042291139442, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:11:31.189113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:31.206367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:31.206404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:31.206412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:31.206438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:31.213651] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7199, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:11:31.299683] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:31.389231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:31.413944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:31.413989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:31.413996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:31.414005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:31.589367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:31.614350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:31.614390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:31.614398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:31.614408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:31.671150] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:31.789569] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:31.814745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:31.814798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:31.814810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:31.814825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:31.966209] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:31.966255] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=44] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:31.966355] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] update_check_range(min_check_version=131, max_check_version=132, global_version=133) [2024-09-11 16:11:31.968373] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2017 [2024-09-11 16:11:31.968410] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:31.968444] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:11:31.968482] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:11:31.968565] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:31.968684] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:11:31.968735] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:11:31.968747] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:11:31.968758] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:11:31.968794] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:11:31.968857] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:11:31.968882] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:11:31.989703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:32.015128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:32.015170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:32.015178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:32.015188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:32.140234] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042292140229, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:11:32.147022] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042292147018, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007576, add_bytes: 0 [2024-09-11 16:11:32.189819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:32.215488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:32.215534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:32.215542] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:32.215552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:32.299868] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:32.393735] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3794, replace_start_pos=10000000, replace_num=100000) [2024-09-11 16:11:32.393779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:32.415809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:32.415852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:32.415860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:32.415869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:32.593939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:32.616170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:32.616216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:32.616225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:32.616235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:32.672351] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:32.794065] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:32.816527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:32.816570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:32.816577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:32.816585] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:32.994256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:33.016825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:33.016870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:33.016877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:33.016925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:33.147845] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042293147842, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:11:33.154671] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042293154668, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007650, add_bytes: 0 [2024-09-11 16:11:33.194465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:33.217168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:33.217214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:33.217222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:33.217231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:33.224529] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7285, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:11:33.300044] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:33.394655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:33.424845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:33.424884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:33.424892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:33.424944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:33.594775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:33.625263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:33.625305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:33.625331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:33.625341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:33.673345] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:33.794893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:33.825650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:33.825715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:33.825725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:33.825735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:33.995018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:34.026075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:34.026119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:34.026127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:34.026136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:34.155473] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042294155469, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:11:34.162296] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042294162293, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:11:34.195126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:34.226437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:34.226484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:34.226492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:34.226502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:34.300182] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:34.395256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:34.426738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:34.426777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:34.426784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:34.426793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:34.599739] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4336, replace_start_pos=10100000, replace_num=100000) [2024-09-11 16:11:34.599787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:34.627038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:34.627073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:34.627081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:34.627089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:34.674275] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:34.799876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:34.827386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:34.827430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:34.827438] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:34.827448] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:35.000016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:35.027741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:35.027790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:35.027799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:35.027809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:35.163146] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042295163142, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:11:35.169851] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042295169848, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:11:35.200137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:35.228055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:35.228094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:35.228102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:35.228111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:35.234982] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6858, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:11:35.300394] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:35.400257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:35.435248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:35.435290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:35.435297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:35.435307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:35.600378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:35.635609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:35.635653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:35.635661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:35.635671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:35.675407] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:35.800557] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:35.836009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:35.836053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:35.836060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:35.836084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:36.000684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:36.036388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:36.036432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:36.036441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:36.036451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:36.170699] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042296170696, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:11:36.177475] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=71] PNIO [ratelimit] time: 1726042296177470, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:11:36.200814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:36.236771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:36.236816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:36.236824] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:36.236834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:36.300607] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:36.401042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:36.437134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:36.437174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:36.437182] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:36.437207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:36.601186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:36.637506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:36.637551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:36.637559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:36.637569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:36.676408] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:36.805593] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4273, replace_start_pos=10200000, replace_num=100000) [2024-09-11 16:11:36.805644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:36.837822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:36.837866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:36.837873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:36.837883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:37.005745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:37.038113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:37.038156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:37.038165] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:37.038175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:37.178381] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042297178377, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:11:37.185147] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042297185142, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:11:37.205929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:37.238419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:37.238488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:37.238496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:37.238505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:37.245664] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7145, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:11:37.300755] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:37.406118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:37.446033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:37.446077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:37.446085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:37.446095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:37.606257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:37.646389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:37.646433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:37.646441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:37.646450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:37.677322] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:37.806380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:37.846760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:37.846807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:37.846815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:37.846824] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:38.006516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:38.047083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:38.047129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:38.047137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:38.047147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:38.185993] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042298185989, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:11:38.192762] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042298192758, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:11:38.206723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:38.247463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:38.247509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:38.247517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:38.247527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:38.300888] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:38.406853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:38.447763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:38.447805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:38.447813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:38.447823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:38.606990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:38.648066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:38.648109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:38.648117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:38.648126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:38.678135] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:38.807228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:38.848373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:38.848417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:38.848424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:38.848438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:39.011748] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4337, replace_start_pos=10300000, replace_num=100000) [2024-09-11 16:11:39.011799] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:39.048742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:39.048788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:39.048796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:39.048805] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:39.193616] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042299193613, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:11:39.200373] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042299200368, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:11:39.211896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:39.249038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:39.249073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:39.249079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:39.249086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:39.255701] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6584, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:11:39.301047] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:39.412107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:39.456057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:39.456094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:39.456102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:39.456110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:39.612238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:39.656342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:39.656386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:39.656394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:39.656403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:39.678938] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:39.812366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:39.856638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:39.856684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:39.856692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:39.856701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:40.012497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:40.056976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:40.057017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:40.057026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:40.057054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:40.201170] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042300201166, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:11:40.207924] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042300207921, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:11:40.212615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:40.257313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:40.257355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:40.257363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:40.257372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:40.301180] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:40.412717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:40.457585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:40.457620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:40.457627] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:40.457636] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:40.457829] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=65, refresh_score_time=60, wash_time=0) [2024-09-11 16:11:40.612837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:40.658072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:40.658110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:40.658135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:40.658144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:40.679893] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:40.812958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:40.858388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:40.858444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:40.858451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:40.858460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:41.013143] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:41.058763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:41.058809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:41.058816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:41.058825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:41.208953] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042301208948, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007782, add_bytes: 0 [2024-09-11 16:11:41.215605] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042301215601, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:11:41.217170] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3907, replace_start_pos=10400000, replace_num=100000) [2024-09-11 16:11:41.217196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:41.259129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:41.259168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:41.259176] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:41.259186] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:41.267526] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8327, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:11:41.301399] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:41.417285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:41.467892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:41.467974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:41.467983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:41.467993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:41.617408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:41.668366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:41.668414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:41.668422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:41.668432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:41.680823] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:41.817534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:41.868742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:41.868788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:41.868796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:41.868806] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:41.982339] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:41.982390] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:41.982474] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=132, max_check_version=133, global_version=134) [2024-09-11 16:11:41.984533] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2058 [2024-09-11 16:11:41.984598] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:41.984633] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:11:41.984671] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:11:41.984755] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:41.984863] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:11:41.984939] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:11:41.984952] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:11:41.984963] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:11:41.984999] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:11:41.985064] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:11:41.985082] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:11:42.017731] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:42.069037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:42.069080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:42.069086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:42.069094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:42.216415] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042302216410, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007462, add_bytes: 0 [2024-09-11 16:11:42.217858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:42.223310] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042302223307, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007706, add_bytes: 0 [2024-09-11 16:11:42.269416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:42.269454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:42.269460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:42.269468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:42.301590] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:42.417982] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:42.469696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:42.469753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:42.469761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:42.469770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:42.618172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:42.670558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:42.670598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:42.670606] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:42.670615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:42.681739] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:42.818288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:42.870847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:42.870885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:42.870892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:42.870917] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:43.018471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:43.071144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:43.071184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:43.071192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:43.071200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:43.218691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:43.224071] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042303224067, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:11:43.230764] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042303230762, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007455, add_bytes: 0 [2024-09-11 16:11:43.271421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:43.271460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:43.271467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:43.271475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:43.280070] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8581, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:11:43.301732] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:43.423060] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4161, replace_start_pos=10500000, replace_num=100000) [2024-09-11 16:11:43.423096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:43.480306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:43.480346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:43.480353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:43.480362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:43.623186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:43.680648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:43.680690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:43.680698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:43.680707] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:43.682889] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:43.823366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:43.881055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:43.881101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:43.881109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:43.881119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:44.023548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:44.081449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:44.081497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:44.081505] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:44.081515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:44.223681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:44.231706] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042304231703, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:11:44.238483] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042304238479, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007717, add_bytes: 0 [2024-09-11 16:11:44.281818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:44.281861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:44.281870] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:44.281880] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:44.301859] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:44.423835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:44.482183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:44.482227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:44.482235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:44.482271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:44.623964] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:44.682570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:44.682608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:44.682616] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:44.682625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:44.684117] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:44.824164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:44.882864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:44.882924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:44.882936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:44.882950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:45.024355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:45.083187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:45.083230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:45.083239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:45.083248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:45.224580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:45.239253] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042305239250, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:11:45.246072] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042305246068, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007589, add_bytes: 0 [2024-09-11 16:11:45.283486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:45.283524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:45.283530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:45.283560] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:45.291518] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7947, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:11:45.302026] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:45.424779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:45.491777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:45.491822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:45.491830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:45.491840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:45.628763] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3795, replace_start_pos=10600000, replace_num=100000) [2024-09-11 16:11:45.628808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:45.685114] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:45.692133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:45.692175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:45.692184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:45.692193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:45.828917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:45.892497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:45.892538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:45.892547] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:45.892557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:46.029054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:46.092856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:46.092945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=89][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:46.092957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:46.092965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:46.229239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:46.246858] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042306246854, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:11:46.253628] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042306253627, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:11:46.293214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:46.293260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:46.293268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:46.293277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:46.302175] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:46.429380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:46.493521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:46.493559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:46.493566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:46.493576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:46.629496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:46.685992] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:46.693814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:46.693856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:46.693865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:46.693874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:46.829642] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:46.894170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:46.894215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:46.894223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:46.894232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:47.029774] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:47.094443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:47.094482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:47.094488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:47.094496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:47.229959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:47.254488] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042307254484, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:11:47.261300] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042307261296, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:11:47.294794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:47.294832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:47.294840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:47.294851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:47.301849] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6984, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:11:47.302295] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:47.430099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:47.502197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:47.502242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:47.502250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:47.502259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:47.630224] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:47.686786] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:47.702568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:47.702611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:47.702619] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:47.702628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:47.833690] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3329, replace_start_pos=10700000, replace_num=100000) [2024-09-11 16:11:47.833735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:47.902982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:47.903029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:47.903037] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:47.903047] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:48.033823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:48.103348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:48.103390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:48.103398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:48.103428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:48.233953] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:48.262089] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042308262086, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:11:48.268849] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042308268846, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:11:48.302453] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=11] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:48.303664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:48.303684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:48.303692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:48.303700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:48.434148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:48.504067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:48.504111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:48.504119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:48.504129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:48.634346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:48.688152] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:48.704508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:48.704552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:48.704560] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:48.704569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:48.834488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:48.904877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:48.904944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:48.904970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:48.904980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:49.034691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:49.105287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:49.105333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:49.105341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:49.105351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:49.234890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:49.269704] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042309269700, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:11:49.276582] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042309276578, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007732, add_bytes: 0 [2024-09-11 16:11:49.302676] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:49.305655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:49.305696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:49.305704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:49.305714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:49.313470] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7743, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:11:49.435096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:49.513796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:49.513840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:49.513848] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:49.513858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:49.635255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:49.689558] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:49.714162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:49.714207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:49.714216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:49.714225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:49.835501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:49.914527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:49.914569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:49.914578] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:49.914588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:50.039940] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4318, replace_start_pos=10800000, replace_num=100000) [2024-09-11 16:11:50.039987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:50.114965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:50.115009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:50.115016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:50.115026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:50.240087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:50.277327] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042310277323, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:11:50.284144] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042310284140, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:11:50.302856] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:50.315324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:50.315366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:50.315374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:50.315383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:50.441859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=1632] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:50.515683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:50.515727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:50.515735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:50.515745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:50.642075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:50.690538] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:50.716075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:50.716114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:50.716122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:50.716131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:50.842194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:50.916432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:50.916474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:50.916482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:50.916493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:51.042315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:51.116806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:51.116852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:51.116860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:51.116870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:51.242507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:51.284956] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042311284951, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:11:51.291766] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042311291763, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:11:51.303090] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=94] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:51.317167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:51.317210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:51.317218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:51.317228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:51.325347] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8106, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:11:51.442702] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:51.525603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:51.525649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:51.525656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:51.525682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:51.642830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:51.691564] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:51.726007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:51.726051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:51.726076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:51.726086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:51.842964] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:51.926333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:51.926377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:51.926384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:51.926393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:51.999211] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:51.999261] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:11:51.999341] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=133, max_check_version=134, global_version=135) [2024-09-11 16:11:52.001396] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2054 [2024-09-11 16:11:52.001437] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:52.001470] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:11:52.001529] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:11:52.001614] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:11:52.001723] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:11:52.001774] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:11:52.001789] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:11:52.001801] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:11:52.001837] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:11:52.001897] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:11:52.001934] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:11:52.043095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:52.126697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:52.126742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:52.126750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:52.126759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:52.246585] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3334, replace_start_pos=10900000, replace_num=100000) [2024-09-11 16:11:52.246635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:52.292559] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042312292555, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:11:52.299453] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042312299449, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:11:52.303207] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:52.327073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:52.327117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:52.327126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:52.327135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:52.446721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:52.527437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:52.527483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:52.527491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:52.527500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:52.646866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:52.692927] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:52.727753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:52.727799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:52.727808] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:52.727833] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:52.847003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:52.928129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:52.928171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:52.928179] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:52.928189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:53.047134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:53.128426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:53.128471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:53.128479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:53.128488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:53.247278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:53.300241] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042313300237, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:11:53.303392] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:53.306997] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042313306995, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:11:53.328697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:53.328737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:53.328743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:53.328764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:53.335379] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6601, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:11:53.447405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:53.535715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:53.535762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:53.535770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:53.535780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:53.647530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:53.694262] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:53.736032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:53.736077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:53.736084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:53.736092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:53.847679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:53.936392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:53.936439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:53.936448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:53.936459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:54.047815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:54.136690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:54.136728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:54.136734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:54.136756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:54.247944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:54.303514] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:54.307782] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042314307779, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:11:54.314545] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042314314542, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:11:54.337077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:54.337121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:54.337129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:54.337139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:54.452539] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4412, replace_start_pos=11000000, replace_num=100000) [2024-09-11 16:11:54.452581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:54.537403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:54.537453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:54.537462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:54.537472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:54.652679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:54.695639] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:54.737782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:54.737829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:54.737838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:54.737848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:54.852878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:54.938145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:54.938190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:54.938198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:54.938207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:55.053053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=87] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:55.138514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:55.138558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:55.138566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:55.138576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:55.253198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:55.303712] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:55.315402] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042315315398, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:11:55.322157] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042315322155, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:11:55.338875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:55.338935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:55.338944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:55.338954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:55.346248] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7280, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:11:55.453365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:55.546612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:55.546657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:55.546665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:55.546675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:55.653491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:55.696970] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:55.747015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:55.747061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:55.747068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:55.747078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:55.853825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:55.947379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:55.947425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:55.947433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:55.947443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:56.054014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:56.147750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:56.147797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:56.147805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:56.147815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:56.254145] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:56.303931] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:56.323020] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042316323016, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:11:56.329842] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042316329839, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:11:56.348137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:56.348183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:56.348191] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:56.348200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:56.454347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:56.548447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:56.548491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:56.548499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:56.548509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:56.658979] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4422, replace_start_pos=11100000, replace_num=100000) [2024-09-11 16:11:56.659030] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:56.698345] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:56.748824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:56.748870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:56.748878] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:56.748888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:56.859223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:56.949213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:56.949260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:56.949268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:56.949297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:57.059357] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:57.149620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:57.149667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:57.149676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:57.149685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:57.259548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:57.304126] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:57.330729] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042317330725, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007709, add_bytes: 0 [2024-09-11 16:11:57.337456] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042317337452, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:11:57.350022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:57.350062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:57.350069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:57.350078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:57.357690] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7597, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:11:57.459737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:57.558050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:57.558094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:57.558119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:57.558128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:57.558315] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:11:57.659860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:57.699820] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:57.758612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:57.758656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:57.758664] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:57.758673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:57.860008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:11:57.958995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:57.959040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:57.959048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:57.959058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:58.060185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:11:58.159358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:58.159402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:58.159410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:58.159420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:58.260375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:11:58.304312] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:58.338268] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042318338264, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:11:58.345015] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042318345012, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:11:58.359713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:58.359751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:58.359759] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:58.359769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:58.460504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:11:58.560069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:58.560114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:58.560122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:58.560132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:58.660684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:11:58.701195] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=113] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:58.760428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:58.760474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:58.760483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:58.760493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:58.865114] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4296, replace_start_pos=11200000, replace_num=100000) [2024-09-11 16:11:58.865165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:11:58.960707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:58.960742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:58.960748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:58.960757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:59.065329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:11:59.161079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:59.161125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:59.161133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:59.161142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:59.265513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:11:59.304447] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:11:59.345873] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726042319345869, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:11:59.352639] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042319352635, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:11:59.361449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:59.361492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:59.361499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:59.361509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:59.370012] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8490, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:11:59.465629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:11:59.570335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:59.570382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:59.570391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:59.570421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:59.665747] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:11:59.702482] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:11:59.770721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:59.770765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:59.770795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:59.770806] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:11:59.865882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:11:59.971107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:11:59.971152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:11:59.971160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:11:59.971170] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:00.066022] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:00.171461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:00.171505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:00.171514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:00.171524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:00.266157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:00.304609] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:00.347533] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:12:00.353476] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726042320353474, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:12:00.353496] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:12:00.357949] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:12:00.360260] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042320360258, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:12:00.360286] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:12:00.371820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:00.371862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:00.371870] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:00.371880] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:00.466347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:00.572179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:00.572226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:00.572235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:00.572244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:00.666485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:00.703513] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:00.772543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:00.772587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:00.772595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:00.772607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:00.772825] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=80, refresh_score_time=64, wash_time=0) [2024-09-11 16:12:00.866604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:00.973121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:00.973169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:00.973177] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:00.973209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:01.071087] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4357, replace_start_pos=11300000, replace_num=100000) [2024-09-11 16:12:01.071137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:01.173525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:01.173574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:01.173583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:01.173593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:01.271225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:01.304771] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=89] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:01.361165] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042321361160, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:12:01.367926] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726042321367922, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:12:01.373843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:01.373889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:01.373896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:01.373928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:01.382246] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8305, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:12:01.471422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:01.582583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:01.582627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:01.582635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:01.582644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:01.671628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:01.704919] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:01.782888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:01.782963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:01.782971] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:01.782980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:01.871753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:01.983230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:01.983275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:01.983282] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:01.983292] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:02.014959] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:02.015020] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:02.015104] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=134, max_check_version=135, global_version=136) [2024-09-11 16:12:02.017194] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2088 [2024-09-11 16:12:02.017260] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:02.017297] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:12:02.017335] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:12:02.017422] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:02.017529] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:12:02.017586] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:12:02.017598] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:12:02.017609] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:12:02.017646] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:12:02.017707] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:12:02.017728] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:12:02.071939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:02.183538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:02.183583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:02.183590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:02.183600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:02.272061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:02.304967] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:02.368710] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042322368705, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:12:02.375481] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042322375478, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:12:02.383837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:02.383882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:02.383889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:02.383898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:02.472174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:02.584163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:02.584210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:02.584218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:02.584247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:02.672292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:02.706210] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:02.784497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:02.784545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:02.784577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:02.784587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:02.872472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:02.984827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:02.984872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:02.984880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:02.984889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:03.072607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:03.185138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:03.185171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:03.185178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:03.185187] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:03.277216] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4427, replace_start_pos=11400000, replace_num=100000) [2024-09-11 16:12:03.277264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:03.305110] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:03.376333] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042323376329, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:12:03.383101] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042323383098, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:12:03.385508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:03.385544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:03.385552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:03.385562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:03.393794] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8219, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:12:03.477353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:03.594114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:03.594160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:03.594169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:03.594178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:03.677479] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:03.707519] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:03.794495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:03.794535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:03.794543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:03.794553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:03.877610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:03.994782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:03.994826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:03.994834] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:03.994843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:04.077731] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:04.195157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:04.195203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:04.195211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:04.195222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:04.277880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:04.305222] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:04.383949] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042324383946, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:12:04.390787] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726042324390782, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:12:04.395469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:04.395503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:04.395512] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:04.395521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:04.478080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:04.595854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:04.595926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:04.595938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:04.595948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:04.678263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:04.708619] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:04.796181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:04.796224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:04.796232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:04.796241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:04.878420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:04.996489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:04.996522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:04.996529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:04.996537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:05.078558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:05.196843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:05.196891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:05.196900] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:05.196934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:05.278676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:05.305406] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:05.391570] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042325391566, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:12:05.397246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:05.397283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:05.397292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:05.397301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:05.398385] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042325398383, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:12:05.405793] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8478, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:12:05.483161] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4360, replace_start_pos=11500000, replace_num=100000) [2024-09-11 16:12:05.483210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:05.606047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:05.606091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:05.606099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:05.606108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:05.683296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:05.709719] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:05.806465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:05.806511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:05.806519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:05.806529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:05.883429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:06.006824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:06.006867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:06.006876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:06.006885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:06.083622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:06.207191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:06.207237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:06.207245] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:06.207277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:06.283753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:06.305572] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:06.399194] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042326399189, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:12:06.406026] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042326406022, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2024-09-11 16:12:06.407574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:06.407604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:06.407612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:06.407621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:06.483939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:06.607962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:06.608008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:06.608016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:06.608026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:06.684086] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:06.711222] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:06.808323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:06.808368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:06.808377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:06.808387] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:06.884274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:07.008683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:07.008729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:07.008761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:07.008771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:07.084398] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:07.209038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:07.209080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:07.209089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:07.209098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:07.284576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:07.305700] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:07.406810] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042327406806, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:12:07.409336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:07.409364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:07.409372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:07.409381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:07.413563] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042327413561, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:12:07.417298] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7905, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:12:07.484768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:07.617540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:07.617582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:07.617590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:07.617599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:07.689278] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4351, replace_start_pos=11600000, replace_num=100000) [2024-09-11 16:12:07.689327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:07.712049] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:07.817896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:07.817958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:07.817965] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:07.817976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:07.889423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:08.018209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:08.018252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:08.018260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:08.018269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:08.089562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:08.218567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:08.218611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:08.218620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:08.218629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:08.289806] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:08.305809] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:08.414487] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042328414484, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:12:08.418873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:08.418925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:08.418934] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:08.418942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:08.421234] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042328421233, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:12:08.489958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:08.619162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:08.619208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:08.619217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:08.619228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:08.690073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:08.712930] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:08.819438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:08.819479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:08.819485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:08.819493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:08.890248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:09.019717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:09.019765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:09.019773] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:09.019782] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:09.090432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:09.220045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:09.220090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:09.220097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:09.220107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:09.290558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:09.306024] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:09.420352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:09.420396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:09.420403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:09.420412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:09.422089] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042329422086, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:12:09.428837] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8413, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:12:09.428852] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042329428849, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:12:09.490694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:09.629085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:09.629129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:09.629137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:09.629163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:09.690887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:09.714036] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:09.829465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:09.829510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:09.829541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:09.829552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:09.894432] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3383, replace_start_pos=11700000, replace_num=100000) [2024-09-11 16:12:09.894472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:10.029774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:10.029820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:10.029827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:10.029836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:10.094571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:10.230053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:10.230096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:10.230102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:10.230110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:10.294705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:10.306136] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:10.429717] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042330429712, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:12:10.430340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:10.433209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=2868][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:10.433222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:10.433232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:10.436471] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042330436467, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:12:10.494840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:10.633461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:10.633509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:10.633517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:10.633526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:10.694974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:10.714851] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:10.833778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:10.833825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:10.833833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:10.833842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:10.895172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:11.034078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:11.034122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:11.034130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:11.034138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:11.095313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:11.234363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:11.234428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:11.234436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:11.234445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:11.295495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:11.306351] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:11.434675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:11.434716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:11.434725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:11.434734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:11.437265] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726042331437262, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:12:11.442253] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7505, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:12:11.444085] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042331444083, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:12:11.495681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:11.642570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:11.642610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:11.642618] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:11.642627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:11.695808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:11.715764] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:11.842853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:11.842898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:11.842922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:11.842931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:11.895957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:12.031785] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:12.031833] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:12.031920] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=135, max_check_version=136, global_version=137) [2024-09-11 16:12:12.033624] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1702 [2024-09-11 16:12:12.033662] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:12.033695] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:12:12.033727] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:12:12.033826] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:12.033925] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:12:12.033975] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:12:12.033984] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:12:12.033996] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:12:12.034028] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:12:12.034076] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:12:12.034093] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:12:12.043251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:12.043293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:12.043301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:12.043310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:12.100481] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4396, replace_start_pos=11800000, replace_num=100000) [2024-09-11 16:12:12.100531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:12.243626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:12.243672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:12.243703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:12.243714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:12.300627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:12.306466] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:12.443958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:12.444003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:12.444010] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:12.444020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:12.444886] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042332444883, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:12:12.451638] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042332451634, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:12:12.500817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:12.644250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:12.644289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:12.644297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:12.644306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:12.701036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:12.716503] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:12.844602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:12.844647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:12.844655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:12.844664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:12.901180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:13.044888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:13.044953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:13.044960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:13.044970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:13.101381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:13.245191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:13.245230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:13.245236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:13.245244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:13.301496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:13.306649] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:13.445460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:13.445496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:13.445502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:13.445511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:13.452557] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726042333452553, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:12:13.453859] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8337, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:12:13.459314] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042333459310, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:12:13.501626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:13.654097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:13.654143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:13.654150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:13.654159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:13.701760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:13.717295] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:13.854384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:13.854426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:13.854433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:13.854442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:13.901976] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:14.054772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:14.054816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:14.054824] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:14.054833] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:14.102105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:14.255127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:14.255171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:14.255179] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:14.255188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:14.306002] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3712, replace_start_pos=11900000, replace_num=100000) [2024-09-11 16:12:14.306060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:14.306762] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:14.455429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:14.455468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:14.455476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:14.455486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:14.460109] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042334460107, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:12:14.466865] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726042334466862, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:12:14.506150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:14.655812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:14.655858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:14.655866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:14.655876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:14.706276] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:14.718405] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:14.856111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:14.856157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:14.856164] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:14.856174] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:14.906397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:15.056479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:15.056525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:15.056533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:15.056568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:15.106515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:15.256792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:15.256836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:15.256844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:15.256852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:15.306643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:15.306882] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:15.457078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:15.457138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:15.457151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:15.457161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:15.464722] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7547, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:12:15.467785] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042335467782, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:12:15.474489] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042335474485, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:12:15.506783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:15.664986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:15.665052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:15.665058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:15.665066] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:15.706919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:15.719392] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:15.865373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:15.865412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:15.865421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:15.865430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:15.907045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:16.065689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:16.065737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:16.065744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:16.065753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:16.107168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:16.266005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:16.266039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:16.266047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:16.266056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:16.307057] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:16.307288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:16.466291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:16.466333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:16.466362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:16.466371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:16.475354] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042336475350, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 16:12:16.482132] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042336482127, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007642, add_bytes: 0 [2024-09-11 16:12:16.511717] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4318, replace_start_pos=12000000, replace_num=100000) [2024-09-11 16:12:16.511755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:16.666666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:16.666712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:16.666720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:16.666730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:16.711842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:16.720467] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:16.867047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:16.867092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:16.867100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:16.867110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:16.911972] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:17.067397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:17.067441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:17.067449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:17.067459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:17.112092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:17.267696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:17.267726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:17.267733] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:17.267742] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:17.307187] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:17.312229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:17.468061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:17.468107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:17.468115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:17.468125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:17.475025] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6885, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:12:17.483022] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042337483017, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:12:17.489784] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042337489780, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007653, add_bytes: 0 [2024-09-11 16:12:17.512339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:17.675276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:17.675322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:17.675328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:17.675336] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:17.712462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:17.721610] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:17.875666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:17.875711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:17.875719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:17.875747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:17.912582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:18.076072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:18.076117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:18.076125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:18.076136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:18.112703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:18.276437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:18.276485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:18.276493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:18.276502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:18.307304] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:18.312840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:18.476850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:18.476894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:18.476925] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:18.476936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:18.490578] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042338490574, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:12:18.497350] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042338497347, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:12:18.513037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:18.677256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:18.677307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:18.677314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:18.677322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:18.716474] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3299, replace_start_pos=12100000, replace_num=100000) [2024-09-11 16:12:18.716597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=121] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:18.723058] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:18.877523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:18.877567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:18.877573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:18.877581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:18.916697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:19.077885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:19.077952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:19.077960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:19.077969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:19.116816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:19.278276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:19.278316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:19.278324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:19.278353] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:19.307435] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:19.316937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:19.478651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:19.478695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:19.478703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:19.478713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:19.486355] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7628, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:12:19.498266] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042339498261, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:12:19.505047] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042339505043, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 16:12:19.517068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:19.686677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:19.686716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:19.686724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:19.686734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:19.717193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:19.724281] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:19.886982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:19.887025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:19.887032] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:19.887042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:19.917419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:20.087265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:20.087297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:20.087304] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:20.087312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:20.117573] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:20.287544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:20.287588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:20.287595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:20.287603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:20.307536] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:20.317701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:20.487830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:20.487887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:20.487928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:20.487944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:20.505814] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042340505810, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:12:20.512639] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042340512635, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:12:20.517833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:20.688179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:20.688223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:20.688231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:20.688240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:20.718008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:20.725216] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:20.888471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:20.888515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:20.888522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:20.888531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:20.922103] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3866, replace_start_pos=12200000, replace_num=100000) [2024-09-11 16:12:20.922141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:21.088826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:21.088871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:21.088879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:21.088889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:21.089123] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=80, refresh_score_time=83, wash_time=0) [2024-09-11 16:12:21.122240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:21.289360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:21.289403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:21.289410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:21.289419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:21.307661] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:21.322367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:21.489766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:21.489812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:21.489821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:21.489830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:21.497083] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7241, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:12:21.513432] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042341513426, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:12:21.520182] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042341520178, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:12:21.522543] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:21.697405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:21.697452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:21.697461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:21.697470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:21.722715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:21.726445] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:21.897719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:21.897762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:21.897770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:21.897779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:21.922851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:22.048818] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:22.048882] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=61] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:22.048970] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=136, max_check_version=137, global_version=138) [2024-09-11 16:12:22.050675] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1705 [2024-09-11 16:12:22.050706] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:22.050737] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:12:22.050769] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:12:22.050842] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:22.050951] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:12:22.050995] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:12:22.051004] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:12:22.051013] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:12:22.051048] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:12:22.051096] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:12:22.051114] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:12:22.098079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:22.098122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:22.098130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:22.098139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:22.122973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:22.298391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:22.298433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:22.298440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:22.298449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:22.307777] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:22.323094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:22.498770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:22.498814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:22.498822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:22.498831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:22.521051] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042342521047, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:12:22.523288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:22.527863] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042342527860, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:12:22.699127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:22.699171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:22.699179] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:22.699189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:22.723409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:22.727440] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:22.899419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:22.899462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:22.899469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:22.899476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:22.923589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:23.099697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:23.099732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:23.099739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:23.099747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:23.128062] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4356, replace_start_pos=12300000, replace_num=100000) [2024-09-11 16:12:23.128112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:23.300115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:23.300161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:23.300169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:23.300178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:23.307913] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:23.328192] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:23.500497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:23.500535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:23.500543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:23.500554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:23.508667] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8100, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:12:23.528306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:23.528654] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042343528651, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:12:23.535428] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042343535424, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:12:23.709019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:23.709064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:23.709093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:23.709103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:23.728370] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:23.728432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:23.909404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:23.909448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:23.909456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:23.909466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:23.928610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:24.109698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:24.109741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:24.109747] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:24.109755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:24.128739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:24.308027] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:24.310030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:24.310058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:24.310065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:24.310074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:24.328862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:24.510306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:24.510339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:24.510355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:24.510362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:24.528998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:24.536279] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042344536275, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:12:24.543047] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042344543043, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:12:24.710685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:24.710729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:24.710737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:24.710747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:24.729134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:24.729543] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:24.911012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:24.911056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:24.911063] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:24.911073] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:24.929370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:25.111376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:25.111421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:25.111429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:25.111438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:25.129571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:25.308152] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:25.311679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:25.311733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:25.311740] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:25.311749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:25.334166] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4403, replace_start_pos=12400000, replace_num=100000) [2024-09-11 16:12:25.334210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:25.512082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:25.512146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:25.512161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:25.512171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:25.520679] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8494, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:12:25.534368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:25.543950] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042345543946, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:12:25.550666] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042345550662, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:12:25.720977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:25.721014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:25.721021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:25.721031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:25.730763] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:25.734497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:25.921276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:25.921315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:25.921322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:25.921342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:25.934617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:26.121642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:26.121685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:26.121693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:26.121703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:26.134739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:26.308295] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:26.321944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:26.321976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:26.321984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:26.321993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:26.334837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:26.522292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:26.522352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:26.522361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:26.522370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:26.534946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:26.551525] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042346551521, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 16:12:26.558324] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042346558319, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:12:26.722629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:26.722671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:26.722678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:26.722688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:26.731899] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:26.735078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:26.922940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:26.922979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:26.922987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:26.922997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:26.935246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:27.123210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:27.123245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:27.123251] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:27.123258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:27.135351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:27.308428] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:27.323497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:27.323542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:27.323550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:27.323580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:27.335477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:27.523885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:27.523952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:27.523961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:27.523971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:27.532142] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8157, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:12:27.538385] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=2769, replace_start_pos=12500000, replace_num=100000) [2024-09-11 16:12:27.538431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:27.559127] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042347559123, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:12:27.565885] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042347565881, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:12:27.732483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:27.732524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:27.732533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:27.732543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:27.732649] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:27.732737] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:12:27.738529] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:27.933058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:27.933097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:27.933104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:27.933113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:27.938737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:28.133350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:28.133396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:28.133404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:28.133413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:28.138918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:28.308612] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:28.333634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:28.333680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:28.333687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:28.333696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:28.339028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:28.533954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:28.534004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:28.534013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:28.534022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:28.539151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:28.566741] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042348566736, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:12:28.573502] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726042348573499, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:12:28.733871] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:28.734236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:28.734267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:28.734273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:28.734294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:28.739287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:28.934505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:28.934548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:28.934554] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:28.934562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:28.939502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:29.134794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:29.134835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:29.134843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:29.134851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:29.139620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:29.308753] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:29.335085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:29.335133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:29.335141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:29.335150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:29.339755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:29.535404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:29.535445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:29.535452] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:29.535461] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:29.539868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:29.543986] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8512, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:12:29.574353] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042349574348, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:12:29.581194] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042349581189, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:12:29.735061] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:29.744232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:29.744276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:29.744284] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:29.744293] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:29.744440] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4381, replace_start_pos=0, replace_num=100000) [2024-09-11 16:12:29.744474] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:29.944585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:29.944595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:29.944626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:29.944642] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:29.944652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:30.144721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:30.144860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:30.144891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:30.144898] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:30.144919] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:30.308870] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:30.344875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=78] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:30.345154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:30.345189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:30.345198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:30.345208] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:30.545069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:30.545498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:30.546841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=1341][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:30.546861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:30.546872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:30.581991] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042350581986, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 16:12:30.588804] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042350588800, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:12:30.736094] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:30.745199] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:30.747163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:30.747198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:30.747207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:30.747216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:30.945380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:30.947461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:30.947494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:30.947502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:30.947511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:31.145610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:31.147803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:31.147835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:31.147843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:31.147852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:31.309040] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=96] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:31.345798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:31.348075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:31.348106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:31.348113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:31.348122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:31.546014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:31.548425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:31.548459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:31.548467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:31.548476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:31.556929] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8441, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:12:31.589652] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042351589648, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007662, add_bytes: 0 [2024-09-11 16:12:31.596348] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042351596345, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:12:31.737340] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:31.746150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:31.757246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:31.757291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:31.757299] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:31.757308] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:31.949760] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3465, replace_start_pos=100000, replace_num=100000) [2024-09-11 16:12:31.949802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:31.957608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:31.957651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:31.957659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:31.957668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:32.065664] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:32.065713] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:32.065795] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=137, max_check_version=138, global_version=139) [2024-09-11 16:12:32.067801] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2005 [2024-09-11 16:12:32.067839] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:32.067875] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:12:32.067927] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:12:32.068011] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:32.068131] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:12:32.068180] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:12:32.068192] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:12:32.068203] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:12:32.068239] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:12:32.068302] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:12:32.068325] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:12:32.149953] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:32.157996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:32.158037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:32.158044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:32.158054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:32.309146] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:32.350099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:32.358357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:32.358401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:32.358409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:32.358419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:32.550290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:32.558721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:32.558782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:32.558790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:32.558799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:32.597204] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042352597200, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:12:32.604022] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042352604019, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:12:32.738697] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:32.750412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:32.759060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:32.759101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:32.759108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:32.759115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:32.950606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:32.959340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:32.959382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:32.959390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:32.959399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:33.150727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:33.159706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:33.159752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:33.159760] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:33.159770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:33.309272] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:33.350922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:33.360017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:33.360059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:33.360067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:33.360076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:33.551107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:33.560393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:33.560436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:33.560444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:33.560454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:33.568283] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7815, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:12:33.604928] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042353604924, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007724, add_bytes: 0 [2024-09-11 16:12:33.611640] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042353611637, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:12:33.739808] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:33.751233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:33.768623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:33.768668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:33.768676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:33.768685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:33.951357] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:33.969021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:33.969061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:33.969069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:33.969094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:34.155123] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3593, replace_start_pos=200000, replace_num=100000) [2024-09-11 16:12:34.155167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:34.169413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:34.169461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:34.169470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:34.169482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:34.309410] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:34.355252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:34.369791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:34.369835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:34.369844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:34.369853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:34.555421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:34.570157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:34.570200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:34.570208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:34.570234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:34.612509] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042354612506, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007582, add_bytes: 0 [2024-09-11 16:12:34.619187] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042354619184, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:12:34.741078] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:34.755549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:34.770448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:34.770489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:34.770496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:34.770504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:34.955683] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:34.970727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:34.970773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:34.970780] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:34.970789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:35.155805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:35.171048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:35.171092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:35.171099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:35.171109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:35.309524] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:35.355926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:35.371400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:35.371445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:35.371476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:35.371487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:35.556154] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:35.571816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:35.571863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:35.571871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:35.571880] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:35.580086] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8193, clean_start_pos=0, clean_num=200000) [2024-09-11 16:12:35.620111] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042355620107, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:12:35.626805] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042355626802, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:12:35.742055] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:35.756285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:35.780347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:35.780391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:35.780399] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:35.780408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:35.956414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:35.980716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:35.980761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:35.980769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:35.980779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:36.156550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:36.181134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:36.181182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:36.181190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:36.181199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:36.309662] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:36.361085] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4389, replace_start_pos=300000, replace_num=100000) [2024-09-11 16:12:36.361128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:36.381499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:36.381543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:36.381551] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:36.381561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:36.561220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:36.581869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:36.581936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:36.581945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:36.581955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:36.627670] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042356627666, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:12:36.634486] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042356634483, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:12:36.743207] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:36.761360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:36.782203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:36.782244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:36.782252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:36.782279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:36.961492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:36.982513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:36.982555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:36.982563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:36.982572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:37.161668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:37.182884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:37.182955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:37.182964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:37.182974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:37.309782] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:37.361792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:37.383271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:37.383315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:37.383323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:37.383332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:37.561916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:37.583643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:37.583682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:37.583690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:37.583700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:37.592127] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8414, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:12:37.635289] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042357635285, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:12:37.642111] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726042357642108, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:12:37.744601] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:37.762099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:37.792449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:37.792494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:37.792501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:37.792510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:37.962233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:37.992815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:37.992862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:37.992870] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:37.992880] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:38.162377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:38.193175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:38.193215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:38.193223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:38.193247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:38.309894] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:38.362564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:38.393485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:38.393533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:38.393540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:38.393549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:38.566673] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3916, replace_start_pos=400000, replace_num=100000) [2024-09-11 16:12:38.566720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:38.593806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:38.593852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:38.593859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:38.593868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:38.642926] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042358642921, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:12:38.649715] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042358649710, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:12:38.745926] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:38.766814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:38.794112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:38.794154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:38.794161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:38.794170] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:38.966963] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:38.994479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:38.994525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:38.994534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:38.994544] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:39.167219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:39.194854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:39.194898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:39.194931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:39.194942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:39.310070] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:39.367341] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:39.395266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:39.395312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:39.395320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:39.395330] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:39.567467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:39.595639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:39.595687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:39.595713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:39.595723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:39.602758] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7021, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:12:39.650521] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042359650517, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:12:39.657294] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042359657290, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007580, add_bytes: 0 [2024-09-11 16:12:39.747427] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:39.767653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:39.803019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:39.803058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:39.803065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:39.803072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:39.967788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:40.003298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:40.003334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:40.003341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:40.003350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:40.167971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:40.203649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:40.203692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:40.203698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:40.203707] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:40.310285] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:40.368100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:40.403978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:40.404023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:40.404031] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:40.404040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:40.568222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:40.604345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:40.604401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:40.604410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:40.604420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:40.658124] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042360658120, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:12:40.664898] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042360664893, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:12:40.748682] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:40.771860] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3460, replace_start_pos=500000, replace_num=100000) [2024-09-11 16:12:40.771909] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:40.804659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:40.804703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:40.804710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:40.804719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:40.971998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:41.005046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:41.005090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:41.005098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:41.005123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:41.172194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:41.205424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:41.205468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:41.205476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:41.205485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:41.310526] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=101] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:41.372319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:41.405742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:41.405784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:41.405791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:41.405800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:41.406047] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=75, refresh_score_time=63, wash_time=0) [2024-09-11 16:12:41.572441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:41.606350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:41.606396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:41.606404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:41.606431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:41.614526] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8080, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:12:41.665752] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042361665748, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:12:41.672511] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726042361672507, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:12:41.749918] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:41.772625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:41.814758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:41.814801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:41.814808] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:41.814816] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:41.972746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:42.015076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:42.015127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:42.015136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:42.015147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:42.085288] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:42.085329] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=40] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:42.085409] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=138, max_check_version=139, global_version=140) [2024-09-11 16:12:42.087452] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2042 [2024-09-11 16:12:42.087508] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:42.087542] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:12:42.087580] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:12:42.087663] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:42.087771] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:12:42.087825] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:12:42.087836] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:12:42.087847] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:12:42.087888] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:12:42.087973] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:12:42.087998] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:12:42.172869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:42.215399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:42.215445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:42.215452] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:42.215462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:42.310724] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:42.373013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:42.415701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:42.415745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:42.415753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:42.415762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:42.573136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:42.616034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:42.616077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:42.616085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:42.616094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:42.673352] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042362673349, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:12:42.680129] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042362680125, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:12:42.750945] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:42.773255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:42.816320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:42.816370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:42.816395] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:42.816403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:42.977759] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4381, replace_start_pos=600000, replace_num=100000) [2024-09-11 16:12:42.977807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:43.016648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:43.016694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:43.016702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:43.016711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:43.177900] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:43.216990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:43.217034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:43.217041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:43.217050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:43.310856] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:43.378046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:43.417298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:43.417343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:43.417367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:43.417376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:43.578182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:43.617626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:43.617672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:43.617681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:43.617690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:43.624764] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7061, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:12:43.681086] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726042363681082, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007733, add_bytes: 0 [2024-09-11 16:12:43.687833] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042363687828, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007703, add_bytes: 0 [2024-09-11 16:12:43.751962] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:43.778364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:43.825071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:43.825113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:43.825119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:43.825128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:43.978491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:44.025419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:44.025463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:44.025470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:44.025480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:44.178612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:44.225720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:44.225755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:44.225762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:44.225771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:44.310989] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:44.378744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:44.426024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:44.426063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:44.426071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:44.426081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:44.578862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:44.626324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:44.626364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:44.626372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:44.626381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:44.688597] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042364688594, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007512, add_bytes: 0 [2024-09-11 16:12:44.695413] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042364695410, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007582, add_bytes: 0 [2024-09-11 16:12:44.753056] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:44.778995] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:44.826648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:44.826692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:44.826700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:44.826709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:44.979115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:45.027053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:45.027093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:45.027102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:45.027111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:45.183587] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4348, replace_start_pos=700000, replace_num=100000) [2024-09-11 16:12:45.183636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:45.227403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:45.227443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:45.227449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:45.227457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:45.311187] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:45.383721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:45.427747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:45.427792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:45.427800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:45.427810] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:45.583934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:45.628088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:45.628134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:45.628142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:45.628152] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:45.636568] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8404, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:12:45.696206] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042365696201, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:12:45.703037] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042365703032, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:12:45.754312] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:45.784120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:45.836893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:45.836957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:45.836964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:45.836974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:45.984303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:46.037203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:46.037239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:46.037246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:46.037256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:46.184425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:46.237553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:46.237598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:46.237605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:46.237633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:46.311341] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:46.384539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:46.437883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:46.437958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:46.437966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:46.437975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:46.584660] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:46.638289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:46.638330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:46.638338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:46.638347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:46.703887] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726042366703883, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:12:46.710578] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042366710575, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:12:46.755410] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:46.784781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:46.838586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:46.838631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:46.838638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:46.838647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:46.984919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:47.038894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:47.038953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:47.038975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:47.038985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:47.185047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:47.239241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:47.239294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:47.239302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:47.239312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:47.311564] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:47.388616] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3450, replace_start_pos=800000, replace_num=100000) [2024-09-11 16:12:47.388665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:47.439618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:47.439660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:47.439667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:47.439677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:47.588743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:47.639927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:47.639978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:47.640001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:47.640010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:47.646562] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6538, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:12:47.711446] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726042367711443, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:12:47.718260] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042367718256, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:12:47.756539] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:47.788859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:47.846830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:47.846874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:47.846882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:47.846891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:47.988990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:48.047171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:48.047217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:48.047225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:48.047234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:48.189109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:48.247532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:48.247578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:48.247586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:48.247595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:48.311758] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:48.389223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:48.447899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:48.447962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:48.447969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:48.447980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:48.589346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:48.648271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:48.648315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:48.648323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:48.648333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:48.719047] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042368719043, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:12:48.725819] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042368725818, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:12:48.757818] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:48.789484] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:48.848567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:48.848614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:48.848621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:48.848628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:48.989678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:49.048953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:49.048999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:49.049007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:49.049016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:49.189822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:49.249254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:49.249301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:49.249307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:49.249314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:49.311985] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:49.389958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:49.449552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:49.449598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:49.449605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:49.449615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:49.594545] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4409, replace_start_pos=900000, replace_num=100000) [2024-09-11 16:12:49.594599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:49.649847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:49.649892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:49.649899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:49.649927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:49.657514] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7560, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:12:49.726739] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042369726734, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:12:49.733503] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042369733499, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:12:49.758862] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:49.794685] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:49.857863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:49.857927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:49.857937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:49.857946] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:49.994813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:50.058204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:50.058248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:50.058255] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:50.058265] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:50.194935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:50.258496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:50.258536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:50.258544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:50.258553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:50.312176] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:50.395056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:50.458857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:50.458923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:50.458950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:50.458960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:50.595238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:50.659259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:50.659306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:50.659314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:50.659324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:50.734291] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042370734287, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:12:50.741042] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042370741038, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:12:50.760027] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:50.795369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:50.859623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:50.859665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:50.859673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:50.859682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:50.995494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:51.060006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:51.060047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:51.060054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:51.060063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:51.195699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:51.260298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:51.260351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:51.260359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:51.260368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:51.312391] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:51.395886] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:51.460666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:51.460706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:51.460714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:51.460723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:51.596029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:51.661063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:51.661103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:51.661110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:51.661120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:51.669069] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7936, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:12:51.741978] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726042371741973, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:12:51.748731] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042371748726, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:12:51.760952] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:51.800397] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4234, replace_start_pos=1000000, replace_num=100000) [2024-09-11 16:12:51.800439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:51.869334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:51.869377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:51.869385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:51.869412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:52.000519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:52.069668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:52.069709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:52.069717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:52.069726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:52.102048] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:52.102097] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:12:52.102172] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=139, max_check_version=140, global_version=141) [2024-09-11 16:12:52.103915] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1729 [2024-09-11 16:12:52.103951] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:52.103983] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:12:52.104035] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:12:52.104111] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:12:52.104195] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:12:52.104238] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:12:52.104249] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:12:52.104258] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:12:52.104290] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:12:52.104338] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:12:52.104355] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:12:52.200632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:52.269983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:52.270028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:52.270049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:52.270057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:52.312685] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:52.400750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:52.470270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:52.470312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:52.470319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:52.470328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:52.600867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:52.670668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:52.670709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:52.670717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:52.670727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:52.749540] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042372749537, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:12:52.756284] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042372756280, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:12:52.762008] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:52.801047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:52.870974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:52.871016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:52.871025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:52.871036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:53.001164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:53.071284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:53.071328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:53.071336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:53.071345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:53.201303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:53.271650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:53.271694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:53.271702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:53.271712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:53.312896] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:53.401413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:53.471964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:53.472007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:53.472015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:53.472024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:53.601532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:53.672255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:53.672298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:53.672328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:53.672337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:53.679816] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7466, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:12:53.757134] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042373757127, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 16:12:53.763092] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:53.763965] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042373763962, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:12:53.801652] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:53.880076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:53.880123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:53.880130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:53.880139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:54.006102] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=1100000, replace_num=100000) [2024-09-11 16:12:54.006151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:54.080446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:54.080491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:54.080499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:54.080510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:54.206273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:54.280750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:54.280786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:54.280793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:54.280802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:54.313099] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:54.406395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:54.481103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:54.481145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:54.481154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:54.481163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:54.606517] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:54.681461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:54.681508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:54.681516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:54.681525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:54.764175] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:54.764761] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042374764758, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:12:54.771572] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042374771569, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:12:54.806634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:54.881831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:54.881877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:54.881885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:54.881894] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:55.006769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:55.082219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:55.082266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:55.082274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:55.082307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:55.206953] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:55.282554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:55.282600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:55.282608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:55.282617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:55.313294] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:55.407072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:55.482851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:55.482895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:55.482927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:55.482937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:55.607240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:55.683166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:55.683210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:55.683217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:55.683226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:55.690851] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7596, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:12:55.765295] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:55.772368] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042375772364, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:12:55.779189] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042375779185, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:12:55.807354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:55.891169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:55.891214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:55.891222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:55.891232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:56.007508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=82] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:56.091536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:56.091582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:56.091590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:56.091599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:56.211554] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3929, replace_start_pos=1200000, replace_num=100000) [2024-09-11 16:12:56.211602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:56.291944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:56.291989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:56.291997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:56.292006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:56.313512] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:56.411697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:56.492309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:56.492369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:56.492378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:56.492388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:56.611823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:56.692611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:56.692651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:56.692657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:56.692665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:56.766109] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:56.779979] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042376779976, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:12:56.786814] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042376786811, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:12:56.811941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:56.892986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:56.893029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:56.893036] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:56.893045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:57.012052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:57.093343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:57.093383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:57.093391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:57.093400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:57.212171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:57.293696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:57.293742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:57.293751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:57.293760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:57.313670] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:57.412304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:57.494067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:57.494114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:57.494124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:57.494135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:57.612425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:57.694436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:57.694482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:57.694489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:57.694499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:57.702477] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7964, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:12:57.767113] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:57.787617] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042377787613, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:12:57.794420] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042377794416, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:12:57.812544] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:12:57.902798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:57.902841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:57.902849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:57.902877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:57.903085] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:12:58.012658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:12:58.103325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:58.103366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:58.103375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:58.103383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:58.212784] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:12:58.303688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:58.303734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:58.303741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:58.303751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:58.313805] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:58.417215] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4300, replace_start_pos=1300000, replace_num=100000) [2024-09-11 16:12:58.417261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:12:58.504007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:58.504048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:58.504072] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:58.504082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:58.617343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:12:58.704383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:58.704427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:58.704435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:58.704445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:58.768174] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:58.795224] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042378795220, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:12:58.802039] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042378802036, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:12:58.817459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:12:58.904785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:58.904832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:58.904840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:58.904849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:59.017575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:12:59.105158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:59.105203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:59.105211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:59.105220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:59.217695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:12:59.305558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:59.305621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:59.305630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:59.305639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:59.314000] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:12:59.417813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:12:59.505898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:59.505968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:59.505975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:59.505984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:59.617926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:12:59.706290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:59.706334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:59.706343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:59.706353] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:12:59.714827] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8461, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:12:59.769197] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:12:59.802846] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042379802843, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:12:59.809656] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042379809653, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:12:59.818041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:12:59.915173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:12:59.915219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:12:59.915227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:12:59.915236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:00.018157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:00.115484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:00.115529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:00.115537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:00.115547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:00.218271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:00.314226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:00.315818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:00.315850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:00.315857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:00.315866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:00.418381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:00.516113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:00.516159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:00.516167] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:00.516176] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:00.622826] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=1400000, replace_num=100000) [2024-09-11 16:13:00.622895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:00.716411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:00.716454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:00.716462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:00.716471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:00.770149] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:00.804512] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:13:00.810453] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042380810450, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:13:00.810492] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:13:00.814883] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:13:00.817207] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042380817203, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:13:00.817241] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:13:00.823003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:00.916706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:00.916750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:00.916757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:00.916767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:01.023110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:01.117031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:01.117074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:01.117082] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:01.117091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:01.223230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:01.314444] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:01.317391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:01.317418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:01.317426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:01.317436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:01.423371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:01.517729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:01.517765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:01.517772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:01.517781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:01.623491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:01.718087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:01.718135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:01.718144] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:01.718153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:01.718371] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=84, refresh_score_time=63, wash_time=0) [2024-09-11 16:13:01.726416] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8030, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:13:01.771234] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:01.818063] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726042381818060, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:13:01.823618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:01.824890] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042381824887, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:13:01.926673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:01.926733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:01.926758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:01.926767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:02.023740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:02.118087] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:02.118137] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:02.118218] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=140, max_check_version=141, global_version=142) [2024-09-11 16:13:02.120400] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2179 [2024-09-11 16:13:02.120444] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:02.120480] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:13:02.120538] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:13:02.120624] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:02.120731] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:13:02.120783] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:13:02.120797] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:13:02.120808] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:13:02.120849] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:13:02.120922] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:13:02.120945] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:13:02.127092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:02.127126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:02.127135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:02.127144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:02.223854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:02.314567] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:02.327356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:02.327396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:02.327402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:02.327409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:02.424029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=91] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:02.527654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:02.527698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:02.527705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:02.527714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:02.624152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:02.727990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:02.728036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:02.728045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:02.728054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:02.772495] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:02.825685] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042382825681, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:13:02.828639] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4369, replace_start_pos=1500000, replace_num=100000) [2024-09-11 16:13:02.828670] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:02.832530] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042382832528, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2024-09-11 16:13:02.928298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:02.928344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:02.928352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:02.928379] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:03.028753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:03.128628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:03.128671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:03.128679] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:03.128688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:03.228880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:03.314777] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:03.329029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:03.329075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:03.329083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:03.329092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:03.429020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:03.529422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:03.529468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:03.529477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:03.529486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:03.629146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:03.729816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:03.729858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:03.729866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:03.729875] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:03.736957] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7067, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:13:03.773598] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:03.829277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:03.833302] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042383833298, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:13:03.840048] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042383840045, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007517, add_bytes: 0 [2024-09-11 16:13:03.937208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:03.937248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:03.937255] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:03.937265] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:04.029399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:04.137499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:04.137541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:04.137549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:04.137558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:04.229514] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:04.314897] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:04.337787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:04.337829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:04.337853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:04.337862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:04.429630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:04.538097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:04.538140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:04.538148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:04.538157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:04.629769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:04.738462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:04.738508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:04.738517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:04.738526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:04.774499] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:04.829892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:04.840937] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042384840934, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:13:04.847750] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042384847746, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007701, add_bytes: 0 [2024-09-11 16:13:04.938817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:04.938861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:04.938869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:04.938879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:05.033551] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3489, replace_start_pos=1600000, replace_num=100000) [2024-09-11 16:13:05.033596] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:05.139179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:05.139225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:05.139234] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:05.139247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:05.233697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:05.315092] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:05.339591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:05.339638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:05.339646] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:05.339657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:05.433828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:05.539979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:05.540021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:05.540028] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:05.540037] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:05.634403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:05.740252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:05.740300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:05.740325] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:05.740334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:05.747644] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7298, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:13:05.775456] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:05.834532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:05.848542] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042385848538, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:13:05.855347] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042385855344, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:13:05.947945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:05.947993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:05.948001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:05.948010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:06.034675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:06.148338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:06.148383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:06.148391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:06.148400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:06.234807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:06.315338] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:06.348634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:06.348674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:06.348682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:06.348691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:06.434926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:06.549038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:06.549082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:06.549089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:06.549099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:06.635050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:06.749430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:06.749475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:06.749483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:06.749493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:06.776463] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:06.835171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:06.856163] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042386856158, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:13:06.862926] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042386862921, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007577, add_bytes: 0 [2024-09-11 16:13:06.949785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:06.949830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:06.949839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:06.949848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:07.035303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:07.150154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:07.150202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:07.150210] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:07.150219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:07.239170] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3753, replace_start_pos=1700000, replace_num=100000) [2024-09-11 16:13:07.239218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:07.315482] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:07.350553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:07.350598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:07.350606] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:07.350615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:07.439320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:07.550938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:07.550981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:07.550988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:07.550997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:07.639501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:07.751303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:07.751349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:07.751357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:07.751367] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:07.759014] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7614, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:13:07.777670] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:07.839629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:07.863752] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042387863748, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 16:13:07.870592] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042387870588, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:13:07.959340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:07.959385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:07.959393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:07.959403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:08.039747] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:08.159637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:08.159683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:08.159691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:08.159700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:08.239881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:08.315616] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:08.360019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:08.360060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:08.360068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:08.360077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:08.440017] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:08.560380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:08.560426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:08.560461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:08.560473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:08.640153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:08.760766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:08.760810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:08.760818] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:08.760827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:08.779004] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:08.840273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:08.871444] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042388871439, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:13:08.878224] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726042388878221, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:13:08.961074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:08.961113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:08.961120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:08.961130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:09.040392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:09.161365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:09.161408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:09.161415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:09.161425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:09.240509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:09.315748] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:09.361682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:09.361728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:09.361737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:09.361747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:09.444832] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4146, replace_start_pos=1800000, replace_num=100000) [2024-09-11 16:13:09.444879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:09.562064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:09.562119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:09.562131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:09.562145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:09.644970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:09.762428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:09.762470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:09.762477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:09.762487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:09.771005] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8504, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:13:09.780142] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:09.845150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:09.879051] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042389879047, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:13:09.885744] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042389885740, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007519, add_bytes: 0 [2024-09-11 16:13:09.971256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:09.971297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:09.971305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:09.971332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:10.045275] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:10.171597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:10.171646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:10.171654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:10.171662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:10.245406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:10.315886] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:10.371891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:10.371952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:10.371960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:10.371969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:10.445631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:10.572276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:10.572322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:10.572330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:10.572339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:10.645762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:10.772615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:10.772661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:10.772669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:10.772679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:10.780951] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:10.845889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:10.886601] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042390886597, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:13:10.893361] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042390893357, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:13:10.972927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:10.972967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:10.972975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:10.972985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:11.046042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:11.173240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:11.173288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:11.173296] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:11.173306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:11.246222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:11.316071] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=91] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:11.373641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:11.373686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:11.373694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:11.373727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:11.446351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:11.574009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:11.574056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:11.574064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:11.574073] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:11.649990] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3524, replace_start_pos=1900000, replace_num=100000) [2024-09-11 16:13:11.650037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:11.774376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:11.774423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:11.774431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:11.774440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:11.781294] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6839, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:13:11.781868] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:11.850118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:11.894235] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042391894231, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:13:11.901051] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042391901046, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:13:11.981612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:11.981658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:11.981666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:11.981675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:12.050239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:12.135344] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:12.135398] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:12.135479] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=141, max_check_version=142, global_version=143) [2024-09-11 16:13:12.137519] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2039 [2024-09-11 16:13:12.137560] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:12.137593] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:13:12.137630] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:13:12.137715] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:12.137839] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:13:12.137892] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:13:12.137922] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:13:12.137935] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:13:12.137976] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:13:12.138036] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:13:12.138061] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:13:12.182040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:12.182086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:12.182094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:12.182104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:12.250581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:12.316189] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:12.382416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:12.382481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:12.382489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:12.382520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:12.450727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:12.582821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:12.582861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:12.582869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:12.582881] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:12.650850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:12.782919] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:12.783194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:12.783226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:12.783234] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:12.783244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:12.850968] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:12.901923] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042392901918, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:13:12.908667] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042392908663, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:13:12.983492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:12.983539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:12.983546] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:12.983555] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:13.051094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:13.183793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:13.183838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:13.183845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:13.183870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:13.251212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:13.316329] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:13.384078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:13.384124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:13.384132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:13.384140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:13.451346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:13.584369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:13.584413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:13.584420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:13.584430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:13.651523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:13.784120] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:13.784728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:13.784762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:13.784770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:13.784779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:13.792098] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7306, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:13:13.856078] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4418, replace_start_pos=2000000, replace_num=100000) [2024-09-11 16:13:13.856129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:13.909460] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042393909455, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:13:13.916229] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042393916225, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:13:13.992437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:13.992480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:13.992488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:13.992498] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:14.056279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:14.192800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:14.192842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:14.192849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:14.192857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:14.256421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:14.316523] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:14.393100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:14.393144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:14.393152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:14.393161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:14.456605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:14.593386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:14.593430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:14.593437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:14.593446] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:14.656798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:14.785203] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:14.793662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:14.793696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:14.793703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:14.793711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:14.856924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:14.917068] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726042394917063, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:13:14.923937] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042394923933, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007708, add_bytes: 0 [2024-09-11 16:13:14.993962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:14.994004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:14.994011] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:14.994020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:15.057052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:15.194278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:15.194322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:15.194329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:15.194338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:15.257184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:15.316637] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:15.394576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:15.394609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:15.394616] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:15.394625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:15.457380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:15.594854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:15.594894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:15.594917] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:15.594928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:15.657513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:15.786298] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:15.795149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:15.795194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:15.795202] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:15.795211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:15.803670] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8444, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:13:15.857697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:15.924701] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042395924696, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:13:15.931457] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042395931452, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007519, add_bytes: 0 [2024-09-11 16:13:16.004022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:16.004067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:16.004074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:16.004104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:16.061448] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3627, replace_start_pos=2100000, replace_num=100000) [2024-09-11 16:13:16.061492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:16.204312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:16.204350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:16.204357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:16.204365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:16.261597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:16.316789] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:16.404664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:16.404710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:16.404718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:16.404727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:16.461716] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:16.605002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:16.605045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:16.605053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:16.605085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:16.661846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:16.787116] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:16.805388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:16.805425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:16.805449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:16.805459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:16.862031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:16.932299] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726042396932294, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:13:16.939137] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042396939133, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:13:17.005712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:17.005754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:17.005762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:17.005771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:17.062148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:17.206073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:17.206120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:17.206128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:17.206138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:17.262270] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:17.316927] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:17.406383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:17.406425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:17.406449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:17.406458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:17.462391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:17.606714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:17.606757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:17.606765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:17.606775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:17.662508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:17.787917] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:17.807079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:17.807127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:17.807135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:17.807145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:17.815713] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8554, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:13:17.862630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:17.939920] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042397939916, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:13:17.946747] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042397946742, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:13:18.016058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:18.016105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:18.016114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:18.016124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:18.062810] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:18.216371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:18.216416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:18.216424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:18.216433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:18.267396] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4395, replace_start_pos=2200000, replace_num=100000) [2024-09-11 16:13:18.267438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:18.317140] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:18.416673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:18.416716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:18.416724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:18.416733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:18.467524] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:18.616990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:18.617035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:18.617043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:18.617052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:18.667663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:18.788678] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:18.817289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:18.817334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:18.817341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:18.817351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:18.867889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:18.947541] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042398947537, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:13:18.954322] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042398954317, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 16:13:19.017603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:19.017639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:19.017646] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:19.017655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:19.068025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:19.217891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:19.217954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:19.217961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:19.217971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:19.268143] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:19.317269] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:19.418217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:19.418261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:19.418270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:19.418279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:19.468262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:19.618545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:19.618591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:19.618599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:19.618608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:19.668440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:19.789753] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:19.818916] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:19.818960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:19.818968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:19.818977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:19.825996] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7006, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:13:19.868622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:19.955223] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042399955219, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:13:19.961972] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042399961969, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007652, add_bytes: 0 [2024-09-11 16:13:20.026248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:20.026287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:20.026295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:20.026304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:20.068849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:20.226538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:20.226578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:20.226604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:20.226613] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:20.268971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:20.317377] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:20.426865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:20.426923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:20.426932] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:20.426941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:20.472690] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3598, replace_start_pos=2300000, replace_num=100000) [2024-09-11 16:13:20.472733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:20.627165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:20.627206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:20.627214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:20.627223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:20.672821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:20.790775] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:20.827515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:20.827560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:20.827568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:20.827577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:20.873004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:20.962830] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042400962826, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:13:20.969629] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042400969625, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007656, add_bytes: 0 [2024-09-11 16:13:21.027827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:21.027873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:21.027880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:21.027890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:21.073184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:21.228210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:21.228255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:21.228263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:21.228272] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:21.273415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:21.317513] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:21.428518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:21.428563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:21.428570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:21.428579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:21.473538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:21.628874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:21.628937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:21.628963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:21.628973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:21.673724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:21.791822] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:21.829272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:21.829318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:21.829326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:21.829336] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:21.836552] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7202, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:13:21.873845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:21.970389] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726042401970384, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:13:21.977208] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726042401977205, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007580, add_bytes: 0 [2024-09-11 16:13:22.036929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:22.036970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:22.036978] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:22.036987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:22.037200] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=73, refresh_score_time=62, wash_time=0) [2024-09-11 16:13:22.073971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:22.150112] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:22.150166] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:22.150250] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] update_check_range(min_check_version=142, max_check_version=143, global_version=144) [2024-09-11 16:13:22.152264] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2013 [2024-09-11 16:13:22.152301] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:22.152335] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:13:22.152373] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:13:22.152456] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:22.152576] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:13:22.152627] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:13:22.152638] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:13:22.152649] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:13:22.152685] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:13:22.152748] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:13:22.152775] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:13:22.237522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:22.237568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:22.237576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:22.237586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:22.274098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:22.317734] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:22.437823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:22.437866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:22.437874] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:22.437883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:22.474219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:22.638185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:22.638229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:22.638254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:22.638264] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:22.677765] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3432, replace_start_pos=2400000, replace_num=100000) [2024-09-11 16:13:22.677814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:22.792915] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:22.838502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:22.838540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:22.838548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:22.838558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:22.877967] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:22.977994] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042402977990, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:13:22.984759] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042402984756, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:13:23.038801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:23.038849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:23.038857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:23.038866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:23.078144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:23.239103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:23.239146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:23.239154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:23.239163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:23.278278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:23.317930] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:23.439458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:23.439502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:23.439510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:23.439520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:23.478419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:23.639821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:23.639863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:23.639871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:23.639883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:23.678609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:23.793943] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:23.840115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:23.840163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:23.840169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:23.840177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:23.846914] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6724, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:13:23.878787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:23.985612] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042403985608, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:13:23.992375] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042403992372, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:13:24.047188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:24.047230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:24.047288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:24.047314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:24.078941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:24.247556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:24.247597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:24.247605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:24.247614] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:24.279117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:24.318111] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:24.447930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:24.447976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:24.447984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:24.447994] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:24.479295] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:24.648227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:24.648271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:24.648279] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:24.648288] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:24.679421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:24.794678] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:24.848623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:24.848667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:24.848675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:24.848702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:24.884023] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4417, replace_start_pos=2500000, replace_num=100000) [2024-09-11 16:13:24.884070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:24.993242] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042404993237, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:13:25.000084] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042405000080, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007708, add_bytes: 0 [2024-09-11 16:13:25.049079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:25.049152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:25.049164] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:25.049179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:25.084163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:25.249485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:25.249531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:25.249539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:25.249548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:25.284311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:25.318242] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:25.449851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:25.449897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:25.449948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:25.449957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:25.484442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:25.650208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:25.650254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:25.650262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:25.650272] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:25.684579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:25.795460] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:25.850564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:25.850605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:25.850613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:25.850622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:25.859180] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8544, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:13:25.884706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:26.000849] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042406000845, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:13:26.007668] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042406007664, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007584, add_bytes: 0 [2024-09-11 16:13:26.059504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:26.059550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:26.059558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:26.059567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:26.084828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:26.259874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:26.259941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:26.259950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:26.259960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:26.284976] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:26.318390] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:26.460268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:26.460313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:26.460321] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:26.460331] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:26.485112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:26.660634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:26.660677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:26.660685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:26.660695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:26.685252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:26.796376] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:26.860958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:26.861019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:26.861027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:26.861037] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:26.885378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:27.008521] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042407008516, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:13:27.015295] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042407015291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:13:27.061344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:27.061391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:27.061400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:27.061410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:27.089829] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4319, replace_start_pos=2600000, replace_num=100000) [2024-09-11 16:13:27.089879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:27.261649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:27.261693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:27.261701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:27.261711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:27.289969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:27.318509] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:27.462039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:27.462085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:27.462094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:27.462103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:27.490093] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:27.662355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:27.662409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:27.662422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:27.662433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:27.690285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:27.797783] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:27.862662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:27.862704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:27.862713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:27.862722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:27.871271] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8536, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:13:27.890410] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:28.016071] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042408016067, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:13:28.022856] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042408022853, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:13:28.071594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:28.071639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:28.071647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:28.071657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:28.071848] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:13:28.090600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:28.272175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:28.272234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:28.272242] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:28.272252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:28.290796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:28.318632] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:28.472546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:28.472592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:28.472600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:28.472609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:28.490958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:28.672849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:28.672894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:28.672924] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:28.672934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:28.691098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:28.799107] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:28.873253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:28.873301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:28.873309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:28.873319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:28.891220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:29.023759] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042409023755, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:13:29.030456] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042409030453, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:13:29.073554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:29.073598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:29.073605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:29.073614] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:29.091354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:29.273932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:29.273976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:29.273984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:29.273993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:29.295830] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=2700000, replace_num=100000) [2024-09-11 16:13:29.295874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:29.318761] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:29.474225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:29.474291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:29.474301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:29.474315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:29.495970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:29.674615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:29.674661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:29.674669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:29.674680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:29.696181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:29.800218] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:29.874944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:29.875004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:29.875012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:29.875021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:29.883294] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8259, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:13:29.896362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:30.031311] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042410031306, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:13:30.038173] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042410038170, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007717, add_bytes: 0 [2024-09-11 16:13:30.083624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:30.083670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:30.083678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:30.083687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:30.096481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:30.284018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:30.284065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:30.284074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:30.284084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:30.296595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:30.318927] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:30.484397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:30.484441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:30.484449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:30.484458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:30.496713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:30.684793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:30.684833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:30.684841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:30.684852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:30.696898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:30.801042] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:30.885184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:30.885227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:30.885235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:30.885244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:30.897095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:31.038925] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042411038922, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:13:31.045744] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042411045741, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007571, add_bytes: 0 [2024-09-11 16:13:31.085551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:31.085598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:31.085624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:31.085635] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:31.097305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:31.285960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:31.286003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:31.286010] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:31.286019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:31.297491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:31.319155] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:31.486356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:31.486400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:31.486408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:31.486417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:31.502030] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4357, replace_start_pos=2800000, replace_num=100000) [2024-09-11 16:13:31.502077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:31.686715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:31.686761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:31.686769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:31.686796] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:31.702222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:31.802133] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:31.887048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:31.887092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:31.887120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:31.887129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:31.895607] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8464, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:13:31.902414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:32.046607] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042412046602, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:13:32.053373] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042412053369, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:13:32.095975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:32.096017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:32.096025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:32.096034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:32.102598] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:32.166087] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:32.166139] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:32.166221] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=143, max_check_version=144, global_version=145) [2024-09-11 16:13:32.168249] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2027 [2024-09-11 16:13:32.168309] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:32.168344] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:13:32.168390] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:13:32.168475] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:32.168582] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:13:32.168641] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:13:32.168652] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:13:32.168663] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:13:32.168699] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:13:32.168763] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:13:32.168782] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:13:32.296363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:32.296408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:32.296416] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:32.296425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:32.302724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:32.319277] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:32.496670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:32.496714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:32.496721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:32.496730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:32.502844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:32.697006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:32.697052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:32.697059] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:32.697069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:32.702970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:32.803288] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:32.897330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:32.897376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:32.897384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:32.897410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:32.903088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:33.054225] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042413054220, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:13:33.060984] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042413060980, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:13:33.097659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:33.097709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:33.097717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:33.097726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:33.103259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:33.297982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:33.298025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:33.298033] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:33.298042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:33.303375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:33.319463] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:33.498275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:33.498319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:33.498326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:33.498352] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:33.503590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:33.698592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:33.698638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:33.698645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:33.698654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:33.708209] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4423, replace_start_pos=2900000, replace_num=100000) [2024-09-11 16:13:33.708258] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:33.804239] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:33.898884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:33.898953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:33.898961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:33.898970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:33.907455] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8472, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:13:33.908435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:34.061798] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042414061794, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 16:13:34.068648] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042414068644, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:13:34.107782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:34.107827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:34.107835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:34.107845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:34.108552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:34.308148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:34.308195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:34.308203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:34.308212] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:34.308767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:34.319640] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:34.508509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:34.508553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:34.508561] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:34.508570] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:34.508938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:34.708819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:34.708866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:34.708875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:34.708884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:34.709110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:34.905060] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:34.909182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:34.909214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:34.909222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:34.909231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:34.909283] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:35.069392] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726042415069387, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:13:35.076169] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042415076165, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007521, add_bytes: 0 [2024-09-11 16:13:35.109489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:35.109536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:35.109530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:35.109545] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:35.109570] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:35.309642] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:35.309927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:35.309961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:35.309969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:35.309978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:35.319764] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:35.509771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:35.510269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:35.510302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:35.510325] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:35.510338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:35.709934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:35.710694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:35.710727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:35.710734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:35.710743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:35.905942] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:35.911082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:35.911119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:35.911128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:35.911138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:35.914331] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4193, replace_start_pos=3000000, replace_num=100000) [2024-09-11 16:13:35.914368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:35.919700] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8549, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:13:36.077069] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042416077064, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:13:36.083829] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042416083825, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007660, add_bytes: 0 [2024-09-11 16:13:36.114459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:36.120062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:36.120101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:36.120109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:36.120118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:36.314594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:36.319969] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:36.320349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:36.320366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:36.320372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:36.320382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:36.514779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:36.520703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:36.520738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:36.520747] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:36.520756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:36.714923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:36.721073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:36.721119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:36.721127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:36.721137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:36.906686] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:36.915109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:36.921382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:36.921426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:36.921435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:36.921445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:37.084613] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042417084609, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:13:37.091449] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042417091445, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:13:37.115235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:37.121745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:37.121784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:37.121793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:37.121802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:37.315371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:37.320118] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:37.322056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:37.322084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:37.322092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:37.322102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:37.515483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:37.522332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:37.522372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:37.522379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:37.522389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:37.715615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:37.722640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:37.722683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:37.722714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:37.722724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:37.907952] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:37.915747] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:37.923064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:37.923109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:37.923116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:37.923126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:37.931683] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8543, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:13:38.092303] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042418092298, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:13:38.099060] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042418099057, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:13:38.119629] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3746, replace_start_pos=3100000, replace_num=100000) [2024-09-11 16:13:38.119666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:38.132025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:38.132070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:38.132078] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:38.132087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:38.319750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:38.320223] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:38.332462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:38.332506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:38.332514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:38.332540] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:38.519867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:38.532758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:38.532797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:38.532804] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:38.532811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:38.719996] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:38.733047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:38.733080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:38.733087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:38.733098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:38.909268] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:38.920182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:38.933330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:38.933362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:38.933368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:38.933378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:39.099845] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042419099841, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:13:39.106682] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042419106679, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:13:39.120311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:39.133725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:39.133769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:39.133803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:39.133814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:39.320333] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:39.320494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:39.334121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:39.334165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:39.334173] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:39.334183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:39.520687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:39.534420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:39.534459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:39.534465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:39.534473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:39.720802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:39.734784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:39.734829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:39.734836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:39.734845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:39.910331] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:39.920943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:39.935179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:39.935221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:39.935230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:39.935254] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:39.943830] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8561, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:13:40.107547] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042420107543, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007702, add_bytes: 0 [2024-09-11 16:13:40.114291] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042420114287, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:13:40.121062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:40.144169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:40.144216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:40.144224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:40.144234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:40.320537] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:40.325176] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3979, replace_start_pos=3200000, replace_num=100000) [2024-09-11 16:13:40.325219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:40.344538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:40.344584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:40.344592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:40.344601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:40.525385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:40.544833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:40.544874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:40.544882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:40.544891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:40.725593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:40.745260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:40.745300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:40.745309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:40.745319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:40.911519] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:40.925777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:40.945626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:40.945671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:40.945679] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:40.945689] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:41.115110] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042421115106, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:13:41.121840] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042421121837, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:13:41.125968] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:41.146021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:41.146065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:41.146073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:41.146082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:41.320691] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=82] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:41.326074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:41.346382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:41.346418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:41.346426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:41.346435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:41.526181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:41.546668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:41.546709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:41.546717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:41.546726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:41.726293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:41.747046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:41.747090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:41.747098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:41.747109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:41.912773] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:41.926413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:41.947350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:41.947392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:41.947400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:41.947408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:41.955943] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8522, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:13:42.122708] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726042422122703, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:13:42.126535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:42.129575] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042422129572, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007735, add_bytes: 0 [2024-09-11 16:13:42.156281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:42.156327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:42.156335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:42.156345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:42.184296] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:42.184352] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:42.184437] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=144, max_check_version=145, global_version=146) [2024-09-11 16:13:42.186456] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2019 [2024-09-11 16:13:42.186494] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:42.186530] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:13:42.186597] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:13:42.186683] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:42.186791] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:13:42.186843] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:13:42.186858] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:13:42.186869] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:13:42.186919] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:13:42.186981] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:13:42.187003] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:13:42.320920] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:42.326647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:42.356644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:42.356687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:42.356694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:42.356703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:42.356945] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=76, refresh_score_time=60, wash_time=0) [2024-09-11 16:13:42.530332] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3554, replace_start_pos=3300000, replace_num=100000) [2024-09-11 16:13:42.530384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:42.557248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:42.557289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:42.557297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:42.557307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:42.730480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:42.757608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:42.757655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:42.757663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:42.757673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:42.914157] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:42.930600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:42.958002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:42.958045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:42.958053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:42.958062] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:43.130334] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042423130330, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:13:43.130729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:43.137090] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042423137085, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007513, add_bytes: 0 [2024-09-11 16:13:43.158388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:43.158433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:43.158440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:43.158450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:43.321043] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:43.330840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:43.358690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:43.358737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:43.358745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:43.358753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:43.530958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:43.559073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:43.559112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:43.559121] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:43.559130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:43.731076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:43.759455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:43.759498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:43.759506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:43.759516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:43.915424] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:43.931189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:43.959807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:43.959852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:43.959859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:43.959870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:43.968456] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8573, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:13:44.131305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:44.137955] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042424137952, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:13:44.144769] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042424144765, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:13:44.168771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:44.168818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:44.168826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:44.168836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:44.321155] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:44.331444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:44.369049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:44.369095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:44.369118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:44.369125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:44.531563] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:44.569442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:44.569490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:44.569498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:44.569507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:44.735338] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3643, replace_start_pos=3400000, replace_num=100000) [2024-09-11 16:13:44.735384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:44.769741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:44.769776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:44.769784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:44.769793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:44.916626] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:44.935473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:44.970085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:44.970129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:44.970137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:44.970146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:45.135600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:45.145549] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042425145545, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:13:45.152326] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042425152323, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:13:45.170383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:45.170421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:45.170429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:45.170438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:45.321279] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:45.335721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:45.370729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:45.370759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:45.370766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:45.370774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:45.535843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:45.571071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:45.571115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:45.571123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:45.571133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:45.735970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:45.771424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:45.771470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:45.771498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:45.771508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:45.917475] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:45.936088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:45.971809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:45.971851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:45.971859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:45.971869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:45.980337] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8457, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:13:46.136223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:46.153231] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042426153228, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:13:46.159993] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726042426159988, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:13:46.180686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:46.180732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:46.180739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:46.180749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:46.321424] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:46.336355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:46.380982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:46.381012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:46.381018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:46.381025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:46.536524] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:46.581362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:46.581406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:46.581414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:46.581423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:46.736653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:46.781727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:46.781771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:46.781778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:46.781787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:46.918520] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:46.940912] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4126, replace_start_pos=3500000, replace_num=100000) [2024-09-11 16:13:46.940955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:46.982007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:46.982041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:46.982047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:46.982057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:47.141038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:47.160850] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042427160845, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:13:47.167609] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042427167605, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:13:47.182298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:47.182341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:47.182349] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:47.182382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:47.321548] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:47.341156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:47.382684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:47.382728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:47.382736] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:47.382745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:47.541290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:47.583055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:47.583099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:47.583108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:47.583117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:47.741409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:47.783417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:47.783460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:47.783468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:47.783477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:47.919540] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:47.941604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:47.983790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:47.983834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:47.983842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:47.983869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:47.992112] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8228, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:13:48.141722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:48.168387] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042428168384, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:13:48.175224] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042428175221, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:13:48.192454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:48.192499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:48.192508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:48.192517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:48.321722] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:48.341853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:48.392765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:48.392804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:48.392812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:48.392821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:48.541970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:48.593068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:48.593111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:48.593136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:48.593146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:48.742089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:48.793389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:48.793435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:48.793441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:48.793449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:48.920476] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:48.942206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:48.994656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:48.994696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:48.994702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:48.994711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:49.146664] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4340, replace_start_pos=3600000, replace_num=100000) [2024-09-11 16:13:49.146713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:49.176009] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042429176005, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:13:49.182772] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042429182769, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:13:49.195033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:49.195078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:49.195086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:49.195096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:49.321855] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:49.346800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:49.395401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:49.395446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:49.395454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:49.395463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:49.546983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:49.595785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:49.595829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:49.595837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:49.595847] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:49.747107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:49.796077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:49.796115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:49.796122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:49.796132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:49.921700] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:49.947241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:49.996361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:49.996403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:49.996411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:49.996420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:50.003478] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7044, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:13:50.147361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:50.183632] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042430183627, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:13:50.190448] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042430190445, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:13:50.203747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:50.203803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:50.203812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:50.203821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:50.321967] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:50.347498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:50.404120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:50.404166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:50.404175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:50.404185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:50.547638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:50.604412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:50.604449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:50.604456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:50.604465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:50.747827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:50.804783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:50.804831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:50.804839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:50.804848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:50.922696] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:50.947945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:51.005143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:51.005181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:51.005189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:51.005199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:51.148067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:51.191317] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042431191313, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:13:51.198075] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042431198071, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:13:51.205437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:51.205479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:51.205487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:51.205497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:51.322216] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:51.352293] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4108, replace_start_pos=3700000, replace_num=100000) [2024-09-11 16:13:51.352335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:51.405724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:51.405766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:51.405790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:51.405799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:51.552425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:51.606049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:51.606093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:51.606100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:51.606109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:51.752552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:51.806325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:51.806367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:51.806374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:51.806381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:51.923508] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:51.952686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:52.006614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:52.006652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:52.006659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:52.006668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:52.014123] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7423, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:13:52.152812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:52.198953] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042432198949, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:13:52.201194] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:52.201250] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=55] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:13:52.201325] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=145, max_check_version=146, global_version=147) [2024-09-11 16:13:52.203030] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1706 [2024-09-11 16:13:52.203065] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:52.203097] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:13:52.203132] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:13:52.203210] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:13:52.203307] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:13:52.203353] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:13:52.203364] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:13:52.203374] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:13:52.203411] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:13:52.203460] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:13:52.203479] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:13:52.205616] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042432205614, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:13:52.214435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:52.214469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:52.214476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:52.214484] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:52.322351] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:52.352940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:52.414726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:52.414770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:52.414777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:52.414804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:52.553145] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:52.615048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:52.615092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:52.615099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:52.615108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:52.753394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:52.815314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:52.815358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:52.815364] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:52.815372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:52.924573] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:52.953527] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:53.015577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:53.015611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:53.015619] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:53.015627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:53.153658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:53.206539] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042433206535, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007586, add_bytes: 0 [2024-09-11 16:13:53.213243] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042433213239, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:13:53.215854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:53.215885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:53.215892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:53.215942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:53.322485] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:53.353777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:53.416175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:53.416217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:53.416224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:53.416233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:53.558271] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4368, replace_start_pos=3800000, replace_num=100000) [2024-09-11 16:13:53.558318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:53.616455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:53.616494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:53.616500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:53.616508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:53.758402] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:53.816731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:53.816770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:53.816776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:53.816799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:53.958586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:54.017035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:54.017079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:54.017086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:54.017095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:54.025192] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8082, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:13:54.025575] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:54.158723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:54.214111] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042434214107, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 16:13:54.220918] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042434220916, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:13:54.225516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:54.225549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:54.225556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:54.225563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:54.322592] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:54.358850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:54.425790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:54.425837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:54.425846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:54.425855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:54.558960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:54.626182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:54.626223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:54.626232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:54.626241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:54.759096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:54.826471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:54.826516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:54.826524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:54.826533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:54.959208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:55.026387] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:55.026827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:55.026861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:55.026869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:55.026879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:55.159311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:55.221712] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042435221709, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:13:55.227158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:55.227196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:55.227206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:55.227221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:55.228475] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042435228473, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:13:55.322773] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:55.359431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:55.427461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:55.427503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:55.427510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:55.427520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:55.559539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:55.627748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:55.627792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:55.627799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:55.627808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:55.763311] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3660, replace_start_pos=3900000, replace_num=100000) [2024-09-11 16:13:55.763361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:55.828065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:55.828103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:55.828111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:55.828120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:55.963443] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:56.027545] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:56.028346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:56.028378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:56.028385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:56.028394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:56.037010] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8584, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:13:56.163578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:56.229395] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042436229391, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:13:56.236153] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042436236149, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:13:56.237344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:56.237376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:56.237384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:56.237394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:56.322928] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=96] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:56.363702] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:56.437695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:56.437739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:56.437747] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:56.437757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:56.563817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:56.638010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:56.638052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:56.638060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:56.638085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:56.764002] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:56.838376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:56.838438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:56.838448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:56.838458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:56.964131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:57.028817] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:57.038716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:57.038752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:57.038759] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:57.038768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:57.164254] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:57.236943] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726042437236940, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:13:57.239028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:57.239064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:57.239071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:57.239081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:57.243822] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042437243819, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:13:57.323171] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:57.364392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:57.439301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:57.439348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:57.439372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:57.439382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:57.564512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:57.639605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:57.639648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:57.639657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:57.639667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:57.764634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:13:57.839927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:57.839972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:57.839981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:57.839991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:57.969189] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4376, replace_start_pos=4000000, replace_num=100000) [2024-09-11 16:13:57.969236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:13:58.030271] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=113] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:58.040217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:58.040258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:58.040265] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:58.040275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:58.047278] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6990, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:13:58.169383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:13:58.244632] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042438244629, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:13:58.247597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:58.247630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:58.247638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:58.247648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:58.247830] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:13:58.251384] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042438251380, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:13:58.323347] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:58.369520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:13:58.448135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:58.448181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:58.448189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:58.448199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:58.569636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:13:58.648406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:58.648440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:58.648447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:58.648455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:58.769751] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:13:58.848761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:58.848805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:58.848813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:58.848823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:58.969866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:13:59.031467] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:13:59.049069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:59.049102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:59.049111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:59.049121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:59.170008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:13:59.249387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:59.249439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:59.249450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:59.249464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:59.252171] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042439252167, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007538, add_bytes: 0 [2024-09-11 16:13:59.259002] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042439258998, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:13:59.323475] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:13:59.370189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:13:59.449770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:59.449815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:59.449823] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:59.449851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:59.570314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:13:59.650083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:59.650125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:59.650132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:59.650141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:59.770440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:13:59.850483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:13:59.850527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:13:59.850535] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:13:59.850545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:13:59.970556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:00.032625] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:00.050777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:00.050825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:00.050831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:00.050838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:00.057480] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6629, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:14:00.175082] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4403, replace_start_pos=4100000, replace_num=100000) [2024-09-11 16:14:00.175130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:00.253846] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:14:00.257817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:00.257856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:00.257865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:00.257876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:00.259855] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042440259852, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:14:00.259882] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:14:00.264221] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:14:00.266613] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042440266611, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:14:00.266643] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:14:00.323641] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=28] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:00.375305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:00.458179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:00.458223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:00.458231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:00.458241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:00.575482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:00.658541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:00.658586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:00.658595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:00.658621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:00.775618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:00.858946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:00.858991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:00.858999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:00.859008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:00.975732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:01.033838] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=140] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:01.059250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:01.059294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:01.059302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:01.059311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:01.175846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:01.259555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:01.259612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:01.259621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:01.259631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:01.267397] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042441267393, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:14:01.274181] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042441274177, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:14:01.323872] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:01.376042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:01.459951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:01.460006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:01.460014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:01.460023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:01.576176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:01.660273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:01.660319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:01.660326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:01.660335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:01.776298] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:01.860636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:01.860678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:01.860686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:01.860696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:01.976420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:02.034921] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=116] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:02.060967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:02.061011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:02.061019] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:02.061028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:02.069438] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8397, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:14:02.176547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:02.216431] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:02.216507] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=75] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:02.216591] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=146, max_check_version=147, global_version=148) [2024-09-11 16:14:02.218585] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1993 [2024-09-11 16:14:02.218624] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:02.218660] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:14:02.218701] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:14:02.218784] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:02.218935] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:14:02.218993] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:14:02.219005] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:14:02.219016] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:14:02.219055] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:14:02.219116] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:14:02.219138] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:14:02.269698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:02.269740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:02.269748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:02.269757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:02.275021] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042442275017, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:14:02.281848] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042442281845, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:14:02.324023] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:02.381133] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4392, replace_start_pos=4200000, replace_num=100000) [2024-09-11 16:14:02.381186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:02.470075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:02.470120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:02.470147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:02.470157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:02.581288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:02.670496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:02.670549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:02.670558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:02.670567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:02.670782] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=87, refresh_score_time=63, wash_time=0) [2024-09-11 16:14:02.781419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:02.871090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:02.871135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:02.871143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:02.871153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:02.981535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:03.036015] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:03.071455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:03.071501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:03.071509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:03.071518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:03.181664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:03.271749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:03.271794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:03.271819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:03.271829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:03.282642] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042443282639, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:14:03.289461] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042443289458, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:14:03.324160] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:03.381860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:03.472131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:03.472175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:03.472184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:03.472194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:03.582008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:03.672500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:03.672548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:03.672557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:03.672567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:03.782130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:03.872868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:03.872933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:03.872959] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:03.872969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:03.982250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:04.037187] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:04.073307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:04.073351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:04.073359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:04.073369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:04.081978] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8593, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:14:04.182379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:04.282309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:04.282353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:04.282362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:04.282372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:04.290257] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042444290254, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:14:04.297082] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042444297078, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:14:04.324274] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:04.382615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:04.482665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:04.482703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:04.482711] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:04.482720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:04.587142] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4382, replace_start_pos=4300000, replace_num=100000) [2024-09-11 16:14:04.587191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:04.682994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:04.683036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:04.683044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:04.683053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:04.787268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:04.883275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:04.883315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:04.883321] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:04.883329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:04.987378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:05.038499] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:05.083638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:05.083683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:05.083692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:05.083702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:05.187497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:05.283973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:05.284020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:05.284027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:05.284037] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:05.297873] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042445297868, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:14:05.304692] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042445304688, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:14:05.324445] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:05.387627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:05.484298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:05.484338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:05.484346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:05.484356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:05.587815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:05.684611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:05.684649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:05.684657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:05.684666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:05.788005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:05.885022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:05.885060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:05.885068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:05.885077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:05.988189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:06.039753] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:06.085454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:06.085501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:06.085509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:06.085535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:06.094134] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8584, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:14:06.188378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:06.294456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:06.294512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:06.294527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:06.294537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:06.305543] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042446305539, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:14:06.312306] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042446312302, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:14:06.324652] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:06.388498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:06.494835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:06.494880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:06.494889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:06.494899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:06.588678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:06.695187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:06.695230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:06.695259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:06.695269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:06.792264] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3444, replace_start_pos=4400000, replace_num=100000) [2024-09-11 16:14:06.792312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:06.895570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:06.895613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:06.895621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:06.895631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:06.992391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:07.040999] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:07.095855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:07.095896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:07.095928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:07.095938] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:07.192578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:07.296162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:07.296200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:07.296208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:07.296217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:07.313114] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042447313110, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007571, add_bytes: 0 [2024-09-11 16:14:07.319856] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042447319853, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:14:07.324878] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:07.392707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:07.496440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:07.496484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:07.496507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:07.496517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:07.592885] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:07.696758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:07.696803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:07.696811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:07.696820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:07.793042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:07.897057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:07.897100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:07.897107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:07.897116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:07.993170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:08.041912] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:08.097343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:08.097387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:08.097395] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:08.097404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:08.105947] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8531, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:14:08.193299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:08.306230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:08.306277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:08.306285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:08.306295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:08.320721] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042448320718, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:14:08.325111] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:08.327473] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042448327471, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:14:08.393488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:08.506523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:08.506565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:08.506571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:08.506580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:08.593611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:08.706812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:08.706857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:08.706864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:08.706872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:08.793724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:08.907129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:08.907169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:08.907175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:08.907183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:08.997568] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3726, replace_start_pos=4500000, replace_num=100000) [2024-09-11 16:14:08.997605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:09.042968] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:09.107409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:09.107451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:09.107457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:09.107465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:09.197790] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:09.307692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:09.307733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:09.307739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:09.307747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:09.325222] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:09.328327] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042449328325, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:14:09.335104] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042449335099, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:14:09.397973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:09.507987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:09.508027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:09.508052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:09.508061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:09.598155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:09.708292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:09.708333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:09.708339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:09.708348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:09.798278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:09.908578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:09.908622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:09.908629] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:09.908639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:09.998460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:10.043993] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:10.108867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:10.108922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:10.108929] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:10.108938] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:10.116129] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7179, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:14:10.198581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:10.316371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:10.316409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:10.316438] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:10.316448] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:10.325393] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:10.336011] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042450336007, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:14:10.342779] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042450342775, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:14:10.398704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:10.516667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:10.516709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:10.516716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:10.516725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:10.598877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:10.717070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:10.717110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:10.717119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:10.717128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:10.799023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:10.917361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:10.917416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:10.917424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:10.917433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:10.999228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:11.045255] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:11.117731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:11.117776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:11.117784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:11.117793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:11.203660] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4296, replace_start_pos=4600000, replace_num=100000) [2024-09-11 16:14:11.203705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:11.318049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:11.318098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:11.318106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:11.318115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:11.325532] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:11.343555] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042451343552, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:14:11.350314] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042451350314, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:14:11.403850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:11.518409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:11.518448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:11.518455] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:11.518462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:11.604067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:11.718770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:11.718811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:11.718819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:11.718829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:11.804204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:11.919063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:11.919113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:11.919119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:11.919128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:12.004331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:12.046059] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:12.119360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:12.119400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:12.119407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:12.119416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:12.127225] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7794, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:14:12.204445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:12.233469] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:12.233516] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:12.233589] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=147, max_check_version=148, global_version=149) [2024-09-11 16:14:12.235326] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1736 [2024-09-11 16:14:12.235381] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:12.235411] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:14:12.235444] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:14:12.235520] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:12.235607] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:14:12.235650] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:14:12.235659] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:14:12.235668] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:14:12.235700] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:14:12.235751] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:14:12.235765] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:14:12.325642] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:12.327469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:12.327496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:12.327504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:12.327514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:12.351258] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042452351253, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007701, add_bytes: 0 [2024-09-11 16:14:12.358011] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726042452358006, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:14:12.404626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:12.527751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:12.527795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:12.527802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:12.527809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:12.604765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:12.728135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:12.728181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:12.728188] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:12.728198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:12.804938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:12.928425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:12.928463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:12.928470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:12.928479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:13.005115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:13.047248] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:13.128807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:13.128849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:13.128857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:13.128865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:13.205311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:13.325787] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:13.329162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:13.329203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:13.329212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:13.329222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:13.358866] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042453358862, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:14:13.365567] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042453365563, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:14:13.409774] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4325, replace_start_pos=4700000, replace_num=100000) [2024-09-11 16:14:13.409824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:13.529586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:13.529630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:13.529638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:13.529648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:13.609920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:13.729876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:13.729936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:13.729945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:13.729955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:13.810038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:13.930254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:13.930298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:13.930307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:13.930316] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:14.010231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:14.048158] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:14.130617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:14.130659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:14.130667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:14.130677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:14.139157] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8450, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:14:14.210439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:14.325914] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:14.339390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:14.339420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:14.339426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:14.339433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:14.366413] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726042454366409, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:14:14.373184] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042454373181, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:14:14.410635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:14.539731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:14.539768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:14.539775] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:14.539785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:14.610774] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:14.740048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:14.740092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:14.740100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:14.740125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:14.810957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:14.940351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:14.940386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:14.940392] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:14.940401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:15.011091] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:15.048914] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:15.140697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:15.140742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:15.140750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:15.140759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:15.211226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:15.326083] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:15.341012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:15.341055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:15.341063] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:15.341072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:15.374039] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042455374035, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:14:15.380785] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042455380781, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:14:15.411409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:15.541378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:15.541424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:15.541448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:15.541459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:15.615637] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4086, replace_start_pos=4800000, replace_num=100000) [2024-09-11 16:14:15.615676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:15.741689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:15.741723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:15.741730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:15.741739] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:15.815756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:15.941981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:15.942016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:15.942023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:15.942032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:16.015884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:16.049804] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:16.142252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:16.142284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:16.142292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:16.142301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:16.149070] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6755, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:14:16.216018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:16.326229] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:16.349309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:16.349346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:16.349353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:16.349362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:16.381641] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042456381638, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:14:16.388422] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042456388418, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:14:16.416136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:16.549596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:16.549642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:16.549650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:16.549658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:16.616321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:16.749987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:16.750032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:16.750040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:16.750050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:16.816445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:16.950279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:16.950338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:16.950347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:16.950355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:17.016645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:17.050924] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:17.150658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:17.150702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:17.150710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:17.150719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:17.216768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:17.326378] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:17.351049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:17.351094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:17.351102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:17.351112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:17.389263] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042457389259, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:14:17.396020] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042457396016, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:14:17.416887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:17.551466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:17.551511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:17.551520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:17.551529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:17.617016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:17.751781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:17.751818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:17.751826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:17.751835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:17.821486] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4294, replace_start_pos=4900000, replace_num=100000) [2024-09-11 16:14:17.821528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:17.952135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:17.952176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:17.952184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:17.952194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:18.021695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:18.051960] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:18.152498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:18.152545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:18.152553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:18.152563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:18.160191] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7614, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:14:18.221818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:18.326505] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:18.360514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:18.360559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:18.360591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:18.360603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:18.396934] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042458396929, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:14:18.403702] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042458403698, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:14:18.421937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:18.560932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:18.560978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:18.560986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:18.560996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:18.622121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:18.761311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:18.761365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:18.761375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:18.761385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:18.822245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:18.961691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:18.961732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:18.961741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:18.961768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:19.022372] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:19.053118] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:19.162071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:19.162112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:19.162135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:19.162147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:19.222491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:19.326659] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:19.362459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:19.362505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:19.362513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:19.362522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:19.404485] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042459404481, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:14:19.411331] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042459411325, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:14:19.422608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:19.562757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:19.562806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:19.562813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:19.562821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:19.622736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:19.763064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:19.763116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:19.763124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:19.763133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:19.822860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:19.963443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:19.963486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:19.963494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:19.963504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:20.027427] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4373, replace_start_pos=5000000, replace_num=100000) [2024-09-11 16:14:20.027472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:20.054063] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:20.163808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:20.163852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:20.163861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:20.163871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:20.172049] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8163, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:14:20.227564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:20.326835] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:20.372310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:20.372350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:20.372358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:20.372366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:20.412170] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042460412165, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:14:20.418993] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042460418989, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:14:20.427688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:20.572618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:20.572656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:20.572662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:20.572670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:20.627811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:20.772897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:20.772966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:20.772974] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:20.772982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:20.827996] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:20.973277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:20.973321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:20.973329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:20.973338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:21.028187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:21.055200] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:21.173559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:21.173601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:21.173609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:21.173618] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:21.228344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:21.327014] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=93] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:21.373955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:21.374012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:21.374027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:21.374036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:21.419785] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042461419780, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:14:21.426489] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042461426485, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007496, add_bytes: 0 [2024-09-11 16:14:21.428497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:21.574269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:21.574312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:21.574320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:21.574329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:21.628679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:21.774633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:21.774678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:21.774686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:21.774696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:21.828807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:21.974998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:21.975040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:21.975047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:21.975056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:22.028937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:22.056368] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:22.175361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:22.175402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:22.175410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:22.175420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:22.183235] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7801, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:14:22.232768] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3638, replace_start_pos=5100000, replace_num=100000) [2024-09-11 16:14:22.232821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:22.250409] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:22.250466] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=55] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:22.250534] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=148, max_check_version=149, global_version=150) [2024-09-11 16:14:22.252247] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1712 [2024-09-11 16:14:22.252317] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=55] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:22.252351] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:14:22.252385] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:14:22.252463] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:22.252548] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:14:22.252602] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:14:22.252612] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:14:22.252622] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:14:22.252655] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:14:22.252706] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:14:22.252724] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:14:22.327198] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:22.383550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:22.383592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:22.383600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:22.383610] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:22.427344] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042462427340, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:14:22.432927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:22.434166] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042462434163, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:14:22.583848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:22.583891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:22.583898] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:22.583937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:22.633052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:22.784177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:22.784225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:22.784234] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:22.784243] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:22.833204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:22.984507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:22.984550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:22.984557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:22.984566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:22.984779] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=76, refresh_score_time=61, wash_time=0) [2024-09-11 16:14:23.033331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:23.057377] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:23.185078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:23.185122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:23.185131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:23.185141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:23.233453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:23.327341] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:23.385376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:23.385421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:23.385429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:23.385438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:23.433575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:23.434951] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042463434949, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:14:23.441785] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042463441782, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:14:23.585688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:23.585737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:23.585763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:23.585772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:23.633701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:23.786043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:23.786089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:23.786097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:23.786106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:23.833825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:23.986314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:23.986347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:23.986353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:23.986361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:24.033951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:24.058700] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:24.186597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:24.186640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:24.186647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:24.186656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:24.194489] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7820, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:14:24.234120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:24.327474] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:24.394812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:24.394873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:24.394881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:24.394891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:24.438770] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4458, replace_start_pos=5200000, replace_num=100000) [2024-09-11 16:14:24.438822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:24.442637] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726042464442635, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:14:24.449349] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042464449345, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:14:24.595223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:24.595269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:24.595277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:24.595287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:24.638921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:24.795516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:24.795557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:24.795564] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:24.795573] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:24.839043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:24.995818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:24.995861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:24.995868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:24.995877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:25.039189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:25.059877] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:25.196189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:25.196236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:25.196245] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:25.196255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:25.239302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:25.327663] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:25.396566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:25.396614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:25.396623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:25.396632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:25.439416] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:25.450196] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042465450193, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:14:25.457014] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042465457011, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:14:25.596953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:25.596996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:25.597004] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:25.597013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:25.639594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:25.797263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:25.797306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:25.797313] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:25.797323] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:25.839717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:25.997569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:25.997612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:25.997620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:25.997630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:26.039835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:26.060874] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=98] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:26.197951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:26.197993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:26.198001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:26.198010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:26.205608] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7583, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:14:26.239956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:26.327875] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:26.405871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:26.405944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:26.405954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:26.405963] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:26.440071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:26.457812] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042466457808, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:14:26.464570] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042466464566, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:14:26.606345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:26.606391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:26.606400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:26.606409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:26.644534] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4351, replace_start_pos=5300000, replace_num=100000) [2024-09-11 16:14:26.644581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:26.806652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:26.806698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:26.806706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:26.806715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:26.844665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:27.007050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:27.007093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:27.007100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:27.007128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:27.044788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:27.061924] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:27.207364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:27.207410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:27.207436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:27.207445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:27.244913] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:27.328097] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:27.407671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:27.407713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:27.407720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:27.407728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:27.445028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:27.465491] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042467465487, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:14:27.472240] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042467472237, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:14:27.607976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:27.608009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:27.608015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:27.608023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:27.645139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:27.808248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:27.808307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:27.808320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:27.808332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:27.845252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:28.008558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:28.008601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:28.008607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:28.008616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:28.045425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:28.063212] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:28.208840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:28.208878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:28.208884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:28.208891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:28.217228] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8311, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:14:28.245537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:28.328319] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:28.417478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:28.417520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:28.417527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:28.417537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:28.417723] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:14:28.445655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:28.473098] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042468473094, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:14:28.479862] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042468479858, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:14:28.617987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:28.618027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:28.618034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:28.618042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:28.645765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:28.818278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:28.818318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:28.818325] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:28.818333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:28.849663] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3790, replace_start_pos=5400000, replace_num=100000) [2024-09-11 16:14:28.849700] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:29.018656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:29.018700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:29.018708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:29.018717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:29.049788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:29.064353] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:29.219079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:29.219126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:29.219134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:29.219166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:29.249876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:29.331488] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=3095] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:29.419398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:29.419442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:29.419449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:29.419458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:29.450027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:29.480653] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042469480648, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:14:29.487474] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726042469487471, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:14:29.619700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:29.619745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:29.619753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:29.619762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:29.650134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:29.820013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:29.820050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:29.820057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:29.820088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:29.850240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:30.020327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:30.020362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:30.020370] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:30.020380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:30.050359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:30.065177] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:30.220624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:30.220666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:30.220673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:30.220683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:30.228324] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7628, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:14:30.250473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:30.331605] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:30.428571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:30.428617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:30.428624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:30.428633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:30.450584] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:30.488285] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042470488281, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:14:30.495095] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042470495090, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:14:30.628964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:30.629007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:30.629015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:30.629024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:30.650770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:30.829331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:30.829376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:30.829384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:30.829395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:30.850957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:31.029698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:31.029745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:31.029754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:31.029764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:31.054857] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3776, replace_start_pos=5500000, replace_num=100000) [2024-09-11 16:14:31.054898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:31.066389] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:31.230013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:31.230057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:31.230064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:31.230074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:31.254999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:31.331764] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:31.430306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:31.430347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:31.430354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:31.430363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:31.455136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:31.495957] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042471495953, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:14:31.502725] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042471502721, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:14:31.630591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:31.630634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:31.630641] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:31.630650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:31.655253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:31.830885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:31.830940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:31.830948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:31.830957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:31.855358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:32.031294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:32.031338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:32.031346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:32.031356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:32.055483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:32.067470] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:32.231660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:32.231703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:32.231710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:32.231719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:32.238231] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6500, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:14:32.255602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:32.265627] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:32.265670] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:32.265752] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=149, max_check_version=150, global_version=151) [2024-09-11 16:14:32.267770] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2019 [2024-09-11 16:14:32.267803] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:32.267838] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:14:32.267913] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:14:32.268000] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:32.268108] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:14:32.268158] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:14:32.268173] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:14:32.268184] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:14:32.268221] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:14:32.268282] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:14:32.268304] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:14:32.331889] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:32.438547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:32.438627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:32.438641] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:32.438653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:32.455725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:32.503562] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042472503558, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:14:32.510278] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042472510274, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:14:32.638893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:32.638959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:32.638967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:32.638976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:32.655852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:32.839276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:32.839321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:32.839329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:32.839339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:32.856085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:33.039684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:33.039749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:33.039758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:33.039768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:33.056207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:33.068658] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:33.239991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:33.240027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:33.240035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:33.240044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:33.260732] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4408, replace_start_pos=5600000, replace_num=100000) [2024-09-11 16:14:33.260782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:33.332098] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:33.440294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:33.440338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:33.440346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:33.440355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:33.460969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:33.511140] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042473511136, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007578, add_bytes: 0 [2024-09-11 16:14:33.517898] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042473517894, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:14:33.640603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:33.640650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:33.640658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:33.640667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:33.661097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:33.840934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:33.840970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:33.840977] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:33.840986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:33.861317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:34.041305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:34.041350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:34.041358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:34.041368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:34.061487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:34.069877] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:34.241670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:34.241713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:34.241722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:34.241731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:34.249197] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7451, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:14:34.261622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:34.332230] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:34.449528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:34.449580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:34.449589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:34.449620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:34.461745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:34.518857] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042474518852, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007716, add_bytes: 0 [2024-09-11 16:14:34.525556] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042474525552, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007658, add_bytes: 0 [2024-09-11 16:14:34.649971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:34.650014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:34.650020] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:34.650028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:34.661922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:34.850327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:34.850373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:34.850381] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:34.850390] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:34.862103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:35.050612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:35.050651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:35.050659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:35.050668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:35.062290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:35.071038] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:35.251054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:35.251090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:35.251098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:35.251125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:35.262473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:35.332436] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:35.451426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:35.451470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:35.451478] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:35.451488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:35.467094] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4436, replace_start_pos=5700000, replace_num=100000) [2024-09-11 16:14:35.467145] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:35.526353] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726042475526349, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007497, add_bytes: 0 [2024-09-11 16:14:35.533181] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042475533178, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:14:35.651786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:35.651831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:35.651839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:35.651849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:35.667331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:35.852165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:35.852228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:35.852235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:35.852245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:35.867467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:36.052453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:36.052487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:36.052493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:36.052501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:36.067588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:36.072063] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:36.252743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:36.252788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:36.252795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:36.252804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:36.260276] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7459, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:14:36.267775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:36.332652] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:36.460525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:36.460557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:36.460564] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:36.460573] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:36.467900] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:36.534024] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042476534021, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:14:36.540744] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042476540740, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:14:36.660875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:36.660940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:36.660950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:36.660960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:36.668104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:36.861174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:36.861208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:36.861215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:36.861223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:36.868234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:37.061444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:37.061486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:37.061494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:37.061503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:37.068352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:37.072931] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:37.261753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:37.261801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:37.261810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:37.261821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:37.268467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:37.332863] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:37.462059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:37.462095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:37.462102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:37.462111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:37.468603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:37.541642] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042477541638, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:14:37.548402] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042477548399, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007659, add_bytes: 0 [2024-09-11 16:14:37.662344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:37.662390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:37.662398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:37.662407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:37.673138] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4409, replace_start_pos=5800000, replace_num=100000) [2024-09-11 16:14:37.673184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:37.862707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:37.862756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:37.862764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:37.862774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:37.873329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:38.063042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:38.063087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:38.063095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:38.063104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:38.073466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:38.073917] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:38.263399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:38.263443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:38.263451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:38.263460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:38.271217] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7742, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:14:38.273575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:38.333071] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:38.471468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:38.471512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:38.471520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:38.471529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:38.473685] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:38.549214] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042478549210, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 16:14:38.555948] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042478555945, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:14:38.671753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:38.671817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:38.671825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:38.671833] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:38.673865] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:38.872058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:38.872100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:38.872108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:38.872117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:38.874000] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:39.072428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:39.072474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:39.072482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:39.072492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:39.074118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:39.074860] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:39.272788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:39.272832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:39.272840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:39.272851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:39.274234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:39.333208] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:39.473153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:39.473199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:39.473232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:39.473244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:39.474336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:39.556872] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042479556869, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007659, add_bytes: 0 [2024-09-11 16:14:39.563586] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042479563581, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:14:39.673547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:39.673590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:39.673599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:39.673608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:39.674448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:39.873848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:39.873890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:39.873898] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:39.873927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:39.878997] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4433, replace_start_pos=5900000, replace_num=100000) [2024-09-11 16:14:39.879033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:40.074181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:40.074250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:40.074259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:40.074268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:40.075877] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:40.079192] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:40.274511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:40.274558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:40.274567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:40.274577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:40.279319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:40.282370] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7781, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:14:40.333323] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:40.479441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:40.482681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:40.482715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:40.482723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:40.482732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:40.564435] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1726042480564431, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:14:40.571254] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042480571250, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:14:40.679617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:40.683050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:40.683081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:40.683089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:40.683118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:40.879801] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:40.883411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:40.883444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:40.883452] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:40.883461] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:41.076945] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:41.079934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:41.083780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:41.083811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:41.083819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:41.083829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:41.280041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:41.284072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:41.284102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:41.284109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:41.284118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:41.333475] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:41.480286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:41.484346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:41.484386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:41.484394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:41.484424] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:41.572111] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042481572108, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:14:41.578915] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042481578896, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007646, add_bytes: 0 [2024-09-11 16:14:41.680408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:41.684665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:41.684698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:41.684706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:41.684715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:41.880591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:41.884970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:41.885009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:41.885016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:41.885025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:42.077980] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:42.084209] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3499, replace_start_pos=6000000, replace_num=100000) [2024-09-11 16:14:42.084246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:42.085267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:42.085294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:42.085303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:42.085312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:42.281450] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:42.281502] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:42.281608] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] update_check_range(min_check_version=150, max_check_version=151, global_version=152) [2024-09-11 16:14:42.283636] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2027 [2024-09-11 16:14:42.283674] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:42.283709] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:14:42.283747] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:14:42.283831] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:42.283967] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:14:42.284023] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:14:42.284035] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:14:42.284046] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:14:42.284083] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:14:42.284148] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:14:42.284170] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:14:42.284325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:42.285610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:42.285637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:42.285645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:42.285655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:42.293556] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7889, clean_start_pos=0, clean_num=200000) [2024-09-11 16:14:42.333589] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:42.484440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:42.493871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:42.493934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:42.493943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:42.493953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:42.579665] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042482579662, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:14:42.586480] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042482586477, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007581, add_bytes: 0 [2024-09-11 16:14:42.684624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:42.694286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:42.694331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:42.694339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:42.694349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:42.884822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:42.894644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:42.894686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:42.894694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:42.894703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:43.078719] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:43.084935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:43.095027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:43.095061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:43.095068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:43.095077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:43.285045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:43.295402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:43.295449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:43.295458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:43.295488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:43.295711] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash time detail, (compute_wash_size_time=105, refresh_score_time=64, wash_time=0) [2024-09-11 16:14:43.333724] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:43.485237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:43.496038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:43.496082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:43.496090] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:43.496099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:43.587361] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042483587358, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 16:14:43.594038] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042483594034, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:14:43.685354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:43.696406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:43.696447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:43.696455] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:43.696465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:43.885477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:43.896777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:43.896823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:43.896853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:43.896864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:44.079537] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:44.085589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:44.097172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:44.097217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:44.097225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:44.097235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:44.290096] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4376, replace_start_pos=6100000, replace_num=100000) [2024-09-11 16:14:44.290142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:44.297477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:44.297508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:44.297515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:44.297524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:44.305246] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7709, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:14:44.333841] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:44.490222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:44.505493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:44.505532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:44.505539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:44.505548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:44.594963] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042484594959, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:14:44.601771] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042484601767, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007733, add_bytes: 0 [2024-09-11 16:14:44.690335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:44.705782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:44.705816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:44.705824] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:44.705833] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:44.890455] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:44.906075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:44.906117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:44.906125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:44.906133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:45.080768] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:45.090566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:45.106464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:45.106511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:45.106520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:45.106530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:45.290694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:45.306842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:45.306886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:45.306894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:45.306929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:45.333966] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:45.490815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:45.507263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:45.507307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:45.507316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:45.507325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:45.602577] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726042485602573, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:14:45.609286] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042485609282, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007515, add_bytes: 0 [2024-09-11 16:14:45.690990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:45.707637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:45.707683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:45.707691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:45.707701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:45.891115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:45.908036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:45.908082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:45.908089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:45.908098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:46.082073] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:46.091227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:46.108434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:46.108479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:46.108488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:46.108515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:46.291336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:46.308754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:46.308800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:46.308808] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:46.308817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:46.316689] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7859, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:14:46.334129] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=86] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:46.495923] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4412, replace_start_pos=6200000, replace_num=100000) [2024-09-11 16:14:46.495971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:46.516985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:46.517030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:46.517038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:46.517047] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:46.610128] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042486610123, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:14:46.616957] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042486616953, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:14:46.696050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:46.717367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:46.717413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:46.717420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:46.717430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:46.896179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:46.917744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:46.917786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:46.917795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:46.917804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:47.083347] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:47.096292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:47.118072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:47.118114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:47.118122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:47.118131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:47.296409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:47.318379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:47.318417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:47.318425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:47.318434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:47.334308] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:47.496586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:47.518663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:47.518729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:47.518737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:47.518747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:47.617820] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042487617817, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007694, add_bytes: 0 [2024-09-11 16:14:47.624567] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042487624563, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:14:47.696710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:47.718992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:47.719031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:47.719038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:47.719046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:47.896833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:47.919273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:47.919308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:47.919314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:47.919322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:48.085047] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=500] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:48.096956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:48.119545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:48.119578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:48.119584] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:48.119593] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:48.297078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:48.319820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:48.319859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:48.319867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:48.319885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:48.328379] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8477, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:14:48.334424] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:48.497212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:48.528666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:48.528707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:48.528715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:48.528724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:48.625441] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042488625437, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:14:48.632203] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042488632199, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:14:48.701819] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4419, replace_start_pos=6300000, replace_num=100000) [2024-09-11 16:14:48.701868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:48.728971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:48.729020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:48.729027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:48.729052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:48.902010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:48.929274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:48.929310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:48.929316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:48.929324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:49.085894] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:49.102133] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:49.129652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:49.129697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:49.129704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:49.129714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:49.302248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:49.330006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:49.330044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:49.330052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:49.330061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:49.334546] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:49.502373] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:49.530279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:49.530317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:49.530324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:49.530333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:49.633039] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042489633036, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:14:49.639732] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042489639730, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007531, add_bytes: 0 [2024-09-11 16:14:49.702541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:49.730558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:49.730586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:49.730594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:49.730603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:49.902668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:49.930824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:49.930859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:49.930866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:49.930875] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:50.087141] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=104] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:50.102788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:50.131090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:50.131127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:50.131134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:50.131143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:50.302891] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:50.331464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:50.331507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:50.331515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:50.331547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:50.334710] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=26] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:50.340081] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8519, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:14:50.503029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:50.540403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:50.540449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:50.540456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:50.540467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:50.640602] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042490640598, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:14:50.647410] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042490647407, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:14:50.703150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:50.740800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:50.740843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:50.740850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:50.740859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:50.907628] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4349, replace_start_pos=6400000, replace_num=100000) [2024-09-11 16:14:50.907672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:50.941107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:50.941144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:50.941152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:50.941162] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:51.088556] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:51.107777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:51.141414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:51.141482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:51.141495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:51.141506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:51.307897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:51.334926] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:51.341750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:51.341789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:51.341798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:51.341807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:51.508034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:51.542033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:51.542066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:51.542072] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:51.542079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:51.648202] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042491648198, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:14:51.654970] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042491654967, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:14:51.708152] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:51.742330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:51.742376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:51.742384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:51.742393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:51.908268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:51.942624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:51.942670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:51.942678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:51.942686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:52.090073] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:52.108389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:52.142947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:52.142989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:52.142997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:52.143006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:52.299456] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:52.299507] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:14:52.299588] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=151, max_check_version=152, global_version=153) [2024-09-11 16:14:52.301615] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2026 [2024-09-11 16:14:52.301675] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:52.301710] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:14:52.301748] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:14:52.301838] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:14:52.301962] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:14:52.302024] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:14:52.302036] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:14:52.302046] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:14:52.302083] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:14:52.302161] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:14:52.302181] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:14:52.308514] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:52.335108] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:52.343312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:52.343358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:52.343366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:52.343375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:52.351936] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8547, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:14:52.508631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:52.552259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:52.552305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:52.552314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:52.552323] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:52.655881] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042492655877, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:14:52.662652] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042492662649, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:14:52.708753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:52.752688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:52.752744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:52.752753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:52.752763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:52.908955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:52.953089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:52.953129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:52.953137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:52.953146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:53.091428] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:53.113417] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=6500000, replace_num=100000) [2024-09-11 16:14:53.113465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:53.153448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:53.153494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:53.153502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:53.153511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:53.313549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:53.335266] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:53.353754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:53.353799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:53.353806] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:53.353815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:53.513665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:53.554084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:53.554129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:53.554137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:53.554146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:53.663494] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042493663490, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:14:53.670208] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042493670205, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:14:53.713782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:53.754396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:53.754443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:53.754451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:53.754460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:53.913899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:53.954773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:53.954813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:53.954821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:53.954831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:54.092728] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:54.114027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:54.155136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:54.155180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:54.155188] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:54.155198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:54.314210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:54.335399] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:54.355522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:54.355567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:54.355575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:54.355584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:54.364130] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8533, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:14:54.514327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:54.564405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:54.564448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:54.564456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:54.564466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:54.671114] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042494671110, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:14:54.677873] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042494677870, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:14:54.714520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:54.764770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:54.764818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:54.764826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:54.764852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:54.914632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:54.965104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:54.965148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:54.965156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:54.965165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:55.093932] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:55.114756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:55.165466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:55.165515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:55.165523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:55.165533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:55.319249] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4372, replace_start_pos=6600000, replace_num=100000) [2024-09-11 16:14:55.319297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:55.335597] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:55.365836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:55.365881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:55.365889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:55.365898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:55.519390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:55.566184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:55.566225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:55.566248] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:55.566258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:55.678671] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042495678668, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:14:55.685494] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726042495685490, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:14:55.719512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:55.766501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:55.766536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:55.766543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:55.766552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:55.919630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:55.966793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:55.966837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:55.966845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:55.966855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:56.094995] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:56.119810] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:56.167104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:56.167149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:56.167156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:56.167166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:56.319927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:56.335813] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:56.367412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:56.367469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:56.367477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:56.367486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:56.374381] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6882, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:14:56.520161] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:56.574700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:56.574744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:56.574752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:56.574763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:56.686297] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042496686293, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:14:56.693049] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042496693047, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:14:56.720282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:56.775095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:56.775139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:56.775146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:56.775156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:56.920476] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:56.975409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:56.975452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:56.975460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:56.975469] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:57.096221] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:57.120614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:57.175775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:57.175824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:57.175833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:57.175843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:57.320739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:57.336009] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:57.376162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:57.376205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:57.376214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:57.376223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:57.525169] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4314, replace_start_pos=6700000, replace_num=100000) [2024-09-11 16:14:57.525218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:57.576477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:57.576521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:57.576529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:57.576538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:57.693928] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042497693925, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:14:57.700721] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042497700717, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:14:57.725362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:57.776862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:57.776934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:57.776943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:57.776953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:57.925491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:14:57.977207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:57.977252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:57.977260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:57.977270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:58.097467] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:58.125782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:14:58.177517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:58.177562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:58.177570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:58.177579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:58.325951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:14:58.336212] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:58.377887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:58.377958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:58.377969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:58.377992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:58.386473] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8467, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:14:58.526070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:14:58.586820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:58.586875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:58.586883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:58.586892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:58.587100] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:14:58.701529] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042498701525, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:14:58.708382] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042498708378, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 16:14:58.726184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:14:58.787409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:58.787454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:58.787462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:58.787472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:58.926302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:14:58.987781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:58.987834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:58.987843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:58.987853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:59.098577] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:14:59.126428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:14:59.188157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:59.188202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:59.188211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:59.188220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:59.326564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:14:59.336342] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:14:59.388477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:59.388522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:59.388529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:59.388538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:59.526694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:14:59.588864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:59.588928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:59.588938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:59.588948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:59.709141] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042499709138, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:14:59.715888] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042499715885, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007507, add_bytes: 0 [2024-09-11 16:14:59.731153] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=6800000, replace_num=100000) [2024-09-11 16:14:59.731217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:14:59.789184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:59.789218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:59.789225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:59.789234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:14:59.931305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:14:59.989477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:14:59.989522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:14:59.989529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:14:59.989539] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:00.099628] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:00.131434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:00.189792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:00.189834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:00.189841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:00.189850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:00.331572] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:00.336458] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:00.390100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:00.390143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:00.390151] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:00.390160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:00.398793] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8596, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:15:00.531687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:00.599065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:00.599112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:00.599120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:00.599129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:00.710824] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=68] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:15:00.716765] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042500716761, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:15:00.716810] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:15:00.721188] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:15:00.723569] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042500723567, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:15:00.723594] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:15:00.731864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:00.799358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:00.799401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:00.799408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:00.799415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:00.931993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:00.999646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:00.999697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:00.999704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:00.999712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:01.100615] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:01.132150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:01.200083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:01.200128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:01.200134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:01.200141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:01.332292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:01.336619] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:01.400399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:01.400452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:01.400460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:01.400470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:01.532486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:01.600715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:01.600754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:01.600762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:01.600771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:01.724367] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042501724364, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:15:01.731189] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042501731185, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:15:01.732612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:01.801088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:01.801133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:01.801141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:01.801151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:01.936385] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3672, replace_start_pos=6900000, replace_num=100000) [2024-09-11 16:15:01.936433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:02.001455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:02.001507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:02.001516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:02.001527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:02.101590] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:02.136515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:02.201758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:02.201803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:02.201809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:02.201816] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:02.316264] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:02.316316] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:02.316389] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=152, max_check_version=153, global_version=154) [2024-09-11 16:15:02.318155] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1765 [2024-09-11 16:15:02.318217] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:02.318249] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:15:02.318282] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:15:02.318360] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:02.318443] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:15:02.318497] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:15:02.318506] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:15:02.318515] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:15:02.318547] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:15:02.318599] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:15:02.318614] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:15:02.336631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:02.336735] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:02.402043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:02.402088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:02.402094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:02.402101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:02.409438] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7324, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:15:02.536777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:02.609698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:02.609737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:02.609743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:02.609751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:02.731977] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726042502731973, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:15:02.736918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:02.738746] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042502738743, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:15:02.810073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:02.810119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:02.810128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:02.810138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:02.937063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:03.010362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:03.010404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:03.010412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:03.010433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:03.102599] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:03.137271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:03.210758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:03.210803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:03.210811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:03.210820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:03.336933] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=28] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:03.337402] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:03.411044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:03.411088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:03.411094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:03.411102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:03.537507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:03.611428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:03.611474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:03.611482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:03.611492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:03.611709] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=81, refresh_score_time=63, wash_time=0) [2024-09-11 16:15:03.737688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:03.739671] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042503739669, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 16:15:03.746362] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042503746359, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:15:03.812043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:03.812088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:03.812096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:03.812106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:03.937892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:04.012354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:04.012401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:04.012408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:04.012418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:04.103601] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:04.142418] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4351, replace_start_pos=7000000, replace_num=100000) [2024-09-11 16:15:04.142475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:04.212735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:04.212779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:04.212804] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:04.212815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:04.337054] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:04.342577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:04.413068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:04.413116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:04.413124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:04.413133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:04.421172] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8025, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:15:04.542711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:04.621447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:04.621491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:04.621499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:04.621508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:04.742833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:04.747229] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042504747224, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:15:04.753977] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042504753973, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:15:04.821745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:04.821781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:04.821788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:04.821797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:04.942970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:05.022134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:05.022179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:05.022187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:05.022197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:05.104709] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:05.143088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:05.222422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:05.222464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:05.222472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:05.222481] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:05.337171] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:05.343264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:05.422729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:05.422773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:05.422781] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:05.422790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:05.543444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:05.623092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:05.623157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:05.623166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:05.623175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:05.743631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:05.754839] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042505754835, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:15:05.761599] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726042505761594, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:15:05.823472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:05.823518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:05.823526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:05.823535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:05.943763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:06.023781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:06.023827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:06.023835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:06.023845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:06.105852] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:06.143881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:06.224072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:06.224114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:06.224122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:06.224132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:06.337377] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:06.348420] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4398, replace_start_pos=7100000, replace_num=100000) [2024-09-11 16:15:06.348462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:06.424424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:06.424466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:06.424474] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:06.424484] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:06.432343] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7846, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:15:06.548544] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:06.632612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:06.632657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:06.632665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:06.632674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:06.748666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:06.762460] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042506762456, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:15:06.769213] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042506769209, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:15:06.833007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:06.833051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:06.833059] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:06.833084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:06.948795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:07.033335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:07.033378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:07.033386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:07.033395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:07.107202] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=110] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:07.148920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:07.233705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:07.233749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:07.233757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:07.233768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:07.337529] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:07.349043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:07.434075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:07.434121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:07.434128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:07.434139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:07.549153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:07.634439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:07.634484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:07.634492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:07.634522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:07.749272] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:07.770063] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042507770060, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:15:07.776831] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042507776828, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:15:07.834827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:07.834872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:07.834880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:07.834890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:07.949392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:08.035213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:08.035259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:08.035267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:08.035277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:08.108496] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:08.149522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:08.235507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:08.235548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:08.235555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:08.235564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:08.337640] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:08.349753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:08.435869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:08.435937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:08.435968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:08.435978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:08.443954] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7961, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:15:08.554217] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=7200000, replace_num=100000) [2024-09-11 16:15:08.554262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:08.644285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:08.644323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:08.644332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:08.644341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:08.754363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:08.777678] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042508777674, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:15:08.784431] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042508784427, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:15:08.844572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:08.844616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:08.844624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:08.844633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:08.954504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:09.044852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:09.044888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:09.044894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:09.044920] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:09.109819] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:09.154704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:09.245149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:09.245189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:09.245197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:09.245206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:09.337832] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:09.354836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:09.445472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:09.445516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:09.445523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:09.445533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:09.554958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:09.645854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:09.645932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:09.645943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:09.645953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:09.755083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:09.785295] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042509785290, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:15:09.792050] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042509792047, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:15:09.846300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:09.846354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:09.846365] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:09.846376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:09.955231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:10.046603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:10.046637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:10.046644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:10.046652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:10.111012] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=109] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:10.155357] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:10.246893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:10.246960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:10.246967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:10.246976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:10.338013] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:10.355479] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:10.447278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:10.447324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:10.447332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:10.447341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:10.455520] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8142, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:15:10.555626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:10.655843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:10.655886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:10.655895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:10.655924] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:10.760124] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4364, replace_start_pos=7300000, replace_num=100000) [2024-09-11 16:15:10.760172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:10.792923] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042510792919, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:15:10.799790] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042510799785, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007738, add_bytes: 0 [2024-09-11 16:15:10.856168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:10.856208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:10.856215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:10.856224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:10.960267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:11.056464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:11.056498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:11.056506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:11.056525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:11.112006] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:11.160409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:11.256810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:11.256869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:11.256877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:11.256886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:11.338179] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:11.360611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:11.457147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:11.457193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:11.457201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:11.457210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:11.560743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:11.657452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:11.657498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:11.657507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:11.657516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:11.760927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:11.800606] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042511800601, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:15:11.807283] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042511807279, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007494, add_bytes: 0 [2024-09-11 16:15:11.857756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:11.857817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:11.857825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:11.857834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:11.961057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:12.058074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:12.058115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:12.058123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:12.058133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:12.113018] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:12.161188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:12.258375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:12.258421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:12.258429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:12.258438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:12.331463] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:12.331514] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:12.331602] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=153, max_check_version=154, global_version=155) [2024-09-11 16:15:12.333326] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1724 [2024-09-11 16:15:12.333364] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:12.333418] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:15:12.333453] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:15:12.333530] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:12.333615] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:15:12.333663] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:15:12.333674] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:15:12.333684] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:15:12.333717] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:15:12.333766] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:15:12.333786] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:15:12.338305] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:12.361323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:12.458691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:12.458735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:12.458743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:12.458752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:12.467289] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8523, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:15:12.561532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:12.667540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:12.667584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:12.667592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:12.667601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:12.761655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:12.808145] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726042512808140, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:15:12.814896] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042512814892, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:15:12.867839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:12.867876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:12.867882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:12.867924] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:12.967066] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=5294, replace_start_pos=7400000, replace_num=100000) [2024-09-11 16:15:12.967104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:13.068232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:13.068277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:13.068285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:13.068295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:13.113807] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:13.167238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:13.268534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:13.268581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:13.268597] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:13.268611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:13.338432] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:13.367421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:13.468852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:13.468895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:13.468928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:13.468941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:13.567539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:13.669197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:13.669238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:13.669262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:13.669271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:13.767665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:13.815788] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042513815784, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 16:15:13.822525] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726042513822520, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:15:13.869576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:13.869620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:13.869628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:13.869637] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:13.967791] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:14.069955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:14.070001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:14.070009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:14.070019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:14.114603] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:14.167920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:14.270265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:14.270309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:14.270317] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:14.270325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:14.338547] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:14.368037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:14.470640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:14.470686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:14.470694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:14.470704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:14.477876] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7160, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:15:14.568175] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:14.678220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:14.678266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:14.678273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:14.678283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:14.768293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:14.823461] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042514823458, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:15:14.830135] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042514830131, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:15:14.878586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:14.878631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:14.878640] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:14.878649] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:14.968410] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:15.078893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:15.078958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:15.078966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:15.078975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:15.115797] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:15.172860] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4309, replace_start_pos=7500000, replace_num=100000) [2024-09-11 16:15:15.172915] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:15.279290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:15.279334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:15.279342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:15.279359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:15.338735] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:15.372998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:15.479674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:15.479718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:15.479726] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:15.479736] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:15.573115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:15.680013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:15.680058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:15.680066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:15.680075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:15.773232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:15.830998] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042515830990, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007532, add_bytes: 0 [2024-09-11 16:15:15.837759] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042515837755, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:15:15.880341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:15.880385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:15.880393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:15.880402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:15.973361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:16.080663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:16.080709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:16.080718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:16.080727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:16.116589] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:16.173497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:16.280965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:16.280998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:16.281005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:16.281013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:16.338894] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:16.373622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:16.481338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:16.481384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:16.481392] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:16.481420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:16.488827] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7392, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:15:16.573745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:16.689156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:16.689203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:16.689211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:16.689220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:16.773880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:16.838639] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042516838635, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007645, add_bytes: 0 [2024-09-11 16:15:16.845440] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042516845435, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:15:16.889443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:16.889489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:16.889495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:16.889503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:16.974029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:17.089759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:17.089812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:17.089846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:17.089857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:17.117952] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:17.174176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:17.290218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:17.290272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:17.290279] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:17.290287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:17.339018] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:17.378132] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3813, replace_start_pos=7600000, replace_num=100000) [2024-09-11 16:15:17.378177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:17.490606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:17.490652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:17.490660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:17.490671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:17.578274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:17.691012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:17.691057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:17.691065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:17.691075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:17.778465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:17.846293] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=82] PNIO [ratelimit] time: 1726042517846288, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007653, add_bytes: 0 [2024-09-11 16:15:17.852980] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042517852976, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:15:17.891371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:17.891410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:17.891418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:17.891427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:17.978606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:18.091752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:18.091796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:18.091805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:18.091814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:18.118801] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:18.178796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:18.292069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:18.292108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:18.292115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:18.292124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:18.339192] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:18.378923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:18.492356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:18.492400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:18.492407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:18.492417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:18.500987] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8557, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:15:18.579107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:18.701338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:18.701382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:18.701390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:18.701399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:18.779239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:18.853848] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042518853844, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:15:18.860600] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042518860596, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:15:18.901725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:18.901769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:18.901778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:18.901787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:18.979364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:19.102044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:19.102087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:19.102095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:19.102104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:19.119895] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:19.179558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:19.302336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:19.302374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:19.302381] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:19.302390] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:19.339334] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:19.379674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:19.502707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:19.502749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:19.502758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:19.502769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:19.584144] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4288, replace_start_pos=7700000, replace_num=100000) [2024-09-11 16:15:19.584187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:19.703032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:19.703081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:19.703089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:19.703098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:19.784279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:19.861516] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042519861513, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:15:19.868216] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042519868213, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:15:19.903413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:19.903458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:19.903487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:19.903496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:19.984420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:20.103726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:20.103770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:20.103777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:20.103787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:20.120889] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=104] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:20.184560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:20.304029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:20.304071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:20.304079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:20.304089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:20.339453] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:20.384753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:20.504321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:20.504360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:20.504368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:20.504377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:20.512947] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8557, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:15:20.584886] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:20.713267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:20.713311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:20.713337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:20.713347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:20.785054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:20.869081] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042520869076, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:15:20.875827] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042520875824, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:15:20.913586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:20.913630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:20.913638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:20.913647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:20.985194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:21.113972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:21.114018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:21.114026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:21.114035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:21.122058] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:21.185316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:21.314341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:21.314386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:21.314394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:21.314404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:21.339596] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:21.385610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:21.514711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:21.514757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:21.514765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:21.514774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:21.585826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:21.715073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:21.715118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:21.715126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:21.715136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:21.790379] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4362, replace_start_pos=7800000, replace_num=100000) [2024-09-11 16:15:21.790427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:21.876789] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042521876785, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007709, add_bytes: 0 [2024-09-11 16:15:21.883460] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042521883456, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:15:21.915467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:21.915512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:21.915521] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:21.915530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:21.990541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:22.115824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:22.115865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:22.115873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:22.115882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:22.122989] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:22.190701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:22.316110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:22.316154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:22.316161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:22.316170] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:22.339722] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:22.349638] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:22.349693] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:22.349778] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=154, max_check_version=155, global_version=156) [2024-09-11 16:15:22.351778] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1999 [2024-09-11 16:15:22.351817] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:22.351853] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:15:22.351933] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:15:22.352017] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:22.352126] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:15:22.352178] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:15:22.352193] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:15:22.352204] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:15:22.352240] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:15:22.352299] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:15:22.352324] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:15:22.390822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:22.516404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:22.516448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:22.516472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:22.516482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:22.523603] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7109, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:15:22.591005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:22.723863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:22.723934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:22.723943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:22.723952] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:22.791200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:22.884363] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042522884359, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 16:15:22.891064] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042522891059, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:15:22.924182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:22.924225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:22.924232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:22.924241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:22.991342] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:23.123728] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:23.124537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:23.124571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:23.124580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:23.124589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:23.191530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:23.324809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:23.324846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:23.324853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:23.324862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:23.339863] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:23.391741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:23.525135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:23.525174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:23.525180] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:23.525187] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:23.591958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:23.725400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:23.725443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:23.725449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:23.725457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:23.792087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:23.891918] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042523891914, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:15:23.898673] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042523898671, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:15:23.925694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:23.925739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:23.925746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:23.925755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:23.926003] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=79, refresh_score_time=80, wash_time=0) [2024-09-11 16:15:23.996619] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4414, replace_start_pos=7900000, replace_num=100000) [2024-09-11 16:15:23.996664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:24.124752] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:24.126237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:24.126271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:24.126277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:24.126287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:24.196819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:24.326514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:24.326558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:24.326565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:24.326574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:24.339998] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:24.396940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:24.526808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:24.526852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:24.526859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:24.526885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:24.534327] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7429, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:15:24.597060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:24.734652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:24.734698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:24.734705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:24.734715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:24.797173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:24.899533] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1726042524899529, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:15:24.906286] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042524906285, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:15:24.935040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:24.935081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:24.935088] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:24.935097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:24.997313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:25.126034] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:25.135404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:25.135448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:25.135456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:25.135465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:25.197452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:25.335770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:25.335838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:25.335847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:25.335857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:25.340188] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:25.397577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:25.536157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:25.536203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:25.536211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:25.536221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:25.597714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:25.736536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:25.736582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:25.736590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:25.736600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:25.797848] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:25.907152] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042525907149, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:15:25.913911] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042525913899, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:15:25.936895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:25.936978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:25.936986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:25.936995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:25.998041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:26.127068] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:26.137296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:26.137342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:26.137350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:26.137360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:26.202718] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4439, replace_start_pos=8000000, replace_num=100000) [2024-09-11 16:15:26.202769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:26.337662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:26.337708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:26.337716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:26.337727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:26.340377] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:26.402930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:26.538061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:26.538104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:26.538112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:26.538121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:26.545251] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7117, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:15:26.603111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:26.745593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:26.745638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:26.745646] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:26.745656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:26.803297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:26.914784] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042526914779, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:15:26.921609] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042526921606, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007707, add_bytes: 0 [2024-09-11 16:15:26.945982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:26.946027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:26.946035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:26.946044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:27.003507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:27.127856] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:27.146365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:27.146405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:27.146413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:27.146422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:27.203686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:27.340552] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:27.346724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:27.346766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:27.346774] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:27.346818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:27.403888] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:27.547119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:27.547163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:27.547171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:27.547180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:27.604044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=78] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:27.747424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:27.747469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:27.747477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:27.747486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:27.804166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:27.922400] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042527922395, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:15:27.929238] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042527929234, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:15:27.947735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:27.947780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:27.947787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:27.947796] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:28.004344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:28.129008] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:28.148123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:28.148167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:28.148175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:28.148207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:28.204476] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:28.340667] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:28.348499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:28.348533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:28.348540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:28.348547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:28.409265] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4607, replace_start_pos=8100000, replace_num=100000) [2024-09-11 16:15:28.409313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:28.548852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:28.548893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:28.548922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:28.548934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:28.557430] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8482, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:15:28.609466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:28.757742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:28.757786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:28.757815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:28.757826] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:28.758029] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:15:28.809600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:28.930006] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042528930002, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:15:28.936776] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042528936773, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:15:28.958333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:28.958374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:28.958381] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:28.958392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:29.009722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:29.130008] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:29.158630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:29.158674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:29.158682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:29.158691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:29.209837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:29.340794] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:29.359024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:29.359068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:29.359075] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:29.359085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:29.410024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:29.559410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:29.559459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:29.559466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:29.559475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:29.610232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:29.759704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:29.759749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:29.759756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:29.759765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:29.810355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:29.937676] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042529937671, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:15:29.944437] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042529944433, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007660, add_bytes: 0 [2024-09-11 16:15:29.960013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:29.960053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:29.960061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:29.960071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:30.010482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:30.131144] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:30.160314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:30.160357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:30.160364] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:30.160374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:30.210678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:30.340915] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:30.360621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:30.360655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:30.360663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:30.360672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:30.410860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:30.560995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:30.561042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:30.561051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:30.561061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:30.569589] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8516, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:15:30.615476] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4405, replace_start_pos=8200000, replace_num=100000) [2024-09-11 16:15:30.615525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:30.769965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:30.770007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:30.770015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:30.770042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:30.815605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:30.945232] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042530945227, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:15:30.952047] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042530952044, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:15:30.970339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:30.970381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:30.970389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:30.970398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:31.015775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:31.132062] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:31.170697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:31.170742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:31.170750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:31.170760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:31.215960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:31.341095] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=89] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:31.371014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:31.371052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:31.371059] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:31.371069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:31.416150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:31.571307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:31.571351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:31.571380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:31.571389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:31.616344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:31.771634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:31.771678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:31.771686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:31.771695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:31.816459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:31.952843] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042531952839, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:15:31.959611] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042531959607, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:15:31.972025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:31.972068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:31.972076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:31.972085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:32.016584] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:32.133082] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:32.172387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:32.172430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:32.172438] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:32.172447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:32.216766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:32.341222] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:32.368583] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:32.368646] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=62] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:32.368728] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=155, max_check_version=156, global_version=157) [2024-09-11 16:15:32.370758] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2028 [2024-09-11 16:15:32.370811] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:32.370848] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:15:32.370887] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:15:32.370985] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:32.371112] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:15:32.371163] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:15:32.371174] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:15:32.371185] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:15:32.371225] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:15:32.371285] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:15:32.371306] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:15:32.372750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:32.372785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:32.372793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:32.372803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:32.416893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:32.573139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:32.573185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:32.573193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:32.573202] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:32.581769] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8532, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:15:32.617090] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:32.782100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:32.782143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:32.782152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:32.782161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:32.820574] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3359, replace_start_pos=8300000, replace_num=100000) [2024-09-11 16:15:32.820619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:32.960474] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042532960469, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:15:32.967280] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042532967276, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:15:32.982409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:32.982454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:32.982462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:32.982471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:33.020764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:33.134225] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:33.182767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:33.182812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:33.182820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:33.182830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:33.220967] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:33.341372] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:33.383057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:33.383089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:33.383095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:33.383102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:33.421116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:33.583409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:33.583455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:33.583463] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:33.583473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:33.621319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:33.783705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:33.783751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:33.783758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:33.783768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:33.821501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:33.968078] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042533968074, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:15:33.974921] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042533974898, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:15:33.984067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:33.984133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:33.984143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:33.984156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:34.021682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:34.135451] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:34.184455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:34.184495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:34.184502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:34.184510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:34.221870] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:34.341517] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:34.384811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:34.384857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:34.384865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:34.384874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:34.422024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:34.585176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:34.585219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:34.585227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:34.585237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:34.593002] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7750, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:15:34.622146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:34.793239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:34.793275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:34.793281] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:34.793290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:34.822365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:34.975701] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042534975697, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:15:34.982515] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042534982512, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:15:34.993593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:34.993636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:34.993644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:34.993653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:35.027004] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4438, replace_start_pos=8400000, replace_num=100000) [2024-09-11 16:15:35.027055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:35.136722] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:35.193896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:35.193952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:35.193960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:35.193969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:35.227221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:35.341655] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:35.394273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:35.394319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:35.394327] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:35.394359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:35.427407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:35.594662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:35.594707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:35.594715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:35.594725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:35.627534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:35.795002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:35.795046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:35.795054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:35.795063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:35.827660] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:35.983322] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042535983317, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:15:35.990077] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042535990072, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:15:35.995365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:35.995407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:35.995415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:35.995425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:36.027853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=114] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:36.137766] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:36.195750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:36.195795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:36.195819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:36.195830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:36.227974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:36.341866] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:36.396138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:36.396182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:36.396190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:36.396200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:36.428101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:36.596503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:36.596549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:36.596557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:36.596567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:36.603500] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6921, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:15:36.628280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:36.803854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:36.803899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:36.803928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:36.803955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:36.828415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:36.990941] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042536990937, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:15:36.997678] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042536997674, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:15:37.004254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:37.004291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:37.004299] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:37.004309] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:37.028626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:37.138804] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:37.204565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:37.204610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:37.204618] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:37.204627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:37.232094] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3343, replace_start_pos=8500000, replace_num=100000) [2024-09-11 16:15:37.232138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:37.342020] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:37.404953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:37.404994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:37.405001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:37.405009] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:37.432230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:37.605360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:37.605405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:37.605413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:37.605422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:37.632376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:37.805739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:37.805783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:37.805790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:37.805799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:37.832512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:37.998548] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726042537998544, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:15:38.005362] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042538005359, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:15:38.006101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:38.006136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:38.006144] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:38.006153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:38.032697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:38.206458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:38.206519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:38.206527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:38.206537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:38.232893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:38.239678] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:38.342129] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:38.406766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:38.406807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:38.406814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:38.406823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:38.433118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:38.607147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:38.607194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:38.607201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:38.607211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:38.614543] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7318, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:15:38.633309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:38.814826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:38.814872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:38.814879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:38.814889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:38.833437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:39.006238] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042539006233, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:15:39.009463] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042539009460, bytes: 0, bw: 0.000000 MB/s, add_ts: 1004101, add_bytes: 0 [2024-09-11 16:15:39.015230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:39.015272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:39.015281] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:39.015289] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:39.033559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:39.215594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:39.215639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:39.215647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:39.215656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:39.233762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:39.240760] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:39.342264] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:39.415988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:39.416034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:39.416042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:39.416051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:39.438270] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4382, replace_start_pos=8600000, replace_num=100000) [2024-09-11 16:15:39.438319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:39.616302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:39.616360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:39.616369] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:39.616395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:39.638468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:39.816628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:39.816671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:39.816678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:39.816687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:39.838597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:40.012365] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042540012360, bytes: 0, bw: 0.000000 MB/s, add_ts: 1002900, add_bytes: 0 [2024-09-11 16:15:40.013845] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042540013843, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:15:40.016958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:40.016989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:40.016996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:40.017005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:40.038728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:40.217235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:40.217279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:40.217287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:40.217317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:40.238931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:40.241778] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:40.342385] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:40.417545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:40.417604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:40.417612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:40.417619] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:40.439084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:40.617933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:40.617975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:40.617981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:40.617989] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:40.624582] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6581, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:15:40.639203] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:40.824839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:40.824884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:40.824892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:40.824920] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:40.839320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:41.019957] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042541019952, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:15:41.021453] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042541021452, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:15:41.025219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:41.025272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:41.025280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:41.025289] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:41.039505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:41.225602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:41.225648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:41.225656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:41.225666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:41.239690] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:41.242708] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:41.342555] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=88] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:41.425936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:41.425982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:41.425990] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:41.426000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:41.439828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:41.626313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:41.626359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:41.626367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:41.626376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:41.643332] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3375, replace_start_pos=8700000, replace_num=100000) [2024-09-11 16:15:41.643380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:41.826694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:41.826737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:41.826745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:41.826755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:41.843478] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:42.027071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:42.027130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:42.027146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:42.027156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:42.027570] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042542027567, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:15:42.029099] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042542029097, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007645, add_bytes: 0 [2024-09-11 16:15:42.043605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:42.227464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:42.227508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:42.227516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:42.227525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:42.243737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:42.243840] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:42.342679] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:42.384883] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:42.384920] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=36] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:42.385016] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=156, max_check_version=157, global_version=158) [2024-09-11 16:15:42.387067] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2051 [2024-09-11 16:15:42.387106] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:42.387148] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:15:42.387189] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:15:42.387275] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:42.387394] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:15:42.387448] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:15:42.387460] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:15:42.387471] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:15:42.387511] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:15:42.387575] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:15:42.387599] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:15:42.427832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:42.427874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:42.427883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:42.427892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:42.443852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:42.628225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:42.628268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:42.628276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:42.628285] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:42.636642] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8342, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:15:42.644030] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:42.836994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:42.837041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:42.837071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:42.837080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:42.844153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:43.035219] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042543035215, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007648, add_bytes: 0 [2024-09-11 16:15:43.036681] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042543036679, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007582, add_bytes: 0 [2024-09-11 16:15:43.037385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:43.037420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:43.037428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:43.037437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:43.044331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:43.237732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:43.237773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:43.237781] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:43.237790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:43.244441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:43.245144] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:43.342826] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:43.438043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:43.438091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:43.438100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:43.438110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:43.444625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:43.638345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:43.638383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:43.638390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:43.638399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:43.644761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:43.838620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:43.838652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:43.838659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:43.838667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:43.849241] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4369, replace_start_pos=8800000, replace_num=100000) [2024-09-11 16:15:43.849281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:44.038888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:44.038948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:44.038954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:44.038962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:44.042807] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042544042804, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007589, add_bytes: 0 [2024-09-11 16:15:44.044291] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042544044289, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:15:44.049423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:44.239212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:44.239258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:44.239266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:44.239275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:44.239506] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=80, refresh_score_time=63, wash_time=0) [2024-09-11 16:15:44.249534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:44.342972] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:44.345949] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:44.439755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:44.439801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:44.439808] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:44.439818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:44.449703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:44.640062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:44.640120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:44.640128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:44.640137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:44.648691] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8539, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:15:44.649835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:44.848964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:44.849005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:44.849012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:44.849036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:44.849943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:45.049266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:45.049310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:45.049318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:45.049328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:45.050072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:45.050432] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042545050430, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:15:45.051863] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042545051862, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007573, add_bytes: 0 [2024-09-11 16:15:45.249565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:45.249610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:45.249617] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:45.249626] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:45.250258] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:45.343173] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:45.346681] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:45.449855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:45.449920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:45.449929] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:45.449939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:45.450367] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:45.650168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:45.650209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:45.650233] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:45.650242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:45.650540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:45.850482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:45.850521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:45.850527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:45.850535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:45.850651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:46.050764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:46.050802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:46.050809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:46.050818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:46.054988] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4215, replace_start_pos=8900000, replace_num=100000) [2024-09-11 16:15:46.055028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:46.058100] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042546058097, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:15:46.059469] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726042546059467, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:15:46.251090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:46.251139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:46.251146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:46.251154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:46.255130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:46.343382] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:46.347486] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:46.451388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:46.451435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:46.451443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:46.451452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:46.455229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:46.651694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:46.651734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:46.651740] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:46.651748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:46.655347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:46.660241] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8481, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:15:46.855462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:46.860501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:46.860541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:46.860548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:46.860557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:47.055583] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:47.060802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:47.060837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:47.060845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:47.060853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:47.065645] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042547065642, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:15:47.067095] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042547067093, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:15:47.255714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:47.261096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:47.261131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:47.261139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:47.261148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:47.343522] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:47.348404] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:47.455840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:47.461379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:47.461411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:47.461418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:47.461427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:47.655964] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:47.661673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:47.661722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:47.661730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:47.661759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:47.856075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:47.861997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:47.862034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:47.862042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:47.862050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:48.056249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:48.062401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:48.062440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:48.062448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:48.062457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:48.073341] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042548073337, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 16:15:48.074699] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042548074697, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:15:48.260780] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4400, replace_start_pos=9000000, replace_num=100000) [2024-09-11 16:15:48.260827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:48.262759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:48.262792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:48.262800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:48.262824] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:48.343655] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:48.349205] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:48.460924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:48.463123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:48.463150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:48.463158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:48.463167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:48.661076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:48.663378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:48.663414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:48.663420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:48.663427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:48.669987] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6548, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:15:48.861221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:48.870331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:48.870375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:48.870383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:48.870393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:49.061341] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:49.070693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:49.070736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:49.070761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:49.070773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:49.080884] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042549080880, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:15:49.082402] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726042549082400, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007703, add_bytes: 0 [2024-09-11 16:15:49.261468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:49.271070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:49.271112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:49.271120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:49.271129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:49.343790] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:49.350054] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:49.461589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:49.471369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:49.471410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:49.471417] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:49.471426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:49.661765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:49.671653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:49.671699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:49.671707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:49.671716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:49.861897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:49.871970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:49.872012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:49.872020] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:49.872029] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:50.062061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:50.072341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:50.072385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:50.072393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:50.072403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:50.088512] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726042550088509, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:15:50.089930] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042550089928, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007528, add_bytes: 0 [2024-09-11 16:15:50.262200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:50.272642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:50.272683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:50.272692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:50.272701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:50.343913] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:50.351039] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:50.466760] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4371, replace_start_pos=9100000, replace_num=100000) [2024-09-11 16:15:50.466807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:50.473067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:50.473102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:50.473110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:50.473142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:50.666931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:50.673366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:50.673410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:50.673418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:50.673427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:50.681927] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8487, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:15:50.867118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:50.882173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:50.882216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:50.882223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:50.882232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:51.067300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:51.082473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:51.082511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:51.082517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:51.082526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:51.096181] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042551096177, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:15:51.097538] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042551097536, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:15:51.267429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:51.282774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:51.282820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:51.282828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:51.282837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:51.344131] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:51.352280] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:51.467616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:51.483061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:51.483094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:51.483101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:51.483110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:51.667748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:51.683332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:51.683368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:51.683374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:51.683382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:51.867878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:51.883607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:51.883650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:51.883657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:51.883683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:52.068030] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:52.083923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:52.083968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:52.083976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:52.083985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:52.103838] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042552103834, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:15:52.105167] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042552105165, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:15:52.268174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:52.284211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:52.284256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:52.284263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:52.284272] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:52.344333] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:52.353555] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:52.402062] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:52.402108] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:15:52.402187] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=157, max_check_version=158, global_version=159) [2024-09-11 16:15:52.404246] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2057 [2024-09-11 16:15:52.404313] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:52.404350] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:15:52.404388] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:15:52.404472] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:15:52.404580] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:15:52.404637] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:15:52.404649] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:15:52.404660] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:15:52.404696] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:15:52.404756] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:15:52.404777] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:15:52.468310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:52.484502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:52.484560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:52.484568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:52.484577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:52.671886] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3393, replace_start_pos=9200000, replace_num=100000) [2024-09-11 16:15:52.671944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:52.684926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:52.684973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:52.684981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:52.684991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:52.692443] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7439, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:15:52.872033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:52.892750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:52.892794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:52.892802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:52.892828] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:53.072163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:53.093062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:53.093107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:53.093115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:53.093128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:53.111353] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042553111348, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007514, add_bytes: 0 [2024-09-11 16:15:53.112788] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042553112785, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:15:53.272288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:53.293427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:53.293470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:53.293478] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:53.293487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:53.344455] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:53.354294] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:53.472423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:53.493709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:53.493755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:53.493762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:53.493771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:53.672607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:53.693994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:53.694040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:53.694070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:53.694079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:53.872739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:53.894321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:53.894367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:53.894375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:53.894385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:54.072882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:54.094700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:54.094746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:54.094754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:54.094764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:54.118971] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042554118966, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:15:54.120388] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042554120387, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:15:54.273034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:54.295102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:54.295145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:54.295170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:54.295179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:54.344624] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:54.355122] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:54.473215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:54.495400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:54.495446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:54.495453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:54.495462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:54.673433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:54.695689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:54.695734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:54.695741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:54.695751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:54.703620] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7855, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:15:54.876940] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3379, replace_start_pos=9300000, replace_num=100000) [2024-09-11 16:15:54.876984] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:54.903863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:54.903922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:54.903931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:54.903940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:55.077147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:55.104156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:55.104193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:55.104199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:55.104206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:55.126644] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042555126642, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:15:55.128014] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726042555128013, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:15:55.277297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:55.304445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:55.304483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:55.304489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:55.304497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:55.344794] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:55.356082] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:55.477488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:55.504718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:55.504758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:55.504766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:55.504775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:55.677626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:55.705007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:55.705042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:55.705048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:55.705055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:55.877761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:55.905286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:55.905322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:55.905328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:55.905336] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:56.077894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:56.105557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:56.105592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:56.105598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:56.105606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:56.134201] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042556134198, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:15:56.135685] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042556135684, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:15:56.278039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:56.305928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:56.305968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:56.305975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:56.305984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:56.344945] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:56.357172] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:56.478172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:56.506210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:56.506252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:56.506259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:56.506292] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:56.678358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:56.706521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:56.706565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:56.706573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:56.706581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:56.713575] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6981, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:15:56.878490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:56.913859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:56.913924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:56.913933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:56.913942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:57.083032] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4415, replace_start_pos=9400000, replace_num=100000) [2024-09-11 16:15:57.083081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:57.114238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:57.114298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:57.114306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:57.114335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:57.141875] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042557141870, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:15:57.143247] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042557143244, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:15:57.283184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:57.314570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:57.314611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:57.314619] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:57.314629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:57.345180] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:57.358072] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:57.483326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:57.514861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:57.514918] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:57.514927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:57.514937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:57.683454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:57.715166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:57.715211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:57.715218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:57.715227] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:57.883576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:15:57.915569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:57.915623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:57.915647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:57.915656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:58.083702] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:15:58.115891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:58.115954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:58.115963] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:58.115972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:58.149498] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=76] PNIO [ratelimit] time: 1726042558149494, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:15:58.150941] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042558150939, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 16:15:58.283883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:15:58.316247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:58.316300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:58.316308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:58.316316] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:58.345356] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:58.359090] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:58.484023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:15:58.516553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:58.516597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:58.516605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:58.516615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:58.684208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:15:58.716928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:58.716974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:58.716982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:58.716991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:58.725615] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8610, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:15:58.884424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:15:58.925975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:58.926018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:58.926025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:58.926033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:58.926186] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:15:59.084619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:15:59.126401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:59.126444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:59.126450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:59.126458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:59.157065] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042559157060, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:15:59.158545] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042559158544, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:15:59.288345] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3613, replace_start_pos=9500000, replace_num=100000) [2024-09-11 16:15:59.288391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:15:59.326808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:59.326855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:59.326862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:59.326870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:59.345534] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:15:59.360187] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:15:59.488556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:15:59.527134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:59.527182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:59.527190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:59.527198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:59.688690] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:15:59.727437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:59.727485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:59.727493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:59.727502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:15:59.888917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:15:59.927738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:15:59.927784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:15:59.927792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:15:59.927818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:00.089036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:00.128071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:00.128111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:00.128118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:00.128128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:00.160173] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:16:00.162432] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:16:00.164680] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726042560164678, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:16:00.164711] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:16:00.166159] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042560166157, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:16:00.166184] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:16:00.289168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:00.328430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:00.328474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:00.328482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:00.328493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:00.345658] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:00.361117] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:00.489304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:00.528823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:00.528870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:00.528878] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:00.528921] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:00.691456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=2046] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:00.729175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:00.729229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:00.729237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:00.729247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:00.737256] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7994, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:16:00.891654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:00.937516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:00.937562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:00.937570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:00.937580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:01.091841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:01.137811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:01.137854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:01.137862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:01.137871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:01.172346] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042561172341, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:16:01.173698] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042561173696, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:16:01.291969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:01.338135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:01.338176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:01.338183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:01.338191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:01.345877] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:01.362117] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:01.496518] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4409, replace_start_pos=9600000, replace_num=100000) [2024-09-11 16:16:01.496569] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:01.538434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:01.538482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:01.538490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:01.538499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:01.696651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:01.738717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:01.738762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:01.738768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:01.738776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:01.896768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:01.939008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:01.939057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:01.939081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:01.939090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:02.096885] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:02.139306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:02.139349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:02.139355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:02.139362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:02.179966] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042562179962, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:16:02.181390] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042562181388, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:16:02.297018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:02.339608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:02.339649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:02.339657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:02.339666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:02.346083] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:02.363254] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:02.419475] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:02.419528] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:02.419611] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=158, max_check_version=159, global_version=160) [2024-09-11 16:16:02.421617] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2005 [2024-09-11 16:16:02.421670] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:02.421705] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:16:02.421743] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:16:02.421826] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:02.421946] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:16:02.422002] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:16:02.422014] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:16:02.422025] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:16:02.422061] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:16:02.422124] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:16:02.422142] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:16:02.497146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:02.539978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:02.540022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:02.540029] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:02.540039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:02.697389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:02.740406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:02.740449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:02.740457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:02.740466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:02.749041] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8560, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:16:02.897516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:02.949393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:02.949437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:02.949445] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:02.949475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:03.097631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:03.149784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:03.149830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:03.149839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:03.149848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:03.187595] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042563187591, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:16:03.188942] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=533] PNIO [ratelimit] time: 1726042563188941, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:16:03.297746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:03.346210] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:03.350151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:03.350177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:03.350184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:03.350191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:03.363988] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:03.497868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:03.550492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:03.550537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:03.550546] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:03.550555] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:03.702203] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4196, replace_start_pos=9700000, replace_num=100000) [2024-09-11 16:16:03.702249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:03.750857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:03.750921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:03.750931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:03.750940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:03.902363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:03.951239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:03.951282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:03.951290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:03.951300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:04.102542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:04.151534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:04.151581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:04.151589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:04.151598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:04.195123] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042564195119, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007528, add_bytes: 0 [2024-09-11 16:16:04.196554] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042564196552, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:16:04.302678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:04.346375] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:04.351847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:04.351885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:04.351894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:04.351923] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:04.364930] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:04.502830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:04.552224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:04.552263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:04.552271] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:04.552280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:04.552501] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=73, refresh_score_time=66, wash_time=0) [2024-09-11 16:16:04.702960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:04.752839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:04.752884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:04.752892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:04.752920] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:04.760103] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7169, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:16:04.903147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:04.960433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:04.960474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:04.960482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:04.960491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:05.103284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:05.160808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:05.160855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:05.160865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:05.160876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:05.202807] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042565202803, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:16:05.204164] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042565204161, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:16:05.303491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:05.346575] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:05.361169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:05.361216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:05.361223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:05.361233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:05.365819] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:05.503617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:05.561530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:05.561578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:05.561586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:05.561595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:05.703788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:05.761828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:05.761866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:05.761875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:05.761899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:05.908313] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4398, replace_start_pos=9800000, replace_num=100000) [2024-09-11 16:16:05.908359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:05.962156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:05.962196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:05.962203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:05.962212] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:06.108534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:06.162452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:06.162494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:06.162501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:06.162510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:06.210430] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042566210425, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:16:06.211849] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042566211847, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:16:06.308659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:06.346785] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:06.362804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:06.362848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:06.362875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:06.362886] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:06.366981] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:06.508842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:06.563122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:06.563163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:06.563170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:06.563180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:06.709003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=87] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:06.763473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:06.763516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:06.763524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:06.763533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:06.771399] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7853, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:16:06.909131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:06.971732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:06.971777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:06.971785] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:06.971794] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:07.111056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:07.172030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:07.172072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:07.172104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:07.172114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:07.217963] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042567217961, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007536, add_bytes: 0 [2024-09-11 16:16:07.219411] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042567219408, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:16:07.311255] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:07.346915] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:07.367814] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:07.372343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:07.372385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:07.372394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:07.372404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:07.511381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:07.572636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:07.572674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:07.572680] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:07.572688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:07.711507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:07.772933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:07.772974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:07.772982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:07.772991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:07.911687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:07.973222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:07.973268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:07.973275] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:07.973285] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:08.116163] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4321, replace_start_pos=9900000, replace_num=100000) [2024-09-11 16:16:08.116205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:08.173518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:08.173560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:08.173567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:08.173575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:08.225661] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042568225657, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 16:16:08.227018] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=91] PNIO [ratelimit] time: 1726042568227016, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:16:08.316303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:08.347033] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:08.368728] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:08.373812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:08.373852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:08.373859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:08.373869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:08.516421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:08.574104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:08.574150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:08.574158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:08.574185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:08.716605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:08.774393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:08.774435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:08.774441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:08.774449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:08.781924] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7462, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:16:08.916787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:08.982181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:08.982224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:08.982231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:08.982240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:09.116918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:09.182469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:09.182505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:09.182511] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:09.182519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:09.233274] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042569233269, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:16:09.234705] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042569234702, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:16:09.317044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:09.347158] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:09.369640] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:09.382758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:09.382800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:09.382806] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:09.382816] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:09.517164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:09.583034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:09.583077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:09.583084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:09.583093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:09.717293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:09.783325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:09.783359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:09.783366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:09.783375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:09.917418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:09.983675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:09.983719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:09.983727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:09.983760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:10.117612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:10.184014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:10.184057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:10.184065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:10.184074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:10.240896] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1726042570240892, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:16:10.242318] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042570242315, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:16:10.322052] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4319, replace_start_pos=10000000, replace_num=100000) [2024-09-11 16:16:10.322101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:10.347270] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:10.370566] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:10.384323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:10.384366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:10.384373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:10.384382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:10.522248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:10.584607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:10.584652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:10.584660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:10.584669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:10.722448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:10.784995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:10.785038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:10.785046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:10.785055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:10.793578] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8510, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:16:10.922645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:10.993823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:10.993867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:10.993875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:10.993884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:11.122821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:11.194173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:11.194217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:11.194225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:11.194235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:11.248541] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726042571248536, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 16:16:11.249933] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042571249931, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:16:11.322925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:11.347442] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=86] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:11.371520] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:11.394471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:11.394517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:11.394525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:11.394552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:11.523057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:11.594770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:11.594810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:11.594816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:11.594823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:11.723233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:11.795087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:11.795133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:11.795147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:11.795157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:11.923374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:11.995395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:11.995439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:11.995446] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:11.995455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:12.123563] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:12.195706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:12.195750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:12.195757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:12.195766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:12.256049] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042572256043, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007507, add_bytes: 0 [2024-09-11 16:16:12.257486] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042572257483, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:16:12.323719] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:12.347569] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:12.372717] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:12.396077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:12.396119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:12.396127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:12.396137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:12.436271] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:12.436326] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:12.436407] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=159, max_check_version=160, global_version=161) [2024-09-11 16:16:12.438451] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2042 [2024-09-11 16:16:12.438493] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:12.438527] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:16:12.438583] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:16:12.438667] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:12.438774] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:16:12.438828] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:16:12.438844] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:16:12.438855] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:16:12.438891] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:16:12.438976] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:16:12.439006] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:16:12.527940] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4103, replace_start_pos=10100000, replace_num=100000) [2024-09-11 16:16:12.527997] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:12.596383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:12.596427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:12.596435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:12.596444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:12.728081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:12.796686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:12.796754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:12.796761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:12.796771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:12.803650] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6864, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:16:12.928262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:13.003929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:13.003967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:13.003973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:13.003980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:13.128385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:13.204219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:13.204258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:13.204266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:13.204275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:13.263664] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=90] PNIO [ratelimit] time: 1726042573263661, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:16:13.265112] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042573265109, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:16:13.328587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:13.347706] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:13.374133] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:13.404569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:13.404614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:13.404622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:13.404631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:13.528765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:13.604861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:13.604921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:13.604930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:13.604939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:13.728899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:13.805163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:13.805206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:13.805214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:13.805223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:13.929114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:14.005477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:14.005519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:14.005526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:14.005536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:14.129300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:14.205756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:14.205798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:14.205805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:14.205812] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:14.271293] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042574271288, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:16:14.272725] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042574272723, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:16:14.329417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:14.347823] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:14.375331] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:14.406061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:14.406102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:14.406110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:14.406119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:14.529525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:14.606346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:14.606392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:14.606400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:14.606426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:14.733060] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3402, replace_start_pos=10200000, replace_num=100000) [2024-09-11 16:16:14.733102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:14.806683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:14.806721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:14.806727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:14.806734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:14.813362] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6616, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:16:14.933246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:15.013623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:15.013669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:15.013677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:15.013686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:15.133435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:15.214009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:15.214055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:15.214062] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:15.214091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:15.278980] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042575278976, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:16:15.280346] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042575280343, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:16:15.333560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:15.348025] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:15.414332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:15.414380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:15.414388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:15.414398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:15.476242] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:15.533741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:15.614650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:15.614696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:15.614704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:15.614713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:15.733874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:15.815063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:15.815109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:15.815116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:15.815125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:15.934028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:16.015425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:16.015470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:16.015495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:16.015507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:16.134160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:16.215870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:16.215945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:16.215955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:16.215965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:16.286585] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042576286581, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:16:16.288012] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042576288010, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:16:16.334344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:16.348166] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:16.416243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:16.416278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:16.416287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:16.416301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:16.477434] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:16.534478] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:16.616540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:16.616583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:16.616591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:16.616600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:16.734600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:16.816930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:16.816976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:16.816985] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:16.816995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:16.824165] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7157, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:16:16.939086] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4351, replace_start_pos=10300000, replace_num=100000) [2024-09-11 16:16:16.939133] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:17.024434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:17.024474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:17.024482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:17.024491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:17.139260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:17.224792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:17.224837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:17.224845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:17.224854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:17.294136] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042577294133, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:16:17.295644] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042577295642, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:16:17.339374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:17.348350] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:17.425109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:17.425154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:17.425162] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:17.425172] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:17.478506] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:17.539558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:17.625515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:17.625559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:17.625567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:17.625575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:17.739748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:17.825816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:17.825855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:17.825863] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:17.825872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:17.939876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:18.026107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:18.026146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:18.026154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:18.026163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:18.140017] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:18.226485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:18.226527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:18.226535] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:18.226545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:18.301747] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=1698] PNIO [ratelimit] time: 1726042578301743, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:16:18.303266] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=217] PNIO [ratelimit] time: 1726042578303263, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:16:18.340137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:18.348465] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:18.426778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:18.426820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:18.426828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:18.426837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:18.479578] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:18.540252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:18.627139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:18.627184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:18.627192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:18.627202] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:18.740376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:18.827529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:18.827575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:18.827583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:18.827610] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:18.835477] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7853, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:16:18.940498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:19.035804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:19.035851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:19.035859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:19.035870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:19.143958] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3346, replace_start_pos=10400000, replace_num=100000) [2024-09-11 16:16:19.144003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:19.236170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:19.236217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:19.236225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:19.236235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:19.309375] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042579309371, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:16:19.310805] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042579310803, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007540, add_bytes: 0 [2024-09-11 16:16:19.344095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:19.348659] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:19.436561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:19.436606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:19.436614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:19.436623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:19.480775] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:19.544274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:19.636860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:19.636924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:19.636933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:19.636943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:19.744400] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:19.837168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:19.837209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:19.837216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:19.837226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:19.944555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=79] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:20.037468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:20.037512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:20.037520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:20.037532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:20.144804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:20.237762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:20.237825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:20.237832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:20.237841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:20.317101] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042580317099, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007728, add_bytes: 0 [2024-09-11 16:16:20.318422] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042580318420, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:16:20.344931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:20.348789] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:20.438085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:20.438126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:20.438133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:20.438143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:20.481716] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:20.545044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:20.638365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:20.638404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:20.638412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:20.638421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:20.745172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:20.838724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:20.838768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:20.838776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:20.838785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:20.846427] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7629, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:16:20.945355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:21.046689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:21.046734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:21.046742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:21.046751] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:21.145472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:21.247068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:21.247111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:21.247120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:21.247130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:21.324594] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042581324590, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007491, add_bytes: 0 [2024-09-11 16:16:21.326031] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726042581326028, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:16:21.348997] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:21.349922] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4334, replace_start_pos=10500000, replace_num=100000) [2024-09-11 16:16:21.349958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:21.447423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:21.447467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:21.447474] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:21.447502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:21.482928] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:21.550045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:21.647796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:21.647856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:21.647864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:21.647874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:21.750171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:21.848108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:21.848151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:21.848158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:21.848167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:21.950307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:22.048402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:22.048446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:22.048454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:22.048463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:22.150440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:22.248766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:22.248813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:22.248821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:22.248830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:22.332222] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042582332216, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:16:22.333711] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042582333708, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:16:22.349124] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:22.350578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:22.449158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:22.449205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:22.449213] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:22.449223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:22.453324] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:22.453372] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:22.453453] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=160, max_check_version=161, global_version=162) [2024-09-11 16:16:22.455475] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2021 [2024-09-11 16:16:22.455508] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:22.455560] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:16:22.455598] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:16:22.455681] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:22.455788] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:16:22.455842] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:16:22.455854] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:16:22.455865] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:16:22.455913] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:16:22.455974] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:16:22.455998] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:16:22.484267] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:22.550681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:22.649467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:22.649512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:22.649520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:22.649530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:22.750809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:22.849861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:22.849920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:22.849930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:22.849941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:22.858254] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8300, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:16:22.950930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:23.058493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:23.058540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:23.058549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:23.058559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:23.151117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:23.258781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:23.258817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:23.258822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:23.258830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:23.339892] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726042583339888, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:16:23.341254] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=395] PNIO [ratelimit] time: 1726042583341252, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:16:23.349253] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:23.351293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:23.459061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:23.459105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:23.459112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:23.459121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:23.485508] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:23.555081] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3668, replace_start_pos=10600000, replace_num=100000) [2024-09-11 16:16:23.555123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:23.659348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:23.659395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:23.659402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:23.659425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:23.755218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:23.859649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:23.859696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:23.859705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:23.859715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:23.955407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:24.059968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:24.060010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:24.060018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:24.060056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:24.155533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:24.260287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:24.260330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:24.260337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:24.260345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:24.347445] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=84] PNIO [ratelimit] time: 1726042584347441, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:16:24.348872] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042584348871, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:16:24.349352] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=25] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:24.355732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:24.460641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:24.460686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:24.460693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:24.460704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:24.486831] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:24.555849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:24.660958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:24.661000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:24.661008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:24.661017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:24.755963] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:24.861233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:24.861301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:24.861308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:24.861315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:24.861499] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=95, refresh_score_time=68, wash_time=0) [2024-09-11 16:16:24.869762] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8249, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:16:24.956087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:25.070048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:25.070090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:25.070098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:25.070107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:25.156207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:25.270411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:25.270451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:25.270459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:25.270467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:25.349515] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=25] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:25.355159] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042585355155, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007714, add_bytes: 0 [2024-09-11 16:16:25.356330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:25.356583] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726042585356581, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007710, add_bytes: 0 [2024-09-11 16:16:25.470774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:25.470821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:25.470829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:25.470839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:25.487999] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=111] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:25.556473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:25.671142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:25.671186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:25.671194] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:25.671203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:25.760960] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4361, replace_start_pos=10700000, replace_num=100000) [2024-09-11 16:16:25.761007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:25.871435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:25.871476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:25.871483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:25.871493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:25.961163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:26.071743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:26.071787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:26.071796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:26.071805] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:26.161353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:26.272122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:26.272166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:26.272174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:26.272183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:26.349664] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:26.361485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:26.362675] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042586362673, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007518, add_bytes: 0 [2024-09-11 16:16:26.364108] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042586364106, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007525, add_bytes: 0 [2024-09-11 16:16:26.472436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:26.472481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:26.472488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:26.472497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:26.489185] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:26.561671] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:26.672728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:26.672769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:26.672776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:26.672783] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:26.761838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:26.873030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:26.873074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:26.873081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:26.873106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:26.880352] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7233, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:16:26.962046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:27.080615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:27.080659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:27.080667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:27.080676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:27.162172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:27.281043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:27.281090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:27.281097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:27.281106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:27.349862] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:27.362305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:27.370294] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042587370290, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:16:27.371719] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042587371717, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:16:27.481405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:27.481454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:27.481479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:27.481490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:27.490588] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:27.562471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:27.681717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:27.681761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:27.681768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:27.681776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:27.762607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:27.882072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:27.882113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:27.882121] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:27.882130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:27.966916] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4185, replace_start_pos=10800000, replace_num=100000) [2024-09-11 16:16:27.966964] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:28.082438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:28.082485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:28.082493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:28.082503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:28.167054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:28.282721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:28.282761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:28.282784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:28.282792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:28.350093] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:28.367174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:28.377916] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042588377914, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:16:28.379346] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042588379343, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:16:28.483129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:28.483170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:28.483178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:28.483188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:28.491745] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:28.567293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:28.683499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:28.683539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:28.683548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:28.683557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:28.767415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:28.883824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:28.883873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:28.883882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:28.883892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:28.891566] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7632, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:16:28.967537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:29.091950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:29.091997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:29.092005] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:29.092014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:29.092206] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:16:29.167659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:29.292502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:29.292545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:29.292554] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:29.292564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:29.350286] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:29.367779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:29.385521] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042589385518, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:16:29.387019] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042589387016, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:16:29.492871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:29.492873] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:29.492947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:29.492987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:29.492997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:29.567899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:29.693292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:29.693354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:29.693363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:29.693373] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:29.768030] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:29.893668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:29.893712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:29.893720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:29.893730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:29.968151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:30.094006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:30.094052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:30.094060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:30.094069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:30.171635] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3369, replace_start_pos=10900000, replace_num=100000) [2024-09-11 16:16:30.171682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:30.294366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:30.294413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:30.294421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:30.294452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:30.350469] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:30.371766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:30.393137] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042590393133, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:16:30.394637] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042590394634, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:16:30.494218] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=112] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:30.494745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:30.494777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:30.494786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:30.494795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:30.571890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:30.695097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:30.695142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:30.695150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:30.695159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:30.772026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:30.895393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:30.895436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:30.895443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:30.895453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:30.902622] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7158, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:16:30.972142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:31.102976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:31.103024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:31.103032] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:31.103042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:31.172271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:31.303338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:31.303383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:31.303392] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:31.303402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:31.350687] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:31.372389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:31.400752] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042591400749, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:16:31.402248] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042591402245, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:16:31.495504] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:31.503706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:31.503751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:31.503758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:31.503768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:31.572505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:31.704088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:31.704133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:31.704142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:31.704151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:31.772635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:31.904461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:31.904507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:31.904514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:31.904524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:31.972764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:32.104773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:32.104818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:32.104825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:32.104834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:32.172887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:32.305136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:32.305179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:32.305187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:32.305197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:32.350877] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:32.377372] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4355, replace_start_pos=11000000, replace_num=100000) [2024-09-11 16:16:32.377450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:32.408375] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042592408371, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:16:32.409874] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042592409872, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:16:32.471717] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:32.471769] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:32.471853] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=161, max_check_version=162, global_version=163) [2024-09-11 16:16:32.473828] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1974 [2024-09-11 16:16:32.473865] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:32.473912] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:16:32.473952] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:16:32.474053] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:32.474161] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:16:32.474212] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:16:32.474224] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:16:32.474241] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:16:32.474277] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:16:32.474337] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:16:32.474360] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:16:32.496690] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:32.505437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:32.505483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:32.505490] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:32.505500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:32.577533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:32.705758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:32.705802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:32.705810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:32.705819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:32.777665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:32.906075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:32.906119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:32.906127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:32.906137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:32.913524] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7375, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:16:32.977803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:33.113844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:33.113889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:33.113897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:33.113930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:33.177923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:33.314233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:33.314277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:33.314285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:33.314325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:33.351132] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:33.378039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:33.416000] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042593415996, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:16:33.417422] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042593417419, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:16:33.497728] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:33.514711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:33.514755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:33.514763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:33.514789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:33.578172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:33.715032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:33.715073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:33.715079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:33.715087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:33.778286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:33.915455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:33.915500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:33.915508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:33.915518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:33.978394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:34.115837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:34.115883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:34.115889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:34.115896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:34.178508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:34.316154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:34.316196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:34.316204] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:34.316213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:34.351248] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:34.378645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:34.423611] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042594423605, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:16:34.425108] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042594425104, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:16:34.498718] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:34.516466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:34.516515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:34.516523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:34.516536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:34.582144] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3381, replace_start_pos=11100000, replace_num=100000) [2024-09-11 16:16:34.582192] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:34.716781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:34.716827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:34.716834] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:34.716843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:34.782274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:34.917069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:34.917115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:34.917122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:34.917152] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:34.924527] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7363, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:16:34.982378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:35.124828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:35.124872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:35.124880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:35.124890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:35.182508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:35.325147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:35.325188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:35.325196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:35.325205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:35.351393] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:35.382634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:35.431224] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042595431220, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:16:35.432719] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042595432716, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:16:35.499886] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:35.525442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:35.525491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:35.525499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:35.525510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:35.582753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:35.725762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:35.725806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:35.725813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:35.725822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:35.782879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:35.926067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:35.926106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:35.926114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:35.926123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:35.983003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:36.126475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:36.126521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:36.126530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:36.126539] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:36.183115] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:36.326770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:36.326814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:36.326821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:36.326851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:36.351546] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:36.383224] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:36.438836] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042596438832, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:16:36.440331] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042596440329, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:16:36.501288] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=106] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:36.527075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:36.527122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:36.527128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:36.527136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:36.583334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:36.727337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:36.727379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:36.727387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:36.727394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:36.787435] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3368, replace_start_pos=11200000, replace_num=100000) [2024-09-11 16:16:36.787480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:36.927634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:36.927678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:36.927686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:36.927695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:36.934993] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7284, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:16:36.987563] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:37.135267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:37.135303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:37.135309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:37.135317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:37.187688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:37.335645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:37.335693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:37.335701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:37.335710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:37.351682] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:37.387811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:37.446453] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042597446448, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:16:37.447951] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042597447948, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:16:37.502563] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:37.535958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:37.536000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:37.536006] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:37.536014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:37.587937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:37.736306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:37.736347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:37.736354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:37.736378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:37.788102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:37.936605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:37.936647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:37.936655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:37.936664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:37.988217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:38.136986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:38.137025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:38.137037] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:38.137044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:38.188333] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:38.337262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:38.337302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:38.337308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:38.337315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:38.351847] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:38.388448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:38.454086] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042598454081, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:16:38.455639] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042598455638, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:16:38.503729] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:38.537547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:38.537609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:38.537616] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:38.537626] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:38.588567] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:38.737850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:38.737922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:38.737932] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:38.737940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:38.788730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:38.938173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:38.938215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:38.938222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:38.938232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:38.946367] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8121, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:16:38.992170] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3326, replace_start_pos=11300000, replace_num=100000) [2024-09-11 16:16:38.992214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:39.146636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:39.146697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:39.146705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:39.146714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:39.192290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:39.346971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:39.347028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:39.347036] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:39.347045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:39.352074] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=93] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:39.392396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:39.461753] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042599461748, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:16:39.463182] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042599463180, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:16:39.504976] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:39.547352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:39.547397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:39.547404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:39.547413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:39.592509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:39.747734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:39.747779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:39.747787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:39.747797] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:39.792636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:39.948037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:39.948070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:39.948075] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:39.948082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:39.992772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:40.148294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:40.148338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:40.148344] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:40.148351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:40.192896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:40.348656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:40.348700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:40.348708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:40.348718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:40.352250] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:40.393040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:40.469304] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042600469300, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:16:40.470725] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042600470724, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:16:40.506275] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:40.549047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:40.549095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:40.549103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:40.549112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:40.593163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:40.749360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:40.749404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:40.749412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:40.749421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:40.793282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:40.949647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:40.949691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:40.949699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:40.949708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:40.958039] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8317, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:16:40.993519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:41.158296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:41.158341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:41.158350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:41.158360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:41.198145] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4413, replace_start_pos=11400000, replace_num=100000) [2024-09-11 16:16:41.198215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:41.352463] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:41.358671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:41.358712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:41.358720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:41.358729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:41.398309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:41.476982] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042601476978, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:16:41.478408] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042601478406, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:16:41.507641] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:41.559042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:41.559085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:41.559093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:41.559102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:41.598440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:41.759349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:41.759392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:41.759400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:41.759409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:41.798568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:41.959638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:41.959682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:41.959707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:41.959714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:41.998709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:42.160022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:42.160057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:42.160064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:42.160071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:42.198829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:42.352643] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:42.360304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:42.360348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:42.360355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:42.360364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:42.398953] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:42.484531] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042602484527, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:16:42.485973] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042602485971, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 16:16:42.490036] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:42.490069] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:42.490170] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] update_check_range(min_check_version=162, max_check_version=163, global_version=164) [2024-09-11 16:16:42.492173] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2002 [2024-09-11 16:16:42.492203] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:42.492238] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:16:42.492279] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:16:42.492362] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:42.492480] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:16:42.492533] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:16:42.492545] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:16:42.492556] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:16:42.492595] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:16:42.492655] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:16:42.492677] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:16:42.508936] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:42.560659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:42.560707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:42.560714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:42.560723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:42.599174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:42.761055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:42.761099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:42.761107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:42.761117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:42.799321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:42.961348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:42.961388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:42.961396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:42.961405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:42.969382] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7963, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:16:42.999444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:43.169656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:43.169698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:43.169705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:43.169712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:43.199576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:43.352860] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:43.370051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:43.370094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:43.370102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:43.370112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:43.404110] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4354, replace_start_pos=11500000, replace_num=100000) [2024-09-11 16:16:43.404158] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:43.492207] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042603492203, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:16:43.493641] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=95] PNIO [ratelimit] time: 1726042603493639, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:16:43.510336] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:43.570427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:43.570471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:43.570479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:43.570487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:43.604242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:43.770781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:43.770844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:43.770853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:43.770863] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:43.804381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:43.971103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:43.971143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:43.971150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:43.971160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:44.004502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:44.171462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:44.171509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:44.171518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:44.171527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:44.204636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:44.353063] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:44.371823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:44.371867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:44.371876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:44.371920] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:44.404836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:44.499784] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042604499780, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007577, add_bytes: 0 [2024-09-11 16:16:44.501263] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042604501260, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:16:44.511574] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:44.572218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:44.572259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:44.572267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:44.572276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:44.604970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:44.772634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:44.772679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:44.772687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:44.772696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:44.805164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:44.973033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:44.973076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:44.973084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:44.973093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:44.981563] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8456, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:16:45.005284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:45.181878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:45.181972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=93][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:45.181981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:45.181990] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:45.182203] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=129, refresh_score_time=62, wash_time=0) [2024-09-11 16:16:45.205504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:45.353298] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:45.382504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:45.382547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:45.382555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:45.382564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:45.405623] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:45.507441] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042605507437, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:16:45.508826] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042605508824, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:16:45.512714] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:45.582790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:45.582830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:45.582838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:45.582847] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:45.610082] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4333, replace_start_pos=11600000, replace_num=100000) [2024-09-11 16:16:45.610129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:45.783159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:45.783199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:45.783207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:45.783240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:45.810332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:45.983543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:45.983586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:45.983593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:45.983601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:46.010520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:46.183837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:46.183875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:46.183883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:46.183892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:46.210644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:46.353505] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:46.384138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:46.384180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:46.384188] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:46.384197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:46.410758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:46.513678] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:46.514995] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042606514993, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:16:46.516490] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042606516487, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:16:46.584446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:46.584508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:46.584517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:46.584526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:46.610874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:46.784734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:46.784775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:46.784781] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:46.784788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:46.811012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:46.985022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:46.985065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:46.985072] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:46.985080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:46.991489] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6394, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:16:47.011127] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:47.191759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:47.191803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:47.191810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:47.191837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:47.211300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:47.353704] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:47.392073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:47.392117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:47.392124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:47.392134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:47.411440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:47.514936] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:47.522679] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042607522676, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:16:47.524100] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042607524098, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:16:47.592367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:47.592410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:47.592418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:47.592427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:47.611582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:47.792665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:47.792703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:47.792711] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:47.792720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:47.816062] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4355, replace_start_pos=11700000, replace_num=100000) [2024-09-11 16:16:47.816109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:47.993056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:47.993095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:47.993104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:47.993113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:48.016216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:48.193341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:48.193379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:48.193386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:48.193395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:48.216334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:48.353881] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:48.393637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:48.393678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:48.393685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:48.393694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:48.416454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:48.517593] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=1566] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:48.530231] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042608530228, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:16:48.531672] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042608531669, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007571, add_bytes: 0 [2024-09-11 16:16:48.593966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:48.594010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:48.594018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:48.594027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:48.616577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:48.794280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:48.794324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:48.794330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:48.794338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:48.816702] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:48.994565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:48.994608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:48.994615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:48.994625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:49.002986] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8348, clean_start_pos=0, clean_num=200000) [2024-09-11 16:16:49.016923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:49.203249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:49.203291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:49.203299] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:49.203308] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:49.217041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:49.354093] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:49.403565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:49.403610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:49.403617] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:49.403627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:49.417191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:49.518968] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:49.537922] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042609537918, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:16:49.539341] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042609539339, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:16:49.603867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:49.603928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:49.603937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:49.603946] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:49.617369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:49.804182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:49.804220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:49.804227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:49.804236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:49.817495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:50.004538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:50.004584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:50.004593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:50.004602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:50.021965] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4348, replace_start_pos=11800000, replace_num=100000) [2024-09-11 16:16:50.022010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:50.204955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:50.204994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:50.205002] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:50.205011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:50.222099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:50.354269] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:50.405334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:50.405373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:50.405382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:50.405391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:50.422285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:50.520087] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:50.545468] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042610545465, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:16:50.546953] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042610546951, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:16:50.605701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:50.605750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:50.605758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:50.605767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:50.622466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:50.806026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:50.806088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:50.806096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:50.806104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:50.822587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:51.006406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:51.006447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:51.006456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:51.006465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:51.014364] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7885, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:16:51.022708] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:51.214610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:51.214651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:51.214657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:51.214665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:51.222885] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:51.354496] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:51.414896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:51.414958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:51.414982] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:51.414991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:51.423025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:51.521196] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:51.553138] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042611553135, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:16:51.554528] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042611554525, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 16:16:51.615222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:51.615265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:51.615273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:51.615282] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:51.623144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:51.815497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:51.815540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:51.815546] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:51.815554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:51.823265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:52.015761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:52.015800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:52.015807] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:52.015814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:52.023396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:52.216085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:52.216164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:52.216173] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:52.216184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:52.227602] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4090, replace_start_pos=11900000, replace_num=100000) [2024-09-11 16:16:52.227646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:52.354622] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:52.416476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:52.416518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:52.416524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:52.416532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:52.427725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:52.508985] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:52.509038] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:16:52.509120] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=163, max_check_version=164, global_version=165) [2024-09-11 16:16:52.511133] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2011 [2024-09-11 16:16:52.511191] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:52.511226] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:16:52.511264] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:16:52.511348] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:16:52.511456] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:16:52.511511] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:16:52.511522] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:16:52.511533] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:16:52.511569] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:16:52.511629] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:16:52.511652] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:16:52.522254] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:52.560763] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042612560760, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:16:52.562188] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042612562185, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007660, add_bytes: 0 [2024-09-11 16:16:52.616752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:52.616798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:52.616803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:52.616811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:52.627841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:52.817026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:52.817066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:52.817073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:52.817080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:52.827954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:53.017372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:53.017411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:53.017420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:53.017429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:53.026009] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8566, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:16:53.028069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:53.226298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:53.226360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:53.226368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:53.226379] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:53.228171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:53.354805] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:53.426611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:53.426656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:53.426663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:53.426672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:53.428343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:53.523368] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:53.568326] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042613568322, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:16:53.569732] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042613569729, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:16:53.626926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:53.626963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:53.626969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:53.626976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:53.628536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:53.827212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:53.827259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:53.827266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:53.827275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:53.828639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:54.027582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:54.027628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:54.027636] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:54.027645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:54.028748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:54.227853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:54.227893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:54.227899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:54.227922] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:54.228831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:54.354923] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:54.428152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:54.428194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:54.428201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:54.428209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:54.432836] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3911, replace_start_pos=12000000, replace_num=100000) [2024-09-11 16:16:54.432880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:54.524433] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:54.575926] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042614575922, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:16:54.577423] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042614577420, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:16:54.628435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:54.628482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:54.628488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:54.628521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:54.633013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:54.828792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:54.828835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:54.828842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:54.828852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:54.833177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:55.029150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:55.029194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:55.029200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:55.029208] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:55.033296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:55.036381] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7161, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:16:55.233419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:55.236690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:55.236722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:55.236730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:55.236756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:55.355047] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:55.433617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:55.437024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:55.437063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:55.437071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:55.437081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:55.525578] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:55.583650] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042615583646, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007724, add_bytes: 0 [2024-09-11 16:16:55.585031] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042615585029, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:16:55.633755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:55.637304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:55.637334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:55.637341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:55.637349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:55.833948] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:55.837646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:55.837682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:55.837690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:55.837699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:56.034084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:56.038018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:56.038074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:56.038087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:56.038096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:56.234224] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:56.238301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:56.238331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:56.238337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:56.238345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:56.355191] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:56.434457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:56.438568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:56.438607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:56.438614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:56.438623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:56.526655] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:56.591157] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042616591152, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007506, add_bytes: 0 [2024-09-11 16:16:56.592648] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042616592645, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:16:56.637946] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3346, replace_start_pos=12100000, replace_num=100000) [2024-09-11 16:16:56.637990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:56.638839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:56.638864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:56.638871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:56.638879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:56.838087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:56.839139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:56.839167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:56.839173] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:56.839182] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:57.038207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:57.039404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:57.039430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:57.039436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:57.039444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:57.046396] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6942, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:16:57.238394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:57.246645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:57.246691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:57.246699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:57.246708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:57.355319] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:57.438535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:57.446947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:57.446988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:57.446995] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:57.447003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:57.527870] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:57.598776] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042617598773, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:16:57.600262] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042617600260, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:16:57.638681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:57.647227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:57.647262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:57.647269] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:57.647276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:57.838812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:16:57.847499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:57.847542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:57.847549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:57.847558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:58.038923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:16:58.047778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:58.047819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:58.047826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:58.047834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:58.239108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:16:58.248082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:58.248120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:58.248128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:58.248137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:58.355438] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:58.439243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:16:58.448363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:58.448404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:58.448412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:58.448422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:58.528781] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:58.606458] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042618606454, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:16:58.607820] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=684] PNIO [ratelimit] time: 1726042618607818, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:16:58.639382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:16:58.648634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:58.648674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:58.648681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:58.648689] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:58.843384] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3806, replace_start_pos=12200000, replace_num=100000) [2024-09-11 16:16:58.843424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:16:58.848927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:58.848982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:58.848989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:58.848998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:59.043571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:16:59.049227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:59.049271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:59.049279] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:59.049288] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:59.057139] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7837, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:16:59.243694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:16:59.257369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:59.257410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:59.257417] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:59.257425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:59.257608] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:16:59.355568] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:16:59.443815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:16:59.457833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:59.457873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:59.457882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:59.457895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:59.529734] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:16:59.614001] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042619613997, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:16:59.615535] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042619615532, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007714, add_bytes: 0 [2024-09-11 16:16:59.644040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:16:59.658138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:59.658204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:59.658212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:59.658220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:16:59.844225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:16:59.858442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:16:59.858485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:16:59.858492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:16:59.858501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:00.044346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:00.058731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:00.058769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:00.058777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:00.058785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:00.244471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:00.259052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:00.259084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:00.259091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:00.259100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:00.355681] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:00.444673] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:00.459330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:00.459371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:00.459378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:00.459387] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:00.530736] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:00.617112] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:17:00.619303] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:17:00.621691] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042620621690, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:17:00.621718] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:17:00.623052] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042620623051, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007519, add_bytes: 0 [2024-09-11 16:17:00.623065] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:17:00.644792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:00.659704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:00.659745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:00.659753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:00.659763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:00.844962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:00.860003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:00.860047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:00.860055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:00.860064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:01.049513] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4349, replace_start_pos=12300000, replace_num=100000) [2024-09-11 16:17:01.049561] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:01.060284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:01.060328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:01.060334] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:01.060342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:01.068197] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7843, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:17:01.249645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:01.268541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:01.268580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:01.268588] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:01.268597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:01.355836] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:01.449833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:01.468823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:01.468866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:01.468874] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:01.468883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:01.531756] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:01.629317] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042621629314, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:17:01.630663] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=5] PNIO [ratelimit] time: 1726042621630663, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:17:01.650026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:01.669152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:01.669194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:01.669202] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:01.669211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:01.850215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:01.869451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:01.869497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:01.869504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:01.869514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:02.050406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:02.069734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:02.069780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:02.069787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:02.069795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:02.250537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:02.270064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:02.270109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:02.270116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:02.270126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:02.356036] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=97] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:02.450768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:02.470375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:02.470421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:02.470428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:02.470437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:02.524222] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:02.524268] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=44] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:02.524357] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] update_check_range(min_check_version=164, max_check_version=165, global_version=166) [2024-09-11 16:17:02.526379] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2022 [2024-09-11 16:17:02.526437] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:02.526473] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:17:02.526506] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:17:02.526580] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:02.526663] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:17:02.526711] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:17:02.526720] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:17:02.526729] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:17:02.526760] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:17:02.526809] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:17:02.526827] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:17:02.533078] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:02.636923] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042622636919, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:17:02.638287] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726042622638283, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:17:02.650969] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:02.670649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:02.670687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:02.670694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:02.670701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:02.851180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:02.871014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:02.871056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:02.871062] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:02.871069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:03.051364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:03.071282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:03.071325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:03.071330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:03.071338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:03.078691] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7340, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:17:03.255958] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4387, replace_start_pos=12400000, replace_num=100000) [2024-09-11 16:17:03.256017] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:03.279053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:03.279092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:03.279101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:03.279110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:03.356168] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:03.456219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:03.479328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:03.479371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:03.479377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:03.479385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:03.534363] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:03.644547] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726042623644542, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:17:03.645918] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=366] PNIO [ratelimit] time: 1726042623645916, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:17:03.656425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:03.679623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:03.679669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:03.679677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:03.679686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:03.856615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:03.879963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:03.880011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:03.880018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:03.880044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:04.056809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:04.080269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:04.080311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:04.080318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:04.080325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:04.256952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:04.280557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:04.280603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:04.280611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:04.280620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:04.356283] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:04.457137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:04.480936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:04.480983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:04.480991] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:04.481000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:04.535735] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:04.652150] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042624652146, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:17:04.653575] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726042624653573, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:17:04.657251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:04.681311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:04.681369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:04.681378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:04.681388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:04.857448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:04.881690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:04.881739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:04.881746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:04.881755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:05.057678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:05.082001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:05.082040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:05.082047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:05.082054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:05.088821] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6754, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:17:05.257862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:05.289071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:05.289118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:05.289124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:05.289152] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:05.356431] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:05.461729] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3610, replace_start_pos=12500000, replace_num=100000) [2024-09-11 16:17:05.461780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:05.489394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:05.489437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:05.489444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:05.489453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:05.489668] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=76, refresh_score_time=63, wash_time=0) [2024-09-11 16:17:05.536942] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:05.659723] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042625659719, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007573, add_bytes: 0 [2024-09-11 16:17:05.661194] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042625661191, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:17:05.661925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:05.689928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:05.689971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:05.689980] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:05.689988] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:05.862049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:05.890285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:05.890331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:05.890340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:05.890349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:06.062241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:06.090670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:06.090711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:06.090719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:06.090728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:06.262440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:06.291062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:06.291110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:06.291118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:06.291128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:06.356576] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:06.462672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:06.491372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:06.491412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:06.491419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:06.491428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:06.538357] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:06.662859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:06.667386] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042626667382, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:17:06.668756] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042626668754, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:17:06.691675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:06.691721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:06.691727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:06.691754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:06.863061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:06.892000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:06.892039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:06.892047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:06.892056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:07.063249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:07.092298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:07.092345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:07.092353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:07.092362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:07.100286] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7910, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:17:07.263369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:07.300612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:07.300651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:07.300659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:07.300669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:07.356834] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:07.463483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:07.501032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:07.501068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:07.501076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:07.501085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:07.539491] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:07.667949] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4349, replace_start_pos=0, replace_num=100000) [2024-09-11 16:17:07.667994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:07.674944] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042627674941, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:17:07.676353] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042627676352, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:17:07.701313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:07.701357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:07.701362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:07.701370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:07.868080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:07.901662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:07.901701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:07.901708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:07.901716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:08.068185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:08.101973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:08.102009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:08.102035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:08.102045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:08.268300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:08.302307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:08.302345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:08.302352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:08.302360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:08.356992] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:08.468412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:08.502651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:08.502693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:08.502702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:08.502711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:08.540261] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:08.668519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:08.682584] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042628682581, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 16:17:08.684038] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726042628684035, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:17:08.703034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:08.703080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:08.703088] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:08.703098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:08.868619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:08.903438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:08.903473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:08.903480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:08.903488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:09.068757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:09.103792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:09.103829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:09.103838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:09.103848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:09.112182] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8319, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:17:09.268864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:09.312516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:09.312549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:09.312556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:09.312564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:09.357140] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:09.468985] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:09.512805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:09.512853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:09.512861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:09.512870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:09.540992] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:09.669098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:09.690229] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042629690226, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007645, add_bytes: 0 [2024-09-11 16:17:09.691599] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042629691597, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:17:09.713121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:09.713165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:09.713173] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:09.713182] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:09.873562] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4341, replace_start_pos=100000, replace_num=100000) [2024-09-11 16:17:09.873609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:09.913428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:09.913474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:09.913481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:09.913491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:10.073693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:10.113784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:10.113824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:10.113832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:10.113842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:10.273806] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:10.314093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:10.314132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:10.314138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:10.314147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:10.357319] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:10.473914] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:10.514369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:10.514404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:10.514411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:10.514418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:10.541782] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:10.674035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:10.697796] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042630697792, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:17:10.699271] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042630699269, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:17:10.714667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:10.714711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:10.714719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:10.714728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:10.874143] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:10.914980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:10.915020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:10.915027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:10.915050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:11.074247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:11.115348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:11.115391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:11.115399] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:11.115408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:11.123772] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8351, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:17:11.274356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:11.324039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:11.324075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:11.324082] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:11.324092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:11.357542] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:11.474466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:11.524393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:11.524436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:11.524444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:11.524472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:11.542521] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:11.674579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:11.705405] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042631705401, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:17:11.706827] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042631706826, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:17:11.724700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:11.724746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:11.724752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:11.724761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:11.874830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:11.924994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:11.925038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:11.925045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:11.925054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:12.079333] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4378, replace_start_pos=200000, replace_num=100000) [2024-09-11 16:17:12.079375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:12.125287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:12.125326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:12.125334] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:12.125343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:12.279456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:12.325696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:12.325746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:12.325755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:12.325764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:12.357720] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:12.479564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:12.526084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:12.526116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:12.526123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:12.526132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:12.540726] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:12.540767] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:12.540847] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=165, max_check_version=166, global_version=167) [2024-09-11 16:17:12.542766] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1919 [2024-09-11 16:17:12.542795] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:12.542849] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:17:12.542887] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:17:12.542982] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:12.543092] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:17:12.543147] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:17:12.543158] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:17:12.543169] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:17:12.543205] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:17:12.543235] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:12.543266] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:17:12.543308] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:17:12.679676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:12.713165] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042632713160, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007759, add_bytes: 0 [2024-09-11 16:17:12.714507] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042632714505, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:17:12.726422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:12.726458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:12.726486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:12.726495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:12.879780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:12.926721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:12.926761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:12.926769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:12.926778] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:13.079877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:13.127072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:13.127112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:13.127119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:13.127129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:13.134618] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7475, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:17:13.279988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:13.334970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:13.335006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:13.335014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:13.335045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:13.357897] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:13.480097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:13.535279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:13.535322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:13.535330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:13.535340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:13.543983] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:13.680210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:13.720639] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042633720636, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007476, add_bytes: 0 [2024-09-11 16:17:13.722123] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042633722121, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:17:13.735584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:13.735630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:13.735638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:13.735646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:13.880323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:13.935888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:13.935946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:13.935953] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:13.935962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:14.080431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:14.136190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:14.136243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:14.136249] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:14.136257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:14.284875] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=300000, replace_num=100000) [2024-09-11 16:17:14.284923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:14.336503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:14.336545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:14.336552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:14.336561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:14.358055] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:14.485008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:14.536794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:14.536836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:14.536843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:14.536853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:14.545154] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:14.685123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:14.728308] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042634728305, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:17:14.729681] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042634729679, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:17:14.737085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:14.737120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:14.737127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:14.737136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:14.885235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:14.937383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:14.937419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:14.937427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:14.937436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:15.085355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:15.137662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:15.137701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:15.137708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:15.137717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:15.145742] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8012, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:17:15.285467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:15.346022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:15.346061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:15.346067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:15.346074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:15.358256] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:15.485576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:15.546039] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:15.546382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:15.546418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:15.546426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:15.546435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:15.685691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:15.735868] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042635735865, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:17:15.737284] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042635737283, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:17:15.746704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:15.746753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:15.746761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:15.746770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:15.885802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:15.947039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:15.947084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:15.947091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:15.947099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:16.085927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:16.147327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:16.147372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:16.147379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:16.147389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:16.286034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:16.347687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:16.347733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:16.347743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:16.347756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:16.358439] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=95] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:16.490554] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4400, replace_start_pos=400000, replace_num=100000) [2024-09-11 16:17:16.490595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:16.546878] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:16.548019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:16.548054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:16.548061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:16.548070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:16.690681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:16.743470] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726042636743466, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:17:16.744917] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042636744916, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:17:16.748325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:16.748366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:16.748374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:16.748384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:16.890785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:16.948607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:16.948667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:16.948675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:16.948683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:17.090894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:17.148939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:17.148980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:17.148986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:17.148994] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:17.156011] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7004, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:17:17.291025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:17.356273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:17.356312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:17.356320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:17.356329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:17.358573] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:17.491092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:17.547792] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:17.556628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:17.556667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:17.556676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:17.556686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:17.691205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:17.751114] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042637751111, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007645, add_bytes: 0 [2024-09-11 16:17:17.752519] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042637752518, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:17:17.756996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:17.757028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:17.757034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:17.757042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:17.891323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:17.957281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:17.957327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:17.957334] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:17.957342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:18.091503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:18.157568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:18.157621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:18.157628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:18.157637] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:18.291688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:18.357861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:18.357946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=84][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:18.357955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:18.357965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:18.358750] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=30] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:18.491807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:18.548680] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:18.558189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:18.558227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:18.558233] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:18.558240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:18.696261] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4341, replace_start_pos=500000, replace_num=100000) [2024-09-11 16:17:18.696302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:18.758476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:18.758519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:18.758527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:18.758535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:18.758711] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726042638758709, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:17:18.760213] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042638760211, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:17:18.896388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:18.958767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:18.958810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:18.958817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:18.958826] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:19.096507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:19.159099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:19.159141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:19.159149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:19.159158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:19.166445] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7272, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:17:19.296629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:19.358872] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:19.366704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:19.366744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:19.366750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:19.366758] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:19.496745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:19.549480] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:19.567015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:19.567045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:19.567050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:19.567058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:19.696870] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:19.766337] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726042639766333, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:17:19.767280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:19.767313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:19.767340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:19.767348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:19.767814] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042639767812, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:17:19.897000] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:19.967576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:19.967614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:19.967620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:19.967628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:20.097119] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:20.167858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:20.167924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:20.167933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:20.167942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:20.297235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:20.359009] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:20.368177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:20.368220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:20.368227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:20.368255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:20.497345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:20.550422] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:20.568472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:20.568505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:20.568526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:20.568533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:20.697463] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:20.768761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:20.768804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:20.768811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:20.768820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:20.774052] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042640774048, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007715, add_bytes: 0 [2024-09-11 16:17:20.775365] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042640775363, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:17:20.901957] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4371, replace_start_pos=600000, replace_num=100000) [2024-09-11 16:17:20.901999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:20.969064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:20.969108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:20.969116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:20.969125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:21.102083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:21.169362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:21.169419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:21.169428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:21.169437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:21.177105] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7655, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:17:21.302196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:21.359243] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:21.377381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:21.377427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:21.377434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:21.377443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:21.502302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:21.551140] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:21.577741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:21.577781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:21.577790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:21.577799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:21.702403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:21.778114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:21.778158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:21.778166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:21.778177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:21.781550] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042641781547, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007499, add_bytes: 0 [2024-09-11 16:17:21.783061] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042641783058, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 16:17:21.902521] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:21.978417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:21.978463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:21.978471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:21.978480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:22.102640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:22.178745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:22.178790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:22.178796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:22.178804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:22.302825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:22.359364] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:22.379027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:22.379069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:22.379076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:22.379083] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:22.502957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:22.552120] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:22.559564] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:22.559611] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:22.559692] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=166, max_check_version=167, global_version=168) [2024-09-11 16:17:22.561700] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2007 [2024-09-11 16:17:22.561749] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:22.561790] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:17:22.561828] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:17:22.561921] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:22.562030] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:17:22.562095] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:17:22.562104] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:17:22.562113] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:17:22.562144] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:17:22.562195] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:17:22.562210] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:17:22.579297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:22.579342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:22.579350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:22.579359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:22.703101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:22.779605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:22.779659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:22.779668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:22.779677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:22.789170] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042642789166, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:17:22.790599] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042642790598, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007540, add_bytes: 0 [2024-09-11 16:17:22.903219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:22.979946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:22.980008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:22.980016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:22.980026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:23.106997] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3670, replace_start_pos=700000, replace_num=100000) [2024-09-11 16:17:23.107043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:23.180354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:23.180392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:23.180400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:23.180409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:23.188865] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8442, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:17:23.307126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:23.359551] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:23.389199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:23.389242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:23.389250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:23.389260] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:23.507305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:23.589489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:23.589555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:23.589563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:23.589572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:23.653010] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:23.707425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:23.789808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:23.789841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:23.789849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:23.789858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:23.796860] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042643796857, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:17:23.798215] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042643798213, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:17:23.907606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:23.990090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:23.990128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:23.990134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:23.990142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:24.107733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:24.190383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:24.190431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:24.190462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:24.190471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:24.307922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:24.359670] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:24.390704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:24.390745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:24.390751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:24.390760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:24.508124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:24.591009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:24.591044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:24.591051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:24.591059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:24.653846] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:24.708240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:24.791271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:24.791309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:24.791315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:24.791323] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:24.804405] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042644804401, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:17:24.805831] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042644805828, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:17:24.908347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:24.991616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:24.991660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:24.991668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:24.991677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:25.108466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:25.192005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:25.192048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:25.192055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:25.192063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:25.198629] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6554, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:17:25.312824] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4236, replace_start_pos=800000, replace_num=100000) [2024-09-11 16:17:25.312862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:25.359859] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:25.398893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:25.398963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:25.398970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:25.398980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:25.512947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:25.599293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:25.599334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:25.599343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:25.599368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:25.655000] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=105] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:25.713064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:25.799606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:25.799649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:25.799675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:25.799684] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:25.799900] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=94, refresh_score_time=63, wash_time=0) [2024-09-11 16:17:25.812091] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042645812088, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:17:25.813515] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042645813513, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:17:25.913249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:26.000267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:26.000316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:26.000324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:26.000333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:26.113372] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:26.200629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:26.200664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:26.200671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:26.200679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:26.313483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:26.360096] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=87] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:26.401011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:26.401066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:26.401074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:26.401084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:26.513590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:26.601333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:26.601377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:26.601384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:26.601393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:26.655991] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:26.713720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:26.801630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:26.801676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:26.801682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:26.801691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:26.819634] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042646819631, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:17:26.821170] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042646821167, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007654, add_bytes: 0 [2024-09-11 16:17:26.913834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:27.001952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:27.001995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:27.002003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:27.002012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:27.113970] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:27.202244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:27.202291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:27.202298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:27.202307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:27.209276] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6956, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:17:27.314201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:27.360229] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:27.409542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:27.409582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:27.409589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:27.409598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:27.518685] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4365, replace_start_pos=900000, replace_num=100000) [2024-09-11 16:17:27.518729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:27.609832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:27.609872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:27.609880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:27.609889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:27.656954] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:27.718817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:27.810149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:27.810206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:27.810221] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:27.810230] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:27.827319] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042647827316, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:17:27.828743] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042647828742, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 16:17:27.919000] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:28.010467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:28.010514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:28.010522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:28.010531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:28.119188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:28.210765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:28.210806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:28.210814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:28.210822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:28.319322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:28.360362] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:28.411064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:28.411121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:28.411130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:28.411139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:28.519440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:28.611395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:28.611442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:28.611450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:28.611459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:28.658060] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:28.719618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:28.811693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:28.811737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:28.811743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:28.811752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:28.834930] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042648834926, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:17:28.836363] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042648836361, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:17:28.919800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:29.011996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:29.012029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:29.012035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:29.012043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:29.120078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:29.212278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:29.212322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:29.212329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:29.212355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:29.220869] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8501, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:17:29.320203] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:29.360561] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:29.421146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:29.421190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:29.421199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:29.421208] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:29.421394] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:17:29.520325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:29.621620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:29.621659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:29.621667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:29.621675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:29.659391] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:29.724597] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4070, replace_start_pos=1000000, replace_num=100000) [2024-09-11 16:17:29.724642] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:29.821917] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:29.821961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:29.821968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:29.821977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:29.842547] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042649842543, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:17:29.843978] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042649843976, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:17:29.924784] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:30.022230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:30.022267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:30.022273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:30.022282] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:30.124973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:30.222505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:30.222543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:30.222550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:30.222559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:30.325161] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:30.360670] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:30.422786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:30.422822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:30.422830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:30.422839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:30.525289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:30.623099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:30.623145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:30.623152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:30.623162] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:30.660591] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:30.725399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:30.823403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:30.823445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:30.823453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:30.823461] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:30.850115] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042650850111, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 16:17:30.851544] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042650851543, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:17:30.925499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:31.023765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:31.023807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:31.023815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:31.023825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:31.125614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:31.224161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:31.224200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:31.224208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:31.224218] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:31.231225] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6975, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:17:31.325731] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:31.360816] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:31.431550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:31.431593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:31.431601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:31.431611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:31.525842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:31.631940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:31.631983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:31.631992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:31.632002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:31.661355] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:31.725952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:31.832301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:31.832342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:31.832350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:31.832359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:31.857734] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042651857729, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:17:31.859139] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042651859137, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:17:31.930396] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4337, replace_start_pos=1100000, replace_num=100000) [2024-09-11 16:17:31.930438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:32.032605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:32.032648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:32.032655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:32.032664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:32.130543] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:32.232895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:32.232955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:32.232961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:32.232969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:32.330651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:32.360933] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:32.433194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:32.433239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:32.433247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:32.433256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:32.530763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:32.574761] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:32.574825] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=62] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:32.574931] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=167, max_check_version=168, global_version=169) [2024-09-11 16:17:32.576961] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2028 [2024-09-11 16:17:32.577003] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:32.577038] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:17:32.577077] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:17:32.577175] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:32.577302] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:17:32.577359] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:17:32.577371] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:17:32.577382] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:17:32.577423] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:17:32.577483] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:17:32.577505] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:17:32.633501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:32.633534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:32.633540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:32.633549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:32.662287] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:32.730884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:32.833778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:32.833831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:32.833838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:32.833847] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:32.865409] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042652865405, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:17:32.866767] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042652866765, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:17:32.931126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:33.034085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:33.034125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:33.034130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:33.034157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:33.131310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:33.234377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:33.234427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:33.234434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:33.234442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:33.241690] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7236, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:17:33.331496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:33.361063] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:33.441965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:33.442019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:33.442027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:33.442036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:33.531620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:33.642261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:33.642302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:33.642308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:33.642333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:33.663292] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:33.731808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:33.842561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:33.842606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:33.842631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:33.842640] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:33.872952] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042653872947, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:17:33.874388] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042653874385, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:17:33.932014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:34.042871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:34.042935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:34.042945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:34.042953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:34.136466] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4317, replace_start_pos=1200000, replace_num=100000) [2024-09-11 16:17:34.136516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:34.243178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:34.243221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:34.243228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:34.243238] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:34.336679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:34.361176] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:34.443457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:34.443507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:34.443515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:34.443523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:34.536803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:34.643766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:34.643808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:34.643815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:34.643823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:34.664207] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:34.736935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:34.844065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:34.844109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:34.844117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:34.844126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:34.880577] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042654880573, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:17:34.881997] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042654881995, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:17:34.937100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:35.044361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:35.044402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:35.044408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:35.044417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:35.137236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:35.244667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:35.244711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:35.244718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:35.244727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:35.252876] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8135, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:17:35.337465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:35.361297] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:35.453120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:35.453166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:35.453174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:35.453183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:35.537584] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:35.653433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:35.653479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:35.653487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:35.653497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:35.665072] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:35.737697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:35.853788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:35.853833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:35.853841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:35.853850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:35.888197] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042655888193, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:17:35.889612] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726042655889609, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:17:35.937805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:36.054172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:36.054215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:36.054223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:36.054233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:36.137916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:36.254524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:36.254560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:36.254567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:36.254574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:36.342356] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=1300000, replace_num=100000) [2024-09-11 16:17:36.342398] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:36.361500] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:36.454790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:36.454838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:36.454846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:36.454876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:36.542482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:36.655192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:36.655236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:36.655244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:36.655254] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:36.665851] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:36.742675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:36.855549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:36.855594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:36.855601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:36.855611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:36.895887] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042656895883, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:17:36.897289] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042656897287, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:17:36.942798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:37.055930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:37.055972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:37.055979] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:37.055987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:37.142927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:37.256293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:37.256339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:37.256347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:37.256382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:37.264500] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8102, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:17:37.343025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:37.361637] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:37.464854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:37.464916] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:37.464924] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:37.464932] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:37.543138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:37.665168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:37.665209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:37.665216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:37.665225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:37.666675] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:37.743261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:37.865547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:37.865597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:37.867443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=1845][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:37.867468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:37.903429] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042657903424, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:17:37.904932] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042657904929, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007642, add_bytes: 0 [2024-09-11 16:17:37.943366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:38.067708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:38.067750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:38.067757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:38.067766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:38.143500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:38.267998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:38.268031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:38.268038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:38.268046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:38.343615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:38.361811] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:38.468273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:38.468316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:38.468323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:38.468333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:38.548076] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4355, replace_start_pos=1400000, replace_num=100000) [2024-09-11 16:17:38.548125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:38.667432] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:38.668625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:38.668661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:38.668669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:38.668678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:38.748222] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:38.868968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:38.869009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:38.869017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:38.869026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:38.911104] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042658911100, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:17:38.912527] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042658912525, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:17:38.948327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:39.069243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:39.069283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:39.069290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:39.069298] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:39.148436] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:39.269511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:39.269551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:39.269558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:39.269565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:39.276154] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6575, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:17:39.348538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:39.362006] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:39.476415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:39.476454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:39.476462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:39.476470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:39.548646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:39.668155] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:39.676769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:39.676809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:39.676816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:39.676826] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:39.748768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:39.877055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:39.877099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:39.877106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:39.877113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:39.918648] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042659918643, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:17:39.920142] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042659920141, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:17:39.948882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:40.077341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:40.077388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:40.077394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:40.077423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:40.149019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:40.277670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:40.277724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:40.277733] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:40.277742] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:40.349134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:40.362175] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:40.478188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:40.478231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:40.478237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:40.478245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:40.549330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:40.669211] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:40.678483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:40.678526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:40.678534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:40.678543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:40.753804] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=1500000, replace_num=100000) [2024-09-11 16:17:40.753854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:40.878778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:40.878817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:40.878840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:40.878849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:40.926254] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042660926251, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:17:40.927753] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042660927750, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:17:40.953939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:41.079140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:41.079185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:41.079193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:41.079202] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:41.154119] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:41.279497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:41.279541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:41.279549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:41.279559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:41.287164] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7590, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:17:41.354251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:41.362334] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:41.487483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:41.487527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:41.487534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:41.487544] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:41.554431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:41.670253] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:41.687779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:41.687818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:41.687827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:41.687836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:41.754611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:41.888145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:41.888191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:41.888199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:41.888208] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:41.933883] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042661933880, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:17:41.935311] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042661935310, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:17:41.954732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:42.088516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:42.088553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:42.088561] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:42.088569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:42.154844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:42.288816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:42.288857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:42.288865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:42.288875] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:42.355005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=88] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:42.362476] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:42.489158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:42.489206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:42.489214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:42.489223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:42.555116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:42.591530] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:42.591574] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:42.591655] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=168, max_check_version=169, global_version=170) [2024-09-11 16:17:42.593652] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1997 [2024-09-11 16:17:42.593713] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:42.593748] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:17:42.593785] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:17:42.593868] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:42.593989] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:17:42.594047] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:17:42.594059] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:17:42.594070] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:17:42.594106] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:17:42.594165] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:17:42.594187] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:17:42.689431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:42.689471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:42.689477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:42.689485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:42.755223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:42.771088] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:42.889714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:42.889756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:42.889763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:42.889772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:42.941500] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042662941496, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:17:42.942986] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042662942984, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:17:42.959413] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4083, replace_start_pos=1600000, replace_num=100000) [2024-09-11 16:17:42.959451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:43.090019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:43.090061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:43.090069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:43.090078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:43.159533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:43.290372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:43.290438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:43.290448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:43.290458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:43.297785] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7313, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:17:43.359648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:43.362648] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:43.498102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:43.498141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:43.498150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:43.498160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:43.559761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:43.698364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:43.698392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:43.698398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:43.698406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:43.759875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:43.771974] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:43.898654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:43.898699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:43.898707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:43.898716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:43.949116] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042663949112, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:17:43.950637] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042663950636, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007652, add_bytes: 0 [2024-09-11 16:17:43.959999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:44.098989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:44.099033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:44.099041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:44.099051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:44.160106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:44.299297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:44.299341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:44.299348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:44.299357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:44.360216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:44.362848] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:44.499731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:44.499775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:44.499783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:44.499793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:44.560332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:44.700046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:44.700091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:44.700098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:44.700108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:44.760465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:44.772692] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:44.900352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:44.900397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:44.900404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:44.900414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:44.956743] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042664956740, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:17:44.958217] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042664958216, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007580, add_bytes: 0 [2024-09-11 16:17:44.960576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:45.100627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:45.100667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:45.100673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:45.100681] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:45.165015] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4344, replace_start_pos=1700000, replace_num=100000) [2024-09-11 16:17:45.165057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:45.300946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:45.300989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:45.300996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:45.301005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:45.309085] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8046, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:17:45.362969] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:45.365139] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:45.509404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:45.509448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:45.509456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:45.509465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:45.565238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:45.709697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:45.709744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:45.709759] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:45.709769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:45.765355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:45.773421] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:45.910020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:45.910064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:45.910072] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:45.910081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:45.964346] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042665964343, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:17:45.965492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:45.965837] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042665965834, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:17:46.110295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:46.110357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:46.110363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:46.110371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:46.110560] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=90, refresh_score_time=54, wash_time=0) [2024-09-11 16:17:46.165661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:46.310793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:46.310838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:46.310846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:46.310855] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:46.363179] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:46.365791] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:46.511086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:46.511126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:46.511133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:46.511141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:46.565893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:46.711422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:46.711472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:46.711501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:46.711515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:46.766032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:46.774358] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:46.911755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:46.911818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:46.911827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:46.911836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:46.966156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:46.971953] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042666971950, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:17:46.973454] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042666973452, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:17:47.112046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:47.112092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:47.112098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:47.112106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:47.166268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:47.312331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:47.312381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:47.312396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:47.312409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:47.320955] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8527, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:17:47.363313] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:47.370130] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3642, replace_start_pos=1800000, replace_num=100000) [2024-09-11 16:17:47.370168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:47.521199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:47.521243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:47.521250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:47.521259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:47.570268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:47.721507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:47.721552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:47.721560] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:47.721569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:47.770398] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:47.775367] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:47.921795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:47.921841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:47.921848] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:47.921858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:47.970534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:47.979682] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042667979679, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007729, add_bytes: 0 [2024-09-11 16:17:47.981064] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042667981062, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:17:48.122077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:48.122120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:48.122127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:48.122153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:48.170676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:48.322378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:48.322422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:48.322429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:48.322439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:48.363508] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:48.370797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:48.522665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:48.522710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:48.522719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:48.522730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:48.570923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:48.722986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:48.723035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:48.723043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:48.723052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:48.771062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:48.776390] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:48.923320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:48.923364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:48.923371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:48.923397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:48.971178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:48.987205] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042668987200, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007521, add_bytes: 0 [2024-09-11 16:17:48.988637] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042668988634, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 16:17:49.123612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:49.123657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:49.123663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:49.123670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:49.171361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:49.323936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:49.323981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:49.323988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:49.323997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:49.332738] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8726, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:17:49.363645] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:49.371496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:49.533034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:49.533080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:49.533106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:49.533115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:49.575984] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4357, replace_start_pos=1900000, replace_num=100000) [2024-09-11 16:17:49.576029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:49.733418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:49.733462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:49.733470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:49.733480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:49.776110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:49.777193] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:49.933781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:49.933825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:49.933833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:49.933843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:49.976231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:49.994891] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042669994887, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:17:49.996296] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042669996294, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007660, add_bytes: 0 [2024-09-11 16:17:50.134136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:50.134181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:50.134189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:50.134198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:50.176340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:50.334421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:50.334465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:50.334472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:50.334479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:50.363835] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:50.376490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:50.534714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:50.534758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:50.534766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:50.534775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:50.576626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:50.735028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:50.735070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:50.735079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:50.735089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:50.776824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:50.777946] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:50.935392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:50.935430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:50.935437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:50.935444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:50.976959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:51.002439] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042671002435, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:17:51.003855] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042671003852, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:17:51.135662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:51.135704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:51.135710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:51.135718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:51.177163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:51.335980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:51.336024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:51.336031] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:51.336041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:51.344342] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8287, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:17:51.364020] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=98] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:51.377302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:51.544620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:51.544671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:51.544678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:51.544686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:51.577437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:51.745004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:51.745059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:51.745067] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:51.745077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:51.778690] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:51.782013] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4450, replace_start_pos=2000000, replace_num=100000) [2024-09-11 16:17:51.782052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:51.945303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:51.945347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:51.945354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:51.945361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:51.982206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:52.010062] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042672010057, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:17:52.011525] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042672011523, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:17:52.145589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:52.145632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:52.145638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:52.145646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:52.182394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:52.345870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:52.345949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=78][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:52.345957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:52.345987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:52.364150] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:52.382519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:52.546232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:52.546281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:52.546288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:52.546297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:52.582663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:52.609118] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:52.609173] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:17:52.609262] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=169, max_check_version=170, global_version=171) [2024-09-11 16:17:52.611417] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2154 [2024-09-11 16:17:52.611456] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:52.611513] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:17:52.611551] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:17:52.611636] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:17:52.611745] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:17:52.611801] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:17:52.611813] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:17:52.611824] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:17:52.611860] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:17:52.611934] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:17:52.611957] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:17:52.746523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:52.746559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:52.746564] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:52.746572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:52.779845] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:52.782829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:52.946811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:52.946851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:52.946859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:52.946868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:52.982997] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:53.017648] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042673017643, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007586, add_bytes: 0 [2024-09-11 16:17:53.019195] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042673019192, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:17:53.147090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:53.147137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:53.147144] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:53.147154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:53.183126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:53.347377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:53.347420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:53.347426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:53.347434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:53.354271] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6825, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:17:53.364289] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:53.383258] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:53.554547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:53.554591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:53.554598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:53.554607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:53.583380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:53.754827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:53.754878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:53.754885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:53.754893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:53.780996] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=105] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:53.783505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:53.955142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:53.955186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:53.955193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:53.955203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:53.987041] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3360, replace_start_pos=2100000, replace_num=100000) [2024-09-11 16:17:53.987084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:54.025279] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042674025275, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:17:54.026774] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042674026771, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007579, add_bytes: 0 [2024-09-11 16:17:54.155493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:54.155551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:54.155559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:54.155569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:54.187171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:54.355806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:54.355852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:54.355859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:54.355868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:54.364407] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:54.387305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:54.556098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:54.556142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:54.556150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:54.556160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:54.587420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:54.756365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:54.756407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:54.756413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:54.756436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:54.782022] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:54.787530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:54.956728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:54.956772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:54.956799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:54.956809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:54.987626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:55.032899] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042675032895, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:17:55.034330] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042675034327, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:17:55.157060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:55.157103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:55.157110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:55.157118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:55.187735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:55.357412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:55.357456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:55.357464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:55.357473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:55.364340] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6854, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:17:55.364543] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:55.387851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:55.564692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:55.564737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:55.564745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:55.564754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:55.587987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:55.764999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:55.765042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:55.765049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:55.765058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:55.783020] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:55.788098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:55.965285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:55.965329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:55.965337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:55.965346] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:55.988282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:56.040504] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042676040500, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:17:56.041995] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042676041992, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:17:56.165565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:56.165608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:56.165615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:56.165622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:56.191711] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3315, replace_start_pos=2200000, replace_num=100000) [2024-09-11 16:17:56.191772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:56.364656] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:56.365872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:56.365918] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:56.365930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:56.365940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:56.391857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:56.566167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:56.566212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:56.566218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:56.566225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:56.591972] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:56.766452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:56.766497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:56.766504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:56.766511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:56.784059] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:56.792104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:56.966738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:56.966781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:56.966789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:56.966798] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:56.992231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:57.048120] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042677048117, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:17:57.049620] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042677049617, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:17:57.167068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:57.167113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:57.167121] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:57.167130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:57.192354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:57.364876] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:57.367340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:57.367367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:57.367372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:57.367380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:57.373844] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6454, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:17:57.392470] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:57.574159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:57.574204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:57.574212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:57.574244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:57.592585] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:57.774477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:57.774516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:57.774523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:57.774532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:57.785036] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:57.792721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:17:57.974826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:57.974862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:57.974870] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:57.974879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:57.992827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:17:58.055740] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042678055736, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:17:58.057165] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042678057163, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:17:58.175124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:58.175170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:58.175178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:58.175187] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:58.192945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:17:58.365008] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:58.375484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:58.375525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:58.375555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:58.375565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:58.396379] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3318, replace_start_pos=2300000, replace_num=100000) [2024-09-11 16:17:58.396422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:17:58.575866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:58.575956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=89][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:58.575971] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:58.575981] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:58.596505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:17:58.776210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:58.776259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:58.776266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:58.776274] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:58.786016] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:58.796634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:17:58.976605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:58.976649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:58.976657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:58.976665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:58.996758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:17:59.063350] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042679063346, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:17:59.064898] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=152] PNIO [ratelimit] time: 1726042679064896, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007733, add_bytes: 0 [2024-09-11 16:17:59.176890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:59.176954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:59.176962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:59.176970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:59.196880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:17:59.365148] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:17:59.377186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:59.377229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:59.377235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:59.377242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:59.384092] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6838, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:17:59.397107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:17:59.584340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:59.584378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:59.584384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:59.584392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:59.584552] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:17:59.597228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:17:59.784807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:59.784850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:59.784859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:59.784868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:59.786752] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:17:59.797347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:17:59.985136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:17:59.985176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:17:59.985184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:17:59.985193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:17:59.997447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:00.066469] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:18:00.068640] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:18:00.070976] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042680070973, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:18:00.071008] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:18:00.072405] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726042680072403, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007507, add_bytes: 0 [2024-09-11 16:18:00.072428] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:18:00.185421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:00.185466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:00.185472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:00.185480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:00.197561] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:00.365264] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:00.385714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:00.385756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:00.385764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:00.385773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:00.397721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:00.586032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:00.586076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:00.586084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:00.586093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:00.601134] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3291, replace_start_pos=2400000, replace_num=100000) [2024-09-11 16:18:00.601179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:00.786318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:00.786367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:00.786375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:00.786384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:00.787481] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:00.801263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:00.986603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:00.986642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:00.986649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:00.986657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:01.001374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:01.078593] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=5] PNIO [ratelimit] time: 1726042681078588, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:18:01.080057] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726042681080056, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007653, add_bytes: 0 [2024-09-11 16:18:01.186920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:01.186965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:01.186974] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:01.186982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:01.201532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:01.365414] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:01.387241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:01.387290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:01.387298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:01.387306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:01.396411] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9089, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:18:01.401647] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:01.596706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:01.596756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:01.596763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:01.596791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:01.601756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:01.788213] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:01.797101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:01.797140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:01.797166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:01.797176] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:01.801867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:01.997416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:01.997457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:01.997464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:01.997472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:02.001982] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:02.086208] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042682086204, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:18:02.087625] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726042682087623, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:18:02.197702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:02.197755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:02.197762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:02.197771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:02.202097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:02.365618] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:02.398079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:02.398124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:02.398150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:02.398159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:02.402268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:02.598469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:02.598523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:02.598532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:02.598543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:02.602374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:02.626583] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:02.626629] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:02.626713] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=170, max_check_version=171, global_version=172) [2024-09-11 16:18:02.628755] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2042 [2024-09-11 16:18:02.628794] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:02.628847] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:18:02.628886] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:18:02.628984] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:02.629092] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:18:02.629151] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:18:02.629162] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:18:02.629182] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:18:02.629213] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:18:02.629261] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:18:02.629279] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:18:02.788948] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:02.798774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:02.798815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:02.798822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:02.798831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:02.806815] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=2500000, replace_num=100000) [2024-09-11 16:18:02.806852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:02.999085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:02.999127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:02.999135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:02.999144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:03.006933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:03.093831] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042683093827, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:18:03.095253] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042683095250, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:18:03.199376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:03.199420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:03.199428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:03.199437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:03.207040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:03.365756] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:03.399665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:03.399712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:03.399721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:03.399749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:03.407070] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7307, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:18:03.407144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:03.607249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:03.607391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:03.607426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:03.607435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:03.607444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:03.789752] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:03.807359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:03.807673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:03.807704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:03.807710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:03.807718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:04.007457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:04.007988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:04.008024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:04.008032] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:04.008041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:04.101444] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042684101440, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:18:04.102857] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=694] PNIO [ratelimit] time: 1726042684102856, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:18:04.207568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:04.208264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:04.208299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:04.208305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:04.208313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:04.365872] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:04.407686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:04.408621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:04.408658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:04.408666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:04.408675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:04.607794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:04.609000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:04.609035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:04.609043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:04.609053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:04.790479] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:04.807922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:04.809347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:04.809379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:04.809386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:04.809395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:05.009613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:05.009653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:05.009676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:05.009684] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:05.012382] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=2600000, replace_num=100000) [2024-09-11 16:18:05.012420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:05.109133] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042685109129, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:18:05.110480] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042685110478, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:18:05.209891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:05.209951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:05.209957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:05.209965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:05.212503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:05.366017] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:05.410198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:05.410245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:05.410252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:05.410261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:05.412613] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:05.418854] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8579, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:18:05.612817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:05.619220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:05.619263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:05.619270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:05.619278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:05.791301] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:05.812945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:05.819507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:05.819542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:05.819549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:05.819557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:06.013050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:06.019857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:06.019892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:06.019919] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:06.019930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:06.116672] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042686116666, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:18:06.118160] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042686118157, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:18:06.213162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:06.220161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:06.220198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:06.220205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:06.220232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:06.366163] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:06.413289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:06.420454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:06.420489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:06.420496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:06.420505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:06.420722] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=67, refresh_score_time=67, wash_time=0) [2024-09-11 16:18:06.613415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:06.620991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:06.621028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:06.621035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:06.621044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:06.792055] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:06.813542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:06.821294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:06.821334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:06.821342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:06.821351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:07.013658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:07.021647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:07.021682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:07.021709] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:07.021719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:07.124294] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042687124290, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:18:07.125828] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042687125826, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:18:07.218156] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4364, replace_start_pos=2700000, replace_num=100000) [2024-09-11 16:18:07.218203] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:07.221971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:07.222006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:07.222014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:07.222023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:07.366302] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:07.418287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:07.422316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:07.422349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:07.422357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:07.422366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:07.429647] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7268, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:18:07.618394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:07.630008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:07.630046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:07.630054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:07.630063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:07.792820] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:07.818533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:07.830303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:07.830335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:07.830343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:07.830353] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:08.018629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:08.030598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:08.030636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:08.030644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:08.030653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:08.131900] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042688131895, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:18:08.133342] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042688133340, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007514, add_bytes: 0 [2024-09-11 16:18:08.218839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:08.230976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:08.231013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:08.231019] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:08.231033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:08.366413] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:08.419023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:08.431276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:08.431316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:08.431323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:08.431332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:08.619200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:08.631565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:08.631609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:08.631616] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:08.631625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:08.793920] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:08.819327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:08.831852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:08.831895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:08.831918] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:08.831929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:09.019462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:09.032129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:09.032164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:09.032171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:09.032178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:09.139509] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726042689139506, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:18:09.140949] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=420] PNIO [ratelimit] time: 1726042689140947, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:18:09.219648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:09.232422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:09.232469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:09.232477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:09.232486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:09.366600] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:09.424223] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4374, replace_start_pos=2800000, replace_num=100000) [2024-09-11 16:18:09.424272] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:09.432690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:09.432731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:09.432737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:09.432745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:09.439598] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6840, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:18:09.624416] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:09.639852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:09.639896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:09.639944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:09.639953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:09.795102] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:09.824616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:09.840186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:09.840253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:09.840261] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:09.840270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:10.024741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:10.040505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:10.040546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:10.040553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:10.040562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:10.147138] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042690147135, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:18:10.148618] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042690148616, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:18:10.224920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:10.240796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:10.240840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:10.240847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:10.240856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:10.366775] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:10.425055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:10.441065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:10.441121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:10.441128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:10.441136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:10.625187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:10.641370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:10.641408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:10.641416] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:10.641425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:10.796552] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:10.825308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:10.841646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:10.841692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:10.841700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:10.841709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:11.025435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:11.041956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:11.041991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:11.041997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:11.042005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:11.154750] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042691154745, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:18:11.156183] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042691156180, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:18:11.225627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:11.242245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:11.242289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:11.242297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:11.242306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:11.366988] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:11.425828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:11.442540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:11.442584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:11.442591] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:11.442600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:11.450699] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8085, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:18:11.630379] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4363, replace_start_pos=2900000, replace_num=100000) [2024-09-11 16:18:11.630426] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:11.650964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:11.651009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:11.651016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:11.651025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:11.797351] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:11.830570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:11.851276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:11.851319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:11.851326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:11.851335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:12.030754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:12.051574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:12.051618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:12.051625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:12.051632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:12.162359] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042692162356, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:18:12.163789] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042692163787, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:18:12.230945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:12.251864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:12.251927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:12.251936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:12.251945] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:12.367117] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:12.431136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:12.452162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:12.452205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:12.452211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:12.452237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:12.631399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:12.643875] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:12.643948] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=70] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:12.644032] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=171, max_check_version=172, global_version=173) [2024-09-11 16:18:12.646054] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2020 [2024-09-11 16:18:12.646087] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:12.646123] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:18:12.646160] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:18:12.646266] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:12.646374] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:18:12.646426] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:18:12.646437] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:18:12.646452] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:18:12.646494] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:18:12.646542] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:18:12.646560] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:18:12.652449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:12.652482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:12.652489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:12.652496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:12.798150] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:12.831521] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:12.852733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:12.852775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:12.852782] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:12.852791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:13.031631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:13.053059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:13.053112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:13.053119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:13.053127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:13.170049] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042693170045, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:18:13.171415] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042693171412, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:18:13.231740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:13.253352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:13.253390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:13.253398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:13.253407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:13.367252] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:13.431852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:13.453642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:13.453685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:13.453693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:13.453702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:13.460406] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6689, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:18:13.632039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:13.660674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:13.660718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:13.660725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:13.660734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:13.799191] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:13.836523] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4335, replace_start_pos=3000000, replace_num=100000) [2024-09-11 16:18:13.836566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:13.860990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:13.861027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:13.861035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:13.861044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:14.036713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:14.061262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:14.061305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:14.061312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:14.061320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:14.177653] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726042694177649, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:18:14.179020] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=413] PNIO [ratelimit] time: 1726042694179018, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:18:14.236898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:14.261547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:14.261593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:14.261601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:14.261633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:14.367364] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:14.437128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:14.461858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:14.461934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:14.461947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:14.461958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:14.637313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:14.662209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:14.662261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:14.662269] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:14.662278] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:14.799992] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:14.837500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:14.862485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:14.862523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:14.862529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:14.862536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:15.037703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:15.062767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:15.062804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:15.062811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:15.062838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:15.185283] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042695185279, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:18:15.186640] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042695186639, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:18:15.237919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:15.263143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:15.263188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:15.263196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:15.263205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:15.367514] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:15.438039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:15.463503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:15.463549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:15.463558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:15.463567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:15.472100] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8520, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:18:15.638233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:15.672429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:15.672473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:15.672503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:15.672516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:15.801134] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:15.838335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:15.872748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:15.872813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:15.872819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:15.872826] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:16.041804] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3348, replace_start_pos=3100000, replace_num=100000) [2024-09-11 16:18:16.041856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:16.073067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:16.073113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:16.073121] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:16.073130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:16.192841] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042696192837, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:18:16.194314] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042696194311, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:18:16.241981] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:16.273373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:16.273429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:16.273441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:16.273454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:16.367668] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:16.442186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:16.473725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:16.473762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:16.473768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:16.473775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:16.642330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:16.674343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:16.674391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:16.674397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:16.674405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:16.802149] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:16.842450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:16.874649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:16.874695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:16.874703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:16.874712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:17.042644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:17.075060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:17.075104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:17.075112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:17.075122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:17.200448] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042697200445, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:18:17.201866] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042697201863, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:18:17.242763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:17.275371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:17.275419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:17.275426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:17.275435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:17.367880] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:17.442879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:17.475677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:17.475721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:17.475729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:17.475738] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:17.484238] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8487, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:18:17.643020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:17.684492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:17.684540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:17.684548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:17.684556] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:17.803314] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:17.843147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:17.884808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:17.884852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:17.884860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:17.884885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:18.043281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:18.085122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:18.085167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:18.085174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:18.085183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:18.208054] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042698208049, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:18:18.209482] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1726042698209480, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:18:18.247461] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4054, replace_start_pos=3200000, replace_num=100000) [2024-09-11 16:18:18.247499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:18.285495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:18.285537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:18.285545] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:18.285555] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:18.368074] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:18.447582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:18.485772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:18.485815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:18.485838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:18.485846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:18.647708] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:18.686065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:18.686108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:18.686114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:18.686122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:18.804462] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:18.847828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:18.886347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:18.886388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:18.886396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:18.886405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:19.047948] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:19.086631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:19.086684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:19.086690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:19.086698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:19.215739] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042699215735, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:18:19.217104] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=208] PNIO [ratelimit] time: 1726042699217102, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:18:19.248068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:19.287033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:19.287115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:19.287124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:19.287133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:19.368274] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:19.448181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:19.487375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:19.487423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:19.487431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:19.487440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:19.495719] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8266, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:18:19.648305] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:19.696007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:19.696052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:19.696060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:19.696069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:19.805505] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:19.848423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:19.896379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:19.896425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:19.896433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:19.896448] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:20.048626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:20.096694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:20.096735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:20.096742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:20.096752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:20.223346] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042700223342, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:18:20.224808] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042700224806, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007704, add_bytes: 0 [2024-09-11 16:18:20.248795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:20.297087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:20.297124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:20.297132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:20.297140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:20.368400] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:20.452552] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3550, replace_start_pos=3300000, replace_num=100000) [2024-09-11 16:18:20.452598] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:20.497454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:20.497501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:20.497509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:20.497519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:20.652693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:20.697799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:20.697844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:20.697851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:20.697861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:20.806641] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:20.852821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:20.898160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:20.898204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:20.898212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:20.898222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:21.052941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:21.098523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:21.098563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:21.098571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:21.098580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:21.230931] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042701230926, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007584, add_bytes: 0 [2024-09-11 16:18:21.232326] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042701232325, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007519, add_bytes: 0 [2024-09-11 16:18:21.253073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:21.298838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:21.298886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:21.298893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:21.298919] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:21.368558] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:21.453196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:21.499232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:21.499276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:21.499284] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:21.499294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:21.507620] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8312, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:18:21.653328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:21.707957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:21.708002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:21.708009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:21.708019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:21.807838] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:21.853454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:21.908315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:21.908359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:21.908367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:21.908376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:22.053637] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:22.108603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:22.108645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:22.108654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:22.108677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:22.238539] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042702238534, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:18:22.239948] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726042702239946, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:18:22.253754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:22.308959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:22.309005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:22.309013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:22.309022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:22.368687] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:22.453859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:22.509251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:22.509294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:22.509302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:22.509311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:22.658169] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4152, replace_start_pos=3400000, replace_num=100000) [2024-09-11 16:18:22.658216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:22.661023] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:22.661086] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=62] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:22.661165] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=172, max_check_version=173, global_version=174) [2024-09-11 16:18:22.663167] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2002 [2024-09-11 16:18:22.663199] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:22.663234] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:18:22.663271] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:18:22.663354] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:22.663475] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:18:22.663527] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:18:22.663539] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:18:22.663550] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:18:22.663593] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:18:22.663654] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:18:22.663677] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:18:22.709605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:22.709651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:22.709658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:22.709669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:22.808896] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:22.858302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:22.909991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:22.910038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:22.910045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:22.910055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:23.058412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:23.110279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:23.110323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:23.110330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:23.110339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:23.246135] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042703246131, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:18:23.247563] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042703247561, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:18:23.258526] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:23.310652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:23.310697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:23.310705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:23.310714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:23.368811] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:23.458704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:23.510991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:23.511034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:23.511041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:23.511050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:23.518880] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7816, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:18:23.658837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:23.719140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:23.719184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:23.719191] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:23.719219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:23.809778] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:23.858966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:23.919456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:23.919499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:23.919525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:23.919534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:24.059068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:24.119765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:24.119813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:24.119822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:24.119832] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:24.253775] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042704253771, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 16:18:24.255180] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042704255178, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:18:24.259201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:24.320081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:24.320124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:24.320132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:24.320141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:24.368893] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:24.459303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:24.520374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:24.520418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:24.520442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:24.520451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:24.659439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:24.720742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:24.720785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:24.720793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:24.720803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:24.810513] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:24.863896] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=3500000, replace_num=100000) [2024-09-11 16:18:24.863949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:24.921131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:24.921175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:24.921184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:24.921194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:25.064034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:25.121496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:25.121541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:25.121549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:25.121558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:25.261461] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=73] PNIO [ratelimit] time: 1726042705261458, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:18:25.262796] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726042705262794, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:18:25.264149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:25.321859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:25.321927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:25.321941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:25.321951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:25.369034] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:25.464327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:25.522246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:25.522290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:25.522298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:25.522308] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:25.530871] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8550, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:18:25.664454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:25.731216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:25.731259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:25.731267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:25.731277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:25.811264] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:25.864648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:25.931589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:25.931636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:25.931644] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:25.931654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:26.064767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:26.131997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:26.132043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:26.132051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:26.132060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:26.264898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:26.269047] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042706269044, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007586, add_bytes: 0 [2024-09-11 16:18:26.270404] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042706270403, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:18:26.332356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:26.332395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:26.332401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:26.332409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:26.369179] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:26.465039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:26.532640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:26.532687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:26.532694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:26.532703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:26.665176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:26.732960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:26.733001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:26.733007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:26.733015] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:26.733198] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=69, refresh_score_time=57, wash_time=0) [2024-09-11 16:18:26.812014] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:26.865300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:26.933496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:26.933539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:26.933548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:26.933558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:27.070504] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=5086, replace_start_pos=3600000, replace_num=100000) [2024-09-11 16:18:27.070555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:27.133783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:27.133826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:27.133834] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:27.133843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:27.270643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:27.276599] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042707276596, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:18:27.278026] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=10] PNIO [ratelimit] time: 1726042707278025, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:18:27.334081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:27.334127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:27.334155] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:27.334165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:27.369342] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:27.470769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:27.534375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:27.534417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:27.534423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:27.534431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:27.542266] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7822, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:18:27.670897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:27.742533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:27.742574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:27.742581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:27.742591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:27.812939] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:27.871046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:27.942808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:27.942853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:27.942858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:27.942866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:28.071640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=517] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:28.143094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:28.143162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:28.143170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:28.143179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:28.271767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:28.284221] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042708284217, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:18:28.285643] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042708285641, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:18:28.343384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:28.343423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:28.343429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:28.343436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:28.369451] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:28.471916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:28.543773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:28.543818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:28.543826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:28.543836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:28.672104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:28.744061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:28.744121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:28.744129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:28.744138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:28.814850] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:28.872237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:28.944438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:28.944481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:28.944488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:28.944496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:29.072432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:29.144717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:29.144762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:29.144768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:29.144775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:29.275895] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3313, replace_start_pos=3700000, replace_num=100000) [2024-09-11 16:18:29.275961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:29.291821] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042709291817, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:18:29.293343] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042709293339, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007698, add_bytes: 0 [2024-09-11 16:18:29.345076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:29.345116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:29.345125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:29.345134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:29.369577] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:29.476041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:29.545379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:29.545418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:29.545424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:29.545432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:29.552884] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7440, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:18:29.676164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:29.753178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:29.753219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:29.753227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:29.753236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:29.753428] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:18:29.815961] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:29.876289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:29.953663] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:29.953707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:29.953716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:29.953724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:30.076418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:30.154068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:30.154112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:30.154138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:30.154148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:30.276534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:30.299453] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042710299448, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:18:30.300871] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042710300868, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007529, add_bytes: 0 [2024-09-11 16:18:30.354439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:30.354505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:30.354513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:30.354523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:30.369689] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:30.476664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:30.554816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:30.554859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:30.554867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:30.554876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:30.676777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:30.755110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:30.755150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:30.755172] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:30.755180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:30.817045] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:30.876897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:30.955473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:30.955517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:30.955525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:30.955534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:31.077071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=81] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:31.155781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:31.155826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:31.155834] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:31.155843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:31.277197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:31.307054] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042711307049, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:18:31.308553] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042711308550, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:18:31.356086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:31.356130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:31.356137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:31.356147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:31.369891] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:31.481008] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3689, replace_start_pos=3800000, replace_num=100000) [2024-09-11 16:18:31.481070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:31.556393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:31.556440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:31.556447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:31.556457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:31.563843] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7372, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:18:31.681157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:31.764189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:31.764233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:31.764241] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:31.764252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:31.818115] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:31.881354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:31.964491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:31.964534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:31.964540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:31.964549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:32.081496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:32.164785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:32.164835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:32.164841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:32.164849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:32.281629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:32.314671] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042712314666, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:18:32.316106] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042712316103, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:18:32.365154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:32.365192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:32.365199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:32.365207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:32.370022] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:32.481815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:32.565458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:32.565505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:32.565513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:32.565522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:32.677486] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:32.677534] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:32.677619] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=173, max_check_version=174, global_version=175) [2024-09-11 16:18:32.679635] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2015 [2024-09-11 16:18:32.679692] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:32.679728] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:18:32.679766] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:18:32.679848] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:32.679969] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:18:32.680032] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:18:32.680043] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:18:32.680055] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:18:32.680091] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:18:32.680161] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:18:32.680180] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:18:32.681942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:32.765773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:32.765819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:32.765827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:32.765836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:32.819251] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:32.882037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:32.966082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:32.966128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:32.966136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:32.966144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:33.082170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:33.166406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:33.166449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:33.166457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:33.166466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:33.282283] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:33.322407] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042713322403, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007737, add_bytes: 0 [2024-09-11 16:18:33.323717] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042713323715, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:18:33.366697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:33.366740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:33.366748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:33.366757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:33.370220] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:33.482461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:33.567015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:33.567053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:33.567061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:33.567070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:33.574382] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7299, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:18:33.687070] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4412, replace_start_pos=3900000, replace_num=100000) [2024-09-11 16:18:33.687121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:33.774706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:33.774753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:33.774761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:33.774772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:33.820537] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:33.887223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:33.975056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:33.975101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:33.975109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:33.975118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:34.087419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=118] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:34.175365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:34.175416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:34.175423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:34.175431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:34.287603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:34.329925] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042714329920, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007517, add_bytes: 0 [2024-09-11 16:18:34.331341] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=333] PNIO [ratelimit] time: 1726042714331340, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:18:34.370334] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:34.375728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:34.375761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:34.375768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:34.375777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:34.487728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:34.576029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:34.576074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:34.576081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:34.576110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:34.687851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:34.776335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:34.776379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:34.776385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:34.776392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:34.821765] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:34.887998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:34.976682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:34.976724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:34.976733] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:34.976742] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:35.088116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:35.177057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:35.177100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:35.177109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:35.177119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:35.288248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:35.337538] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042715337534, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:18:35.338946] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042715338944, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:18:35.370524] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:35.377343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:35.377383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:35.377408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:35.377418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:35.488385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:35.577710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:35.577753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:35.577761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:35.577771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:35.584774] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6988, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:18:35.688520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:35.785057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:35.785101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:35.785109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:35.785119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:35.822923] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:35.893029] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4367, replace_start_pos=4000000, replace_num=100000) [2024-09-11 16:18:35.893076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:35.985375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:35.985421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:35.985431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:35.985443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:36.093160] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:36.185744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:36.185807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:36.185817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:36.185827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:36.293343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:36.345150] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042716345146, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:18:36.346568] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042716346566, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:18:36.370740] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:36.386148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:36.386199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:36.386207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:36.386217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:36.493546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:36.586533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:36.586572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:36.586580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:36.586590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:36.693671] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:36.786852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:36.786929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:36.786940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:36.786951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:36.824195] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:36.893878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:36.987257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:36.987302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:36.987310] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:36.987320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:37.094023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:37.187526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:37.187559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:37.187565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:37.187573] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:37.294194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:37.352754] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042717352750, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:18:37.354254] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042717354251, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:18:37.370865] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:37.387793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:37.387836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:37.387844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:37.387853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:37.494316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:37.588116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:37.588158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:37.588164] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:37.588171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:37.594767] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6584, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:18:37.694511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:37.795029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:37.795073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:37.795080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:37.795089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:37.825117] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:37.894643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:37.995326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:37.995369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:37.995376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:37.995385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:38.099160] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4404, replace_start_pos=4100000, replace_num=100000) [2024-09-11 16:18:38.099209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:38.195607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:38.195651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:38.195659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:38.195685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:38.299296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:38.360405] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042718360400, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007650, add_bytes: 0 [2024-09-11 16:18:38.361872] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042718361870, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:18:38.370976] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:38.395925] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:38.395968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:38.395975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:38.395984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:38.499475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:38.596209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:38.596253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:38.596260] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:38.596269] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:38.699605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:38.796492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:38.796537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:38.796543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:38.796567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:38.825856] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:38.899813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:38.996790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:38.996829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:38.996854] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:38.996864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:39.099936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:39.197088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:39.197131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:39.197139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:39.197148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:39.300122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:39.368010] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042719368006, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:18:39.369482] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=878] PNIO [ratelimit] time: 1726042719369480, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:18:39.371090] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:39.397397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:39.397443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:39.397451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:39.397460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:39.500303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:39.597683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:39.597727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:39.597752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:39.597760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:39.606345] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8573, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:18:39.700420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:39.806612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:39.806660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:39.806667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:39.806677] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:39.826608] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:39.900547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:40.006940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:40.006984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:40.006992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:40.007001] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:40.100666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:40.207240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:40.207286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:40.207292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:40.207300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:40.304111] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3337, replace_start_pos=4200000, replace_num=100000) [2024-09-11 16:18:40.304149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:40.371209] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=20] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:40.375614] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042720375611, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:18:40.377044] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042720377042, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:18:40.407531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:40.407574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:40.407581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:40.407590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:40.504310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:40.607817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:40.607857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:40.607865] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:40.607874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:40.704514] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:40.808095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:40.808134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:40.808140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:40.808148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:40.827455] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:40.904636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:41.008488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:41.008541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:41.008548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:41.008558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:41.104757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:41.208816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:41.208879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:41.208888] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:41.208897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:41.304880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:41.371455] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=91] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:41.383216] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042721383212, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:18:41.384711] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042721384708, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:18:41.409144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:41.409189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:41.409196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:41.409205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:41.505027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:41.609438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:41.609483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:41.609491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:41.609500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:41.617816] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8286, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:18:41.705158] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:41.818068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:41.818111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:41.818118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:41.818125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:41.828600] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:41.905265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:42.018333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:42.018372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:42.018378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:42.018385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:42.105431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:42.218611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:42.218656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:42.218663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:42.218672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:42.305553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:42.371590] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:42.390852] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042722390849, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:18:42.392266] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042722392263, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:18:42.418998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:42.419043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:42.419070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:42.419080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:42.510100] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4366, replace_start_pos=4300000, replace_num=100000) [2024-09-11 16:18:42.510149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:42.619419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:42.619466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:42.619474] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:42.619484] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:42.694567] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:42.694620] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:42.694702] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=174, max_check_version=175, global_version=176) [2024-09-11 16:18:42.696684] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1981 [2024-09-11 16:18:42.696717] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:42.696774] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:18:42.696812] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:18:42.696895] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:42.697015] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:18:42.697075] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:18:42.697087] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:18:42.697098] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:18:42.697135] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:18:42.697194] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:18:42.697216] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:18:42.710293] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:42.819782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:42.819822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:42.819830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:42.819839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:42.829488] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:42.910483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:43.020135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:43.020177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:43.020184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:43.020191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:43.110608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:43.220411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:43.220464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:43.220471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:43.220478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:43.310737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:43.371728] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:43.398455] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042723398452, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:18:43.399881] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042723399879, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:18:43.420749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:43.420788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:43.420795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:43.420819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:43.510850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:43.621065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:43.621110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:43.621117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:43.621127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:43.628939] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7799, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:18:43.710957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:43.829203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:43.829245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:43.829252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:43.829260] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:43.830556] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:43.911067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:44.029571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:44.029611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:44.029620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:44.029629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:44.111280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:44.230021] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:44.230077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:44.230085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:44.230115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:44.311412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:44.371913] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:44.406071] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042724406067, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:18:44.407500] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042724407499, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:18:44.430421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:44.430464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:44.430473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:44.430482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:44.511557] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:44.630867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:44.630936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:44.630945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:44.630954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:44.716083] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4399, replace_start_pos=4400000, replace_num=100000) [2024-09-11 16:18:44.716131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:44.831187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:44.831229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:44.831251] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:44.831260] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:44.831406] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:44.916215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:45.031504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:45.031559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:45.031566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:45.031575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:45.116417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:45.231847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:45.231892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:45.231916] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:45.231927] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:45.316607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:45.372117] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:45.413788] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042725413783, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007716, add_bytes: 0 [2024-09-11 16:18:45.415177] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042725415175, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:18:45.432168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:45.432213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:45.432222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:45.432232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:45.516736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:45.632470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:45.632516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:45.632545] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:45.632556] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:45.640448] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7878, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:18:45.716878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:45.832299] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:45.840723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:45.840766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:45.840773] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:45.840782] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:45.917008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:46.041032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:46.041075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:46.041083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:46.041092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:46.117129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:46.241329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:46.241374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:46.241382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:46.241391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:46.317251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:46.372274] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:46.421362] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042726421359, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007576, add_bytes: 0 [2024-09-11 16:18:46.422728] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042726422726, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:18:46.441685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:46.441730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:46.441738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:46.441748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:46.517386] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:46.642065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:46.642111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:46.642119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:46.642128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:46.717506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:46.833300] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:46.842350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:46.842398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:46.842405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:46.842414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:46.921379] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3708, replace_start_pos=4500000, replace_num=100000) [2024-09-11 16:18:46.921417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:47.042641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:47.042682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:47.042689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:47.042712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:47.042944] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=88, refresh_score_time=63, wash_time=0) [2024-09-11 16:18:47.121496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:47.243170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:47.243216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:47.243224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:47.243233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:47.321615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:47.372418] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:47.428916] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042727428912, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:18:47.430427] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042727430424, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007698, add_bytes: 0 [2024-09-11 16:18:47.443470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:47.443511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:47.443518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:47.443527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:47.521732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:47.643741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:47.643789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:47.643810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:47.643817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:47.651213] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7382, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:18:47.721854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:47.834434] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:47.851492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:47.851536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:47.851544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:47.851553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:47.921992] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:48.051790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:48.051834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:48.051842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:48.051851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:48.122120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:48.252166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:48.252211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:48.252219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:48.252228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:48.322241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:48.372537] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:48.436535] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042728436531, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:18:48.438029] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042728438025, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:18:48.452541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:48.452585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:48.452593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:48.452602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:48.522362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:48.652853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:48.652929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:48.652936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:48.652944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:48.722545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:48.835447] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:48.853161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:48.853216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:48.853223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:48.853231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:48.922674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:49.053525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:49.053563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:49.053571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:49.053578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:49.127308] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4445, replace_start_pos=4600000, replace_num=100000) [2024-09-11 16:18:49.127376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:49.253833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:49.253879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:49.253887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:49.253896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:49.327459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:49.372686] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:49.444148] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=1605] PNIO [ratelimit] time: 1726042729444143, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:18:49.445577] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=127] PNIO [ratelimit] time: 1726042729445576, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:18:49.454161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:49.454202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:49.454209] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:49.454216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:49.527641] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:49.654447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:49.654487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:49.654494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:49.654501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:49.662686] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8154, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:18:49.727762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:49.836630] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:49.862998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:49.863039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:49.863062] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:49.863072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:49.927874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:50.063451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:50.063496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:50.063504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:50.063514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:50.128073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:50.263769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:50.263813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:50.263820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:50.263830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:50.328198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:50.372892] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:50.451779] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042730451774, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:18:50.453199] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042730453196, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:18:50.464084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:50.464129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:50.464156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:50.464164] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:50.528325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:50.664402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:50.664447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:50.664454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:50.664464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:50.728560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:50.837601] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:50.864694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:50.864737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:50.864746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:50.864755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:50.928686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:51.065004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:51.065045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:51.065053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:51.065062] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:51.128867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:51.265381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:51.265426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:51.265435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:51.265462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:51.333427] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4409, replace_start_pos=4700000, replace_num=100000) [2024-09-11 16:18:51.333471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:51.373079] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=102] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:51.459384] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042731459380, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:18:51.460802] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042731460801, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:18:51.465692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:51.465726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:51.465734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:51.465742] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:51.533617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:51.665984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:51.666031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:51.666039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:51.666048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:51.673772] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7708, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:18:51.733805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:51.838568] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:51.874026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:51.874069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:51.874076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:51.874083] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:51.933947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:52.074338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:52.074384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:52.074392] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:52.074402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:52.134082] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:52.274641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:52.274685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:52.274693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:52.274703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:52.334200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:52.373201] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:52.466999] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042732466994, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:18:52.468490] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726042732468488, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:18:52.475074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:52.475106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:52.475114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:52.475123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:52.534307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:52.675384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:52.675427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:52.675435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:52.675444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:52.712980] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:52.713031] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:18:52.713110] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=175, max_check_version=176, global_version=177) [2024-09-11 16:18:52.715156] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2045 [2024-09-11 16:18:52.715196] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:52.715232] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:18:52.715290] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:18:52.715375] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:18:52.715482] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:18:52.715534] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:18:52.715549] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:18:52.715560] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:18:52.715597] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:18:52.715657] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:18:52.715679] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:18:52.734421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:52.839651] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:52.875697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:52.875740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:52.875746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:52.875766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:52.934549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:53.076000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:53.076038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:53.076064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:53.076073] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:53.134682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:53.276307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:53.276358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:53.276367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:53.276376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:53.334815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:53.373380] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:53.474618] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042733474614, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:18:53.476067] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042733476064, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007576, add_bytes: 0 [2024-09-11 16:18:53.476618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:53.476643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:53.476650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:53.476659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:53.538293] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3357, replace_start_pos=4800000, replace_num=100000) [2024-09-11 16:18:53.538346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:53.676994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:53.677040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:53.677048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:53.677057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:53.684832] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7762, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:18:53.738457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:53.840709] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:53.885140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:53.885184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:53.885192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:53.885201] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:53.938586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:54.085502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:54.085543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:54.085552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:54.085562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:54.138703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:54.285898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:54.285960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:54.285968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:54.285978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:54.338828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:54.373578] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:54.482238] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042734482234, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:18:54.483731] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=104] PNIO [ratelimit] time: 1726042734483728, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:18:54.486210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:54.486239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:54.486246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:54.486255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:54.538966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:54.686559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:54.686605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:54.686612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:54.686620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:54.739079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:54.841628] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:54.886853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:54.886921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:54.886933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:54.886942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:54.939192] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:55.087193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:55.087239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:55.087247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:55.087256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:55.139319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:55.287568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:55.287613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:55.287621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:55.287631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:55.339498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:55.373722] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:55.487856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:55.487922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:55.487931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:55.487941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:55.489852] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042735489850, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:18:55.491414] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042735491411, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:18:55.540153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=577] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:55.688246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:55.688290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:55.688298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:55.688307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:55.696710] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8368, clean_start_pos=0, clean_num=200000) [2024-09-11 16:18:55.743599] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3325, replace_start_pos=4900000, replace_num=100000) [2024-09-11 16:18:55.743640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:55.842814] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:55.896980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:55.897036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:55.897044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:55.897053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:55.943724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:56.097286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:56.097330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:56.097338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:56.097347] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:56.143853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:56.297597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:56.297645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:56.297653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:56.297662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:56.343985] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:56.373870] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:56.497462] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042736497459, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:18:56.497896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:56.497963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:56.497970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:56.497979] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:56.498953] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042736498951, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007540, add_bytes: 0 [2024-09-11 16:18:56.544099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:56.698225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:56.698270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:56.698279] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:56.698287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:56.744227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:56.843997] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:56.898598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:56.898644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:56.898652] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:56.898662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:56.944346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:57.098979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:57.099020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:57.099029] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:57.099038] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:57.144475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:57.299277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:57.299321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:57.299347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:57.299357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:57.344604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:57.374016] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:57.499656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:57.499699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:57.499707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:57.499717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:57.505080] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042737505077, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:18:57.506568] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042737506565, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:18:57.544732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:57.699974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:57.700017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:57.700025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:57.700034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:57.708537] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8490, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:18:57.744862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:18:57.845048] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:57.908801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:57.908841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:57.908849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:57.908858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:57.948376] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=91] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3349, replace_start_pos=5000000, replace_num=100000) [2024-09-11 16:18:57.948419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:18:58.109182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:58.109227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:58.109235] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:58.109246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:58.148509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:18:58.309610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:58.309657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:58.309665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:58.309674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:58.348699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:18:58.374128] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:58.509931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:58.509982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:58.509993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:58.510019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:58.512704] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042738512700, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:18:58.514182] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042738514180, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:18:58.548815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:18:58.710321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:58.710361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:58.710368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:58.710378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:58.748946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:18:58.846201] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:58.910637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:58.910688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:58.910696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:58.910706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:58.949134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:18:59.110988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:59.111035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:59.111042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:59.111052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:59.149264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:18:59.311285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:59.311329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:59.311336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:59.311345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:59.349378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:18:59.374324] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:18:59.511591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:59.511636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:59.511642] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:59.511649] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:59.520305] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042739520301, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:18:59.521802] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042739521799, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:18:59.549560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:18:59.711975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:59.712022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:59.712030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:59.712040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:59.720559] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8506, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:18:59.749700] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:18:59.847231] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:18:59.920816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:18:59.920861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:18:59.920869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:18:59.920878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:18:59.921082] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:18:59.949841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:00.121400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:00.121444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:00.121452] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:00.121462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:00.153456] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=92] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3442, replace_start_pos=5100000, replace_num=100000) [2024-09-11 16:19:00.153502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:00.321691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:00.321734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:00.321743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:00.321752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:00.353593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:00.374470] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:00.522004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:00.522050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:00.522057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:00.522066] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:00.523502] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:19:00.525603] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:19:00.527993] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042740527991, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:19:00.528027] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:19:00.529357] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042740529356, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:19:00.529370] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:19:00.553765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:00.722303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:00.722345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:00.722352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:00.722360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:00.753895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:00.848134] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:00.922593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:00.922639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:00.922647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:00.922656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:00.954018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:01.122873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:01.122930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:01.122938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:01.122946] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:01.154146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:01.323217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:01.323261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:01.323287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:01.323297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:01.354282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:01.374690] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:01.523522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:01.523567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:01.523573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:01.523581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:01.535614] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042741535611, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:19:01.536963] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726042741536960, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:19:01.554417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:01.723878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:01.723946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:01.723954] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:01.723964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:01.730786] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6809, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:19:01.754545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:01.849153] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:01.931074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:01.931119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:01.931127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:01.931136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:01.954687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:02.131467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:02.131510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:02.131518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:02.131527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:02.154831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:02.331847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:02.331889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:02.331897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:02.331923] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:02.358298] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3340, replace_start_pos=5200000, replace_num=100000) [2024-09-11 16:19:02.358339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:02.374807] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:02.532222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:02.532266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:02.532274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:02.532285] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:02.543158] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042742543153, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:19:02.544599] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042742544596, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:19:02.558425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:02.731282] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:02.731336] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:02.731421] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=176, max_check_version=177, global_version=178) [2024-09-11 16:19:02.732584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:02.732616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:02.732626] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:02.732638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:02.733533] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2112 [2024-09-11 16:19:02.733570] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:02.733606] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:19:02.733664] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:19:02.733754] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:02.733861] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:19:02.733930] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:19:02.733947] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:19:02.733958] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:19:02.733995] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:19:02.734055] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:19:02.734077] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:19:02.758550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:02.850125] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:02.932966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:02.933010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:02.933018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:02.933027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:02.958715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:03.133324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:03.133368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:03.133377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:03.133386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:03.158933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:03.333701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:03.333743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:03.333751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:03.333761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:03.359066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:03.374954] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:03.534032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:03.534099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:03.534131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:03.534145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:03.550774] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042743550769, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:19:03.552269] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042743552266, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:19:03.559178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:03.734444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:03.734490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:03.734498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:03.734507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:03.742177] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7656, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:19:03.759315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:03.851242] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:03.942499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:03.942545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:03.942553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:03.942562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:03.959451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:04.142798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:04.142842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:04.142848] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:04.142856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:04.159574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:04.343241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:04.343283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:04.343291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:04.343301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:04.359704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:04.375069] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:04.543531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:04.543569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:04.543575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:04.543583] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:04.558450] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042744558446, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:19:04.559812] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042744559809, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007543, add_bytes: 0 [2024-09-11 16:19:04.564149] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4298, replace_start_pos=5300000, replace_num=100000) [2024-09-11 16:19:04.564177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:04.743881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:04.743938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:04.743946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:04.743955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:04.764259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:04.852433] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:04.944297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:04.944343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:04.944351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:04.944361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:04.964394] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:05.144655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:05.144701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:05.144709] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:05.144734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:05.164534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:05.345104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:05.345148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:05.345156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:05.345166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:05.364714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:05.375197] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:05.545519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:05.545556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:05.545563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:05.545571] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:05.564839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:05.566007] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042745566004, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:19:05.567433] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042745567432, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:19:05.745790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:05.745826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:05.745832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:05.745853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:05.752436] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6572, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:19:05.764964] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:05.853788] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:05.952708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:05.952746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:05.952753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:05.952761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:05.965102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:06.153082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:06.153127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:06.153135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:06.153145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:06.165232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:06.353359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:06.353403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:06.353409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:06.353417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:06.365368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:06.375341] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:06.553715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:06.553762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:06.553788] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:06.553799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:06.565565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:06.573680] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042746573677, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:19:06.575054] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726042746575053, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:19:06.754067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:06.754113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:06.754122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:06.754134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:06.769030] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3344, replace_start_pos=5400000, replace_num=100000) [2024-09-11 16:19:06.769075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:06.854871] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:06.954436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:06.954482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:06.954489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:06.954499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:06.969233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:07.154830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:07.154875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:07.154883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:07.154892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:07.169388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:07.355160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:07.355212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:07.355220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:07.355229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:07.355451] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=86, refresh_score_time=65, wash_time=0) [2024-09-11 16:19:07.369535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:07.375465] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:07.555673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:07.555715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:07.555721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:07.555729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:07.569726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:07.581250] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042747581247, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:19:07.582673] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726042747582671, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:19:07.756005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:07.756056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:07.756064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:07.756073] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:07.763728] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7623, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:19:07.769895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:07.855730] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:07.964005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:07.964041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:07.964060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:07.964070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:07.970028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:08.164373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:08.164422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:08.164430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:08.164440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:08.170151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:08.364685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:08.364728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:08.364735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:08.364744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:08.370365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:08.375569] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:08.565102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:08.565163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:08.565181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:08.565196] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:08.570500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:08.588874] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042748588869, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:19:08.590283] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042748590281, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:19:08.765453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:08.765496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:08.765503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:08.765512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:08.770604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:08.856737] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:08.965769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:08.965814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:08.965822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:08.965831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:08.974735] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4016, replace_start_pos=5500000, replace_num=100000) [2024-09-11 16:19:08.974777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:09.166111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:09.166157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:09.166163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:09.166172] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:09.174867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:09.366412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:09.366458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:09.366484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:09.366493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:09.375009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:09.375690] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:09.566736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:09.566779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:09.566785] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:09.566792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:09.575132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:09.596535] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=82] PNIO [ratelimit] time: 1726042749596530, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 16:19:09.597915] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042749597900, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:19:09.767050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:09.767090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:09.767098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:09.767108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:09.775261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:09.775619] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8498, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:19:09.857628] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:09.975388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:09.975884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:09.975931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:09.975940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:09.975961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:10.175522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:10.176177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:10.176208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:10.176215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:10.176223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:10.375650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:10.375784] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=24] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:10.376419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:10.376441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:10.376447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:10.376454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:10.575815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=77] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:10.576675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:10.576708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:10.576716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:10.576725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:10.604157] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042750604153, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:19:10.605522] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042750605520, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:19:10.775952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:10.776956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:10.776983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:10.776990] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:10.776997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:10.858377] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:10.976090] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:10.977229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:10.977265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:10.977274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:10.977284] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:11.177513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:11.177558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:11.177566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:11.177575] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:11.179575] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3359, replace_start_pos=5600000, replace_num=100000) [2024-09-11 16:19:11.179608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:11.375891] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:11.377804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:11.377839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:11.377849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:11.377858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:11.379763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:11.578113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:11.578159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:11.578166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:11.578175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:11.579868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:11.611773] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=69] PNIO [ratelimit] time: 1726042751611768, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:19:11.613131] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042751613128, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:19:11.778396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:11.778442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:11.778450] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:11.778459] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:11.779987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:11.785822] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7349, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:19:11.859148] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:11.980156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:11.986069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:11.986109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:11.986116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:11.986125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:12.180379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:12.186340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:12.186394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:12.186401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:12.186409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:12.376020] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:12.380513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:12.386643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:12.386687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:12.386694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:12.386703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:12.580632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:12.586952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:12.586989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:12.586997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:12.587006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:12.619322] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726042752619319, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:19:12.620739] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042752620737, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:19:12.750099] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:12.750174] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=73] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:12.750254] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=177, max_check_version=178, global_version=179) [2024-09-11 16:19:12.752302] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2048 [2024-09-11 16:19:12.752342] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:12.752376] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:19:12.752414] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:19:12.752498] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:12.752618] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:19:12.752673] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:19:12.752684] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:19:12.752695] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:19:12.752738] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:19:12.752798] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:19:12.752825] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:19:12.780767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:12.787221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:12.787262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:12.787268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:12.787277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:12.860104] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:12.980884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:12.987495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:12.987530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:12.987537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:12.987547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:13.181025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:13.187799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:13.187843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:13.187851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:13.187879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:13.376149] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:13.385567] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4398, replace_start_pos=5700000, replace_num=100000) [2024-09-11 16:19:13.385614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:13.388184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:13.388217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:13.388225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:13.388234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:13.585711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:13.588484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:13.588517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:13.588525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:13.588533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:13.626936] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042753626932, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:19:13.628428] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042753628426, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:19:13.785846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:13.788752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:13.788779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:13.788803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:13.788812] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:13.796899] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8075, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:19:13.861369] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:13.985978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:13.997137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:13.997173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:13.997181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:13.997189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:14.186173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:14.197491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:14.197536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:14.197544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:14.197554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:14.376346] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:14.386310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:14.397855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:14.397899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:14.397929] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:14.397939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:14.586431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:14.598174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:14.598224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:14.598232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:14.598241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:14.634617] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042754634614, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:19:14.636049] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042754636047, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:19:14.786546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:14.798449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:14.798479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:14.798485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:14.798493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:14.862519] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:14.986712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:14.998787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:14.998824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:14.998832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:14.998842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:15.186897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:15.199068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:15.199110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:15.199118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:15.199127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:15.376477] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:15.387038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:15.399420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:15.399463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:15.399471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:15.399481] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:15.590584] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3338, replace_start_pos=5800000, replace_num=100000) [2024-09-11 16:19:15.590633] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:15.599785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:15.599827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:15.599835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:15.599844] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:15.642231] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042755642226, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:19:15.643600] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042755643598, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:19:15.790788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:15.800077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:15.800122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:15.800129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:15.800139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:15.808585] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8416, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:19:15.863698] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:15.990919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:16.008852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:16.008889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:16.008929] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:16.008940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:16.191110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:16.209182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:16.209225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:16.209233] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:16.209241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:16.376619] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:16.391289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:16.409466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:16.409504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:16.409510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:16.409518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:16.591407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:16.609817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:16.609859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:16.609868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:16.609877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:16.649787] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042756649781, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:19:16.651204] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042756651203, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:19:16.791533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:16.810134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:16.810179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:16.810187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:16.810196] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:16.864628] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:16.991661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:17.010382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:17.010423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:17.010429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:17.010436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:17.191792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:17.210672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:17.210716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:17.210724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:17.210733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:17.376821] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:17.391922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:17.411072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:17.411115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:17.411145] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:17.411156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:17.592055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:17.611429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:17.611472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:17.611480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:17.611490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:17.657465] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042757657461, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:19:17.658892] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=10] PNIO [ratelimit] time: 1726042757658890, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:19:17.796517] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4336, replace_start_pos=5900000, replace_num=100000) [2024-09-11 16:19:17.796565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:17.811803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:17.811847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:17.811856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:17.811865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:17.820439] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8561, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:19:17.865916] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:17.996650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:18.020758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:18.020802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:18.020810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:18.020819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:18.196758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:18.221122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:18.221162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:18.221170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:18.221180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:18.376993] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:18.396963] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:18.421473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:18.421512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:18.421519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:18.421529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:18.597080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:18.621824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:18.621872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:18.621881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:18.621890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:18.665031] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042758665027, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:19:18.666568] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042758666566, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:19:18.797211] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:18.822149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:18.822193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:18.822200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:18.822210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:18.866879] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:18.997335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:19.022439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:19.022483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:19.022491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:19.022500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:19.197466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:19.222745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:19.222785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:19.222793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:19.222802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:19.377228] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:19.397608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:19.423034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:19.423077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:19.423084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:19.423092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:19.597731] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:19.623319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:19.623364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:19.623372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:19.623381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:19.672649] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042759672646, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:19:19.674125] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042759674123, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:19:19.797860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:19.797898] INFO run1 (ob_timer.cpp:374) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] dump timer info(this=0x7f529d2ad960, tasks_num=0, wakeup_time=103417452892) [2024-09-11 16:19:19.823685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:19.823727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:19.823735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:19.823752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:19.832302] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8532, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:19:19.868102] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=98] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:20.002311] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4311, replace_start_pos=6000000, replace_num=100000) [2024-09-11 16:19:20.002356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:20.032543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:20.032587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:20.032595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:20.032603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:20.202439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:20.232824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:20.232892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:20.232900] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:20.232930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:20.377357] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:20.402639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:20.433162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:20.433198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:20.433203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:20.433210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:20.602766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:20.633439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:20.633487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:20.633495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:20.633503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:20.680258] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726042760680253, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:19:20.681678] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042760681676, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:19:20.802895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:20.833736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:20.833804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:20.833810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:20.833818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:20.868974] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:21.003041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:21.034039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:21.034080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:21.034086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:21.034094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:21.203180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:21.234311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:21.234355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:21.234362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:21.234371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:21.377517] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:21.403370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:21.434596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:21.434643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:21.434651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:21.434660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:21.603557] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:21.634879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:21.634962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:21.634969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:21.634977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:21.687936] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042761687931, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:19:21.689297] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042761689295, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:19:21.803695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:21.835234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:21.835279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:21.835286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:21.835296] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:21.842930] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7622, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:19:21.869757] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:22.003827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:22.043182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:22.043222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:22.043229] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:22.043239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:22.207304] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3344, replace_start_pos=6100000, replace_num=100000) [2024-09-11 16:19:22.207351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:22.243450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:22.243494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:22.243500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:22.243508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:22.377637] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:22.407454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:22.443752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:22.443793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:22.443801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:22.443811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:22.607580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:22.644139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:22.644184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:22.644192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:22.644202] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:22.695480] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042762695476, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:19:22.696932] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042762696929, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:19:22.765174] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:22.765215] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:22.765323] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=178, max_check_version=179, global_version=180) [2024-09-11 16:19:22.767426] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2101 [2024-09-11 16:19:22.767489] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:22.767525] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:19:22.767567] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:19:22.767651] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:22.767761] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:19:22.767818] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:19:22.767829] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:19:22.767841] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:19:22.767878] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:19:22.767961] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:19:22.767988] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:19:22.807698] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:22.844429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:22.844463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:22.844470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:22.844477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:22.870611] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=115] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:23.007821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:23.044701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:23.044741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:23.044750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:23.044759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:23.207944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:23.245009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:23.245048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:23.245055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:23.245064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:23.377776] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:23.408059] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:23.445294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:23.445338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:23.445345] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:23.445355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:23.608191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:23.645662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:23.645724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:23.645748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:23.645760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:23.703164] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042763703161, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:19:23.704533] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042763704531, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:19:23.808307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:23.846060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:23.846108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:23.846116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:23.846125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:23.853559] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7419, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:19:23.871518] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:24.008415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:24.053857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:24.053924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:24.053937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:24.053946] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:24.208535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:24.254205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:24.254249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:24.254257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:24.254266] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:24.377953] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:24.411959] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3308, replace_start_pos=6200000, replace_num=100000) [2024-09-11 16:19:24.412002] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:24.454500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:24.454542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:24.454550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:24.454559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:24.612088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:24.654793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:24.654838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:24.654845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:24.654854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:24.710720] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042764710717, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:19:24.712147] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042764712145, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:19:24.812206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:24.855099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:24.855143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:24.855150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:24.855159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:24.872275] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:25.012328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:25.055392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:25.055436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:25.055444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:25.055453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:25.212515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:25.255781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:25.255824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:25.255831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:25.255841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:25.378099] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:25.412659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:25.456140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:25.456179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:25.456188] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:25.456216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:25.612784] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:25.656530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:25.656575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:25.656583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:25.656592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:25.718392] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042765718388, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:19:25.719759] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042765719758, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:19:25.812916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:25.856894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:25.856960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:25.856969] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:25.856978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:25.864329] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7338, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:19:25.873036] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:26.013107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:26.064579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:26.064625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:26.064633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:26.064642] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:26.213243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:26.264984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:26.265044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:26.265052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:26.265061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:26.378311] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:26.413375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:26.465292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:26.465337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:26.465345] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:26.465354] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:26.616839] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3334, replace_start_pos=6300000, replace_num=100000) [2024-09-11 16:19:26.616886] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:26.665670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:26.665715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:26.665723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:26.665733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:26.726020] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042766726015, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:19:26.727375] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042766727373, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:19:26.817036] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:26.865987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:26.866025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:26.866033] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:26.866042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:26.873798] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:27.017237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:27.066337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:27.066376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:27.066384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:27.066394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:27.217373] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:27.266713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:27.266757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:27.266765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:27.266774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:27.378616] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:27.417495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:27.467082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:27.467126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:27.467134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:27.467143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:27.617693] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:27.667438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:27.667483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:27.667492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:27.667501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:27.667717] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=80, refresh_score_time=61, wash_time=0) [2024-09-11 16:19:27.733569] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042767733565, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:19:27.735053] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042767735050, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:19:27.817839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:27.868037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:27.868078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:27.868086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:27.868096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:27.874590] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:27.875909] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7801, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:19:28.018059] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:28.076226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:28.076269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:28.076277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:28.076287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:28.218187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:28.276535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:28.276574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:28.276596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:28.276606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:28.378837] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:28.418361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:28.476883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:28.476942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:28.476948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:28.476956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:28.618486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:28.677249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:28.677298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:28.677305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:28.677314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:28.741186] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042768741180, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:19:28.742609] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042768742606, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:19:28.821924] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3317, replace_start_pos=6400000, replace_num=100000) [2024-09-11 16:19:28.821973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:28.875445] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:28.877624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:28.877658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:28.877666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:28.877675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:29.022057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:29.077916] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:29.077958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:29.077965] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:29.077975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:29.222190] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:29.278267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:29.278312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:29.278320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:29.278329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:29.379048] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:29.422328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:29.478633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:29.478678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:29.478686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:29.478696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:29.622465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:29.679033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:29.679078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:29.679106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:29.679116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:29.748800] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042769748795, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:19:29.750217] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042769750216, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:19:29.822587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:29.876412] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:29.879440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:29.879464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:29.879471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:29.879479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:29.886893] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7403, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:19:30.022703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:30.087121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:30.087157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:30.087163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:30.087171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:30.087323] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:19:30.222890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:30.287569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:30.287615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:30.287622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:30.287631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:30.379224] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:30.423045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:30.487879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:30.487940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:30.487948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:30.487957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:30.623168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:30.688256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:30.688295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:30.688303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:30.688312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:30.756417] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042770756413, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:19:30.757848] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726042770757846, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:19:30.823277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:30.877257] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:30.888603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:30.888641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:30.888649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:30.888658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:31.027711] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4326, replace_start_pos=6500000, replace_num=100000) [2024-09-11 16:19:31.027755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:31.088974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:31.089027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:31.089035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:31.089043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:31.227836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:31.289344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:31.289382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:31.289390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:31.289400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:31.379508] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=145] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:31.427947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:31.489689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:31.489731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:31.489739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:31.489749] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:31.628062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:31.690077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:31.690116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:31.690124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:31.690152] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:31.764096] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042771764091, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:19:31.765461] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042771765459, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:19:31.828171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:31.877985] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:31.890452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:31.890489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:31.890497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:31.890507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:31.899090] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8569, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:19:32.028280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:32.099412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:32.099458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:32.099466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:32.099476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:32.228389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:32.299763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:32.299801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:32.299809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:32.299818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:32.379686] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:32.428507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:32.500122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:32.500168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:32.500177] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:32.500189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:32.628639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:32.700429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:32.700471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:32.700479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:32.700488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:32.771656] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042772771651, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:19:32.773072] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042772773069, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:19:32.781461] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:32.781508] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:32.781588] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=179, max_check_version=180, global_version=181) [2024-09-11 16:19:32.783600] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2011 [2024-09-11 16:19:32.783656] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:32.783691] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:19:32.783728] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:19:32.783810] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:32.783934] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:19:32.783991] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:19:32.784002] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:19:32.784013] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:19:32.784049] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:19:32.784108] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:19:32.784130] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:19:32.828750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:32.878718] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:32.900790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:32.900849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:32.900858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:32.900869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:33.028860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:33.101098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:33.101132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:33.101139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:33.101148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:33.233410] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4436, replace_start_pos=6600000, replace_num=100000) [2024-09-11 16:19:33.233454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:33.301438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:33.301472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:33.301479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:33.301488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:33.379827] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:33.433534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:33.501784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:33.501823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:33.501849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:33.501859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:33.633637] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:33.702155] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:33.702192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:33.702200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:33.702209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:33.779265] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042773779261, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:19:33.780751] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042773780748, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:19:33.833749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:33.879428] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:33.902514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:33.902552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:33.902560] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:33.902569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:33.911133] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8549, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:19:34.033859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:34.111457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:34.111498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:34.111506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:34.111515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:34.233983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:34.311845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:34.311887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:34.311895] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:34.311928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:34.380005] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:34.434103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:34.512220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:34.512260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:34.512274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:34.512283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:34.634213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:34.712575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:34.712614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:34.712622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:34.712631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:34.786877] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042774786873, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:19:34.788295] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1726042774788294, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:19:34.834320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:34.880646] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:34.912983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:34.913030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:34.913037] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:34.913047] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:35.034429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:35.113384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:35.113425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:35.113433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:35.113443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:35.234545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:35.313686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:35.313736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:35.313748] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:35.313758] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:35.380226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:35.438554] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3899, replace_start_pos=6700000, replace_num=100000) [2024-09-11 16:19:35.438592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:35.514061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:35.514102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:35.514111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:35.514120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:35.638728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:35.714397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:35.714443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:35.714451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:35.714460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:35.794481] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042775794476, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:19:35.795914] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042775795914, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:19:35.838866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:35.881714] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:35.914704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:35.914749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:35.914756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:35.914765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:35.921642] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6864, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:19:36.038992] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:36.121998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:36.122055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:36.122066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:36.122076] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:36.239108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:36.322389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:36.322437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:36.322469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:36.322479] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:36.380435] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:36.439218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:36.522779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:36.522819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:36.522827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:36.522838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:36.639336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:36.723078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:36.723124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:36.723132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:36.723141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:36.802113] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042776802109, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:19:36.803529] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726042776803528, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:19:36.839466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:36.882868] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:36.923387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:36.923430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:36.923438] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:36.923447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:37.039586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:37.123680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:37.123743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:37.123751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:37.123761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:37.239706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:37.324009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:37.324055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:37.324062] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:37.324071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:37.380564] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:37.439820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:37.524450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:37.524503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:37.524511] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:37.524521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:37.643246] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3318, replace_start_pos=6800000, replace_num=100000) [2024-09-11 16:19:37.643311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:37.724754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:37.724825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:37.724833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:37.724842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:37.809724] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042777809720, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:19:37.811157] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042777811155, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:19:37.843397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:37.884126] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=106] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:37.925070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:37.925113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:37.925121] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:37.925130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:37.933179] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8035, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:19:38.043509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:38.133574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:38.133620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:38.133628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:38.133638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:38.243626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:38.333952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:38.333988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:38.333995] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:38.334002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:38.380736] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:38.443830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:38.534316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:38.534359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:38.534367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:38.534377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:38.643954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:38.734682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:38.734731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:38.734739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:38.734748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:38.817337] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042778817334, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:19:38.818838] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042778818835, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:19:38.844081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:38.885209] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:38.935076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:38.935123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:38.935132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:38.935142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:39.044199] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:39.135436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:39.135477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:39.135485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:39.135496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:39.244311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:39.335759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:39.335802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:39.335810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:39.335819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:39.380931] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:39.444426] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:39.536115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:39.536162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:39.536170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:39.536180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:39.644540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:39.736479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:39.736525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:39.736533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:39.736543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:39.825015] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042779825010, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:19:39.826376] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=88] PNIO [ratelimit] time: 1726042779826374, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:19:39.849024] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4346, replace_start_pos=6900000, replace_num=100000) [2024-09-11 16:19:39.849067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:39.886370] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:39.936841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:39.936929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=88][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:39.936940] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:39.936950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:39.945406] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8443, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:19:40.049149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:40.145655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:40.145699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:40.145706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:40.145716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:40.249289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:40.346037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:40.346079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:40.346087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:40.346096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:40.381142] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:40.449412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:40.546321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:40.546369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:40.546377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:40.546385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:40.649528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:40.746690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:40.746737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:40.746745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:40.746754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:40.832687] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726042780832683, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:19:40.834008] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042780834006, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:19:40.849660] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:40.887887] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:40.947072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:40.947117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:40.947125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:40.947135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:41.049777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:41.147499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:41.147544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:41.147552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:41.147562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:41.249893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:41.347805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:41.347868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:41.347876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:41.347885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:41.381297] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:41.450035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:41.548152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:41.548197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:41.548205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:41.548214] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:41.650154] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:41.748526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:41.748571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:41.748579] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:41.748588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:41.840187] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042781840183, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007500, add_bytes: 0 [2024-09-11 16:19:41.841685] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042781841683, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:19:41.850325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:41.889176] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=112] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:41.948824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:41.948868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:41.948875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:41.948884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:41.955528] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6586, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:19:42.054334] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3815, replace_start_pos=7000000, replace_num=100000) [2024-09-11 16:19:42.054375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:42.155770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:42.155810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:42.155817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:42.155827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:42.254461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:42.356063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:42.356104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:42.356112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:42.356121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:42.381411] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:42.454673] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:42.556348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:42.556388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:42.556394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:42.556403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:42.654875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:42.756647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:42.756694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:42.756702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:42.756711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:42.798239] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:42.798290] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:42.798357] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=180, max_check_version=181, global_version=182) [2024-09-11 16:19:42.800079] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1721 [2024-09-11 16:19:42.800117] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:42.800148] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:19:42.800202] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:19:42.800276] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:42.800358] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:19:42.800405] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:19:42.800419] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:19:42.800428] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:19:42.800459] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:19:42.800507] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:19:42.800524] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:19:42.847857] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042782847853, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:19:42.849236] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042782849233, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:19:42.855084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:42.890596] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:42.956939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:42.956984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:42.956990] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:42.956998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:43.055265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:43.157255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:43.157301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:43.157308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:43.157317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:43.255381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:43.357566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:43.357606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:43.357612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:43.357619] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:43.381599] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:43.455497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:43.557945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:43.557989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:43.557996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:43.558005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:43.655613] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:43.758308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:43.758373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:43.758383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:43.758393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:43.855483] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042783855479, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:19:43.855722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:43.856859] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042783856856, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:19:43.891741] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:43.958699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:43.958743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:43.958751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:43.958760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:43.966560] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7787, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:19:44.057183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=1386] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:44.166880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:44.166948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:44.166957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:44.166967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:44.261571] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4267, replace_start_pos=7100000, replace_num=100000) [2024-09-11 16:19:44.261618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:44.367261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:44.367307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:44.367315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:44.367325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:44.381718] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:44.461698] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:44.567640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:44.567687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:44.567695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:44.567704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:44.661826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:44.768035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:44.768079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:44.768086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:44.768095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:44.862043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:44.863029] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726042784863026, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:19:44.864528] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=276] PNIO [ratelimit] time: 1726042784864525, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:19:44.892883] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:44.968392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:44.968437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:44.968445] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:44.968454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:45.062164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:45.168682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:45.168723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:45.168753] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:45.168762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:45.262282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:45.369079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:45.369124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:45.369132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:45.369141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:45.381852] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:45.462392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:45.569372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:45.569413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:45.569420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:45.569429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:45.662497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:45.769727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:45.769767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:45.769776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:45.769785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:45.862601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:45.870644] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042785870641, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:19:45.872176] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042785872174, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007649, add_bytes: 0 [2024-09-11 16:19:45.894001] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=105] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:45.970158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:45.970218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:45.970227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:45.970236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:45.977738] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7490, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:19:46.062705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:46.178069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:46.178112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:46.178120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:46.178129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:46.262876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:46.378424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:46.378468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:46.378476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:46.378486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:46.382071] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=86] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:46.466812] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3824, replace_start_pos=7200000, replace_num=100000) [2024-09-11 16:19:46.466851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:46.578782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:46.578821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:46.578829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:46.578849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:46.666949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:46.779069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:46.779103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:46.779109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:46.779117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:46.867075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:46.878255] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042786878251, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:19:46.879748] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042786879745, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007571, add_bytes: 0 [2024-09-11 16:19:46.895116] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:46.979377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:46.979420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:46.979428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:46.979437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:47.067191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:47.179787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:47.179831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:47.179839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:47.179849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:47.267308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:47.380082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:47.380118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:47.380125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:47.380134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:47.382188] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:47.467424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:47.580378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:47.580421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:47.580429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:47.580438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:47.667540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:47.780753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:47.780807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:47.780820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:47.780834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:47.867654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:47.885940] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042787885936, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:19:47.887317] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042787887315, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:19:47.896185] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:47.981152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:47.981196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:47.981204] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:47.981237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:47.981453] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=103, refresh_score_time=62, wash_time=0) [2024-09-11 16:19:47.990020] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8551, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:19:48.067771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:48.190344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:48.190388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:48.190437] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:48.190455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:48.267887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:48.382281] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=24] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:48.390684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:48.390712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:48.390720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:48.390728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:48.468020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:48.591048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:48.591089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:48.591097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:48.591125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:48.672565] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4410, replace_start_pos=7300000, replace_num=100000) [2024-09-11 16:19:48.672614] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:48.791434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:48.791479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:48.791487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:48.791496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:48.872713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:48.893493] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726042788893490, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:19:48.894942] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042788894939, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:19:48.897171] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:48.991796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:48.991842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:48.991850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:48.991860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:49.072849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:49.192190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:49.192236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:49.192244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:49.192255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:49.273035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:49.382374] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:49.392569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:49.392614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:49.392622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:49.392632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:49.473158] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:49.592875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:49.592934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:49.592941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:49.592948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:49.673345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:49.793165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:49.793205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:49.793212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:49.793219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:49.873532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:49.898397] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:49.901170] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042789901167, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:19:49.902600] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042789902598, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007659, add_bytes: 0 [2024-09-11 16:19:49.993452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:49.993494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:49.993501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:49.993509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:50.000298] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6757, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:19:50.073655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:50.200550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:50.200596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:50.200604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:50.200613] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:50.273773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:50.382501] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:50.400932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:50.400978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:50.400985] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:50.400994] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:50.473955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:50.601293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:50.601341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:50.601349] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:50.601359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:50.674135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:50.801657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:50.801702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:50.801708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:50.801717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:50.877648] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3354, replace_start_pos=7400000, replace_num=100000) [2024-09-11 16:19:50.877701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:50.899577] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:50.908724] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042790908719, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:19:50.910154] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042790910152, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:19:51.001972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:51.002016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:51.002023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:51.002032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:51.077844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:51.202329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:51.202374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:51.202382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:51.202392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:51.277968] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:51.382661] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=89] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:51.402629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:51.402666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:51.402674] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:51.402706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:51.478086] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:51.602968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:51.603007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:51.603015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:51.603024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:51.678272] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:51.803237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:51.803280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:51.803287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:51.803294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:51.878391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:51.900491] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:51.916336] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042791916333, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:19:51.917779] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042791917776, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:19:52.003595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:52.003641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:52.003649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:52.003659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:52.011104] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7431, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:19:52.078504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:52.211429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:52.211494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:52.211503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:52.211512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:52.278697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:52.382838] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:52.411742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:52.411786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:52.411794] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:52.411803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:52.478878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:52.612074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:52.612118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:52.612126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:52.612135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:52.679013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:52.812360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:52.812396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:52.812404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:52.812423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:52.814933] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:52.814956] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:19:52.815035] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=181, max_check_version=182, global_version=183) [2024-09-11 16:19:52.817065] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2028 [2024-09-11 16:19:52.817103] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:52.817138] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:19:52.817176] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:19:52.817273] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:19:52.817381] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:19:52.817435] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:19:52.817446] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:19:52.817463] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:19:52.817499] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:19:52.817559] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:19:52.817581] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:19:52.879129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:52.901434] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:52.923949] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042792923945, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:19:52.925407] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042792925404, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:19:53.012668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:53.012711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:53.012719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:53.012728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:53.083285] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4038, replace_start_pos=7500000, replace_num=100000) [2024-09-11 16:19:53.083330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:53.212996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:53.213042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:53.213068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:53.213077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:53.283476] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:53.382963] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:53.413391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:53.413436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:53.413444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:53.413454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:53.483589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:53.613734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:53.613775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:53.613783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:53.613792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:53.683705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:53.814038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:53.814077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:53.814083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:53.814090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:53.883817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:53.902376] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:53.931691] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042793931687, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007742, add_bytes: 0 [2024-09-11 16:19:53.933012] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042793933010, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:19:54.014402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:54.014457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:54.014466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:54.014475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:54.022130] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7641, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:19:54.083927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:54.222444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:54.222489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:54.222497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:54.222507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:54.284040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:54.383090] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:54.422804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:54.422844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:54.422850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:54.422859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:54.484195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:54.623139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:54.623199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:54.623208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:54.623218] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:54.684315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:54.823518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:54.823563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:54.823571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:54.823580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:54.884440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:54.903556] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:54.939187] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042794939183, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007496, add_bytes: 0 [2024-09-11 16:19:54.940682] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042794940679, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:19:55.023809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:55.023850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:55.023857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:55.023867] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:55.084566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:55.224161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:55.224207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:55.224216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:55.224225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:55.288775] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4023, replace_start_pos=7600000, replace_num=100000) [2024-09-11 16:19:55.288833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:55.383241] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:55.424469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:55.424513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:55.424521] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:55.424530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:55.488933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:55.624759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:55.624797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:55.624804] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:55.624813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:55.689150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:55.825061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:55.825105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:55.825112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:55.825121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:55.889269] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:55.904648] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:55.946796] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042795946792, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:19:55.948235] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042795948232, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:19:56.025354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:56.025402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:56.025409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:56.025418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:56.033041] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7588, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:19:56.089395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:56.233299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:56.233340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:56.233346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:56.233353] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:56.289517] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:56.383385] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:56.433585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:56.433629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:56.433637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:56.433646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:56.489742] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:56.633966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:56.634008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:56.634015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:56.634024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:56.689945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:56.834281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:56.834325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:56.834332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:56.834341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:56.890092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:56.905852] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:56.954428] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042796954424, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:19:56.955948] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042796955945, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007713, add_bytes: 0 [2024-09-11 16:19:57.034589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:57.034631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:57.034639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:57.034647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:57.090218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:57.234876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:57.234937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:57.234945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:57.234954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:57.290331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:57.383513] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:57.435169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:57.435201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:57.435207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:57.435225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:57.494788] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=7700000, replace_num=100000) [2024-09-11 16:19:57.494834] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:57.635531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:57.635579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:57.635587] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:57.635596] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:57.694985] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:57.835832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:57.835868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:57.835876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:57.835885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:57.895097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:19:57.906776] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=105] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:57.962060] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042797962055, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:19:57.963529] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042797963528, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007583, add_bytes: 0 [2024-09-11 16:19:58.036154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:58.036199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:58.036207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:58.036217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:58.044286] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8056, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:19:58.095208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:19:58.244549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:58.244585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:58.244592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:58.244601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:58.295373] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:19:58.383615] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=28] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:58.444815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:58.444856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:58.444863] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:58.444871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:58.495486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:19:58.645158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:58.645204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:58.645212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:58.645222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:58.695603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:19:58.845525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:58.845590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:58.845599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:58.845609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:58.895720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:19:58.907765] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:58.969668] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042798969664, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:19:58.971150] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042798971147, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:19:59.045821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:59.045852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:59.045858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:59.045865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:59.095933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:19:59.246080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:59.246120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:59.246126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:59.246134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:59.296117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:19:59.383826] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:19:59.446366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:59.446406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:59.446413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:59.446421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:59.496243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:19:59.646651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:59.646691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:59.646698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:59.646707] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:59.700669] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4290, replace_start_pos=7800000, replace_num=100000) [2024-09-11 16:19:59.700718] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:19:59.847030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:19:59.847075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:19:59.847083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:19:59.847093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:19:59.900797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:19:59.909018] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:19:59.977337] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726042799977333, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:19:59.978710] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=356] PNIO [ratelimit] time: 1726042799978708, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:20:00.047396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:00.047437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:00.047444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:00.047452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:00.054084] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6620, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:20:00.100920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:00.254347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:00.254392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:00.254418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:00.254428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:00.254611] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:20:00.301037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:00.383989] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:00.454877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:00.454949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:00.454960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:00.454972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:00.501176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:00.655213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:00.655255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:00.655263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:00.655272] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:00.701365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:00.855569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:00.855615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:00.855641] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:00.855652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:00.901507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:00.910055] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:00.974384] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:20:00.980372] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:20:00.984883] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042800984881, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:20:00.984927] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:20:00.986321] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042800986318, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:20:00.986352] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:20:01.055972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:01.056017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:01.056025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:01.056034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:01.101697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:01.256335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:01.256380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:01.256389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:01.256398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:01.301820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:01.384226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=84] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:01.456647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:01.456690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:01.456718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:01.456728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:01.501934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:01.657072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:01.657119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:01.657127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:01.657136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:01.702051] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:01.857369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:01.857421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:01.857429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:01.857438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:01.906254] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4076, replace_start_pos=7900000, replace_num=100000) [2024-09-11 16:20:01.906302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:01.911178] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:01.992497] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042801992492, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:20:01.993957] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042801993954, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:20:02.057656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:02.057701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:02.057708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:02.057717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:02.064830] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7099, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:20:02.106458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:02.265125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:02.265170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:02.265176] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:02.265184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:02.306584] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:02.384360] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:02.465440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:02.465486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:02.465494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:02.465503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:02.506710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:02.665733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:02.665779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:02.665786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:02.665795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:02.706850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:02.831226] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:02.831293] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=65] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:02.831366] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=182, max_check_version=183, global_version=184) [2024-09-11 16:20:02.833103] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1736 [2024-09-11 16:20:02.833138] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:02.833169] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:20:02.833202] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:20:02.833277] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:02.833371] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:20:02.833418] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:20:02.833427] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:20:02.833435] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:20:02.833470] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:20:02.833518] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:20:02.833535] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:20:02.866047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:02.866093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:02.866101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:02.866110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:02.906998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:02.912306] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:03.000196] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042803000192, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 16:20:03.001536] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042803001534, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007580, add_bytes: 0 [2024-09-11 16:20:03.066331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:03.066368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:03.066375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:03.066383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:03.107129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:03.266684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:03.266730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:03.266755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:03.266765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:03.307247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:03.384498] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:03.467029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:03.467075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:03.467083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:03.467092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:03.507434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:03.667340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:03.667383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:03.667391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:03.667401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:03.707554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:03.867703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:03.867746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:03.867755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:03.867765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:03.907679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:03.913428] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:04.007726] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042804007722, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 16:20:04.009181] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042804009178, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 16:20:04.068090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:04.068141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:04.068149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:04.068159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:04.076175] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8001, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:20:04.111709] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3896, replace_start_pos=8000000, replace_num=100000) [2024-09-11 16:20:04.111763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:04.276493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:04.276540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:04.276548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:04.276558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:04.311863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:04.384677] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:04.476791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:04.476837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:04.476845] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:04.476854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:04.512021] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:04.677133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:04.677201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:04.677207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:04.677216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:04.712192] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:04.877511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:04.877554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:04.877562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:04.877572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:04.912324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:04.914408] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:05.015349] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042805015344, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:20:05.016856] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=132] PNIO [ratelimit] time: 1726042805016854, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:20:05.077794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:05.077837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:05.077843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:05.077851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:05.112448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:05.278063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:05.278103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:05.278109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:05.278117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:05.312576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:05.384822] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:05.478453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:05.478498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:05.478506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:05.478515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:05.512692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:05.678752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:05.678798] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:05.678805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:05.678815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:05.712812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:05.879108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:05.879154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:05.879162] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:05.879171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:05.912937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:05.915544] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:06.022958] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042806022955, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:20:06.024405] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042806024403, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:20:06.079407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:06.079452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:06.079460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:06.079488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:06.087253] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7751, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:20:06.113052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:06.287485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:06.287528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:06.287537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:06.287545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:06.316507] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3315, replace_start_pos=8100000, replace_num=100000) [2024-09-11 16:20:06.316553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:06.384983] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:06.487802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:06.487849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:06.487857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:06.487867] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:06.516632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:06.688112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:06.688161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:06.688189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:06.688197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:06.716751] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:06.888439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:06.888484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:06.888492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:06.888501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:06.916829] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:06.916863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:07.030578] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042807030575, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:20:07.032109] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042807032106, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007703, add_bytes: 0 [2024-09-11 16:20:07.088797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:07.088841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:07.088849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:07.088859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:07.117041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=103] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:07.289096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:07.289135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:07.289142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:07.289150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:07.317155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:07.385116] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:07.489378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:07.489440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:07.489449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:07.489458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:07.517278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:07.689686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:07.689733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:07.689741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:07.689750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:07.717405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:07.890002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:07.890047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:07.890055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:07.890064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:07.917532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:07.918112] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=121] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:08.038266] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042808038262, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:20:08.039636] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042808039634, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007528, add_bytes: 0 [2024-09-11 16:20:08.090356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:08.090400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:08.090408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:08.090419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:08.098752] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8320, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:20:08.117724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:08.299054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:08.299097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:08.299103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:08.299112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:08.299290] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=73, refresh_score_time=59, wash_time=0) [2024-09-11 16:20:08.317840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:08.385325] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:08.499542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:08.499586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:08.499594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:08.499603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:08.522383] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4421, replace_start_pos=8200000, replace_num=100000) [2024-09-11 16:20:08.522428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:08.699828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:08.699875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:08.699883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:08.699891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:08.722522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:08.900228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:08.900272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:08.900280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:08.900290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:08.919064] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:08.922651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:09.045882] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042809045878, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:20:09.047256] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042809047254, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:20:09.100506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:09.100540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:09.100545] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:09.100553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:09.122770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:09.300789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:09.301000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=209][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:09.301011] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:09.301020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:09.322891] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:09.385430] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:09.501258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:09.501301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:09.501309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:09.501340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:09.523033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:09.701635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:09.701680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:09.701688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:09.701698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:09.723233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:09.901952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:09.901996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:09.902003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:09.902013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:09.920101] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:09.923356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:10.053473] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=78] PNIO [ratelimit] time: 1726042810053467, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007589, add_bytes: 0 [2024-09-11 16:20:10.054928] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=288] PNIO [ratelimit] time: 1726042810054925, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:20:10.102307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:10.102354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:10.102362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:10.102371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:10.111370] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8983, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:20:10.123463] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:10.311625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:10.311690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:10.311696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:10.311704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:10.323589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:10.385609] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:10.511950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:10.511990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:10.511996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:10.512003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:10.523701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:10.712239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:10.712287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:10.712295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:10.712304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:10.729550] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=5719, replace_start_pos=8300000, replace_num=100000) [2024-09-11 16:20:10.729599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:10.912521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:10.912569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:10.912575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:10.912583] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:10.920986] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=93] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:10.929686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:11.061120] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042811061116, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007649, add_bytes: 0 [2024-09-11 16:20:11.062547] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042811062544, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:20:11.112826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:11.112875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:11.112883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:11.112891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:11.129838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:11.313139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:11.313185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:11.313190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:11.313198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:11.329959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:11.385824] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:11.513494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:11.513538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:11.513547] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:11.513556] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:11.530074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:11.713853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:11.713892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:11.713900] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:11.713936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:11.730209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:11.914182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:11.914239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:11.914247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:11.914257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:11.921817] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:11.930335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:12.068737] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042812068732, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:20:12.070099] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042812070096, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:20:12.114495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:12.114539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:12.114547] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:12.114557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:12.122342] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7769, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:20:12.130447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:12.322626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:12.322682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:12.322690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:12.322721] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:12.330621] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:12.385935] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:12.522992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:12.523036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:12.523042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:12.523051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:12.530747] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:12.723291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:12.723337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:12.723344] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:12.723354] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:12.730868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:12.848054] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:12.848092] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=36] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:12.848171] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=183, max_check_version=184, global_version=185) [2024-09-11 16:20:12.850232] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2059 [2024-09-11 16:20:12.850288] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:12.850324] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:20:12.850362] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:20:12.850449] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:12.850557] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:20:12.850624] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:20:12.850637] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:20:12.850648] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:20:12.850684] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:20:12.850747] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:20:12.850766] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:20:12.922913] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:12.923609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:12.923634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:12.923642] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:12.923650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:12.934406] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3398, replace_start_pos=8400000, replace_num=100000) [2024-09-11 16:20:12.934442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:13.076295] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042813076291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:20:13.077704] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042813077701, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:20:13.123898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:13.123967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:13.123975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:13.123985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:13.134522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:13.324215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:13.324256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:13.324264] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:13.324273] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:13.334640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:13.386119] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:13.524513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:13.524552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:13.524558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:13.524567] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:13.534757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:13.724807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:13.724853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:13.724861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:13.724870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:13.734876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:13.924018] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:13.925088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:13.925122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:13.925129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:13.925137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:13.935018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:14.083899] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042814083894, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:20:14.085389] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042814085386, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:20:14.125353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:14.125402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:14.125408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:14.125439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:14.132197] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6744, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:20:14.135113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:14.332523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:14.332564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:14.332570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:14.332577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:14.335215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:14.386237] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:14.532886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:14.532950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:14.532957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:14.532966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:14.535309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:14.733182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:14.733223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:14.733230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:14.733237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:14.735415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:14.933478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:14.933544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:14.933552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:14.933562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:14.935546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=12] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:15.024953] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:15.091512] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726042815091508, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:20:15.092953] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=105] PNIO [ratelimit] time: 1726042815092951, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 16:20:15.133793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:15.133833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:15.133839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:15.133846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:15.139358] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3707, replace_start_pos=8500000, replace_num=100000) [2024-09-11 16:20:15.139399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:15.334094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:15.334134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:15.334141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:15.334150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:15.339482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:15.386362] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:15.534400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:15.534464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:15.534471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:15.534481] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:15.539597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:15.734723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:15.734770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:15.734778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:15.734787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:15.739709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:15.935067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:15.935112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:15.935120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:15.935129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:15.939873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:16.026088] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:16.099198] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042816099193, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:20:16.100550] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042816100547, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:20:16.135427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:16.135471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:16.135479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:16.135489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:16.140016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:16.143994] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8491, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:20:16.340125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:16.344269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:16.344305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:16.344312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:16.344322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:16.386506] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:16.540284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:16.544622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:16.544661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:16.544669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:16.544679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:16.740400] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:16.744891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:16.744950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:16.744957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:16.744965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:16.940580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:16.945204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:16.945238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:16.945246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:16.945255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:17.027122] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:17.106745] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042817106741, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:20:17.108247] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042817108244, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 16:20:17.140781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:17.145553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:17.145589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:17.145595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:17.145604] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:17.345396] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4431, replace_start_pos=8600000, replace_num=100000) [2024-09-11 16:20:17.345446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:17.345841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:17.345875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:17.345882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:17.345891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:17.386641] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:17.545596] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:17.546258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:17.546289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:17.546298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:17.546325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:17.745814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:17.746562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:17.746595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:17.746603] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:17.746611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:17.946014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:17.946829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:17.946862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:17.946869] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:17.946877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:18.029166] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:18.114356] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042818114352, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:20:18.115801] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042818115798, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:20:18.146216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:18.147175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:18.147210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:18.147219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:18.147228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:18.155783] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8542, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:20:18.346342] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:18.356097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:18.356158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:18.356165] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:18.356173] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:18.386745] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:18.546523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:18.556473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:18.556515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:18.556526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:18.556536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:18.746738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:18.756753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:18.756794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:18.756800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:18.756808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:18.946934] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:18.957099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:18.957142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:18.957150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:18.957177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:19.030155] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:19.121972] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042819121967, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:20:19.123396] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042819123394, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:20:19.147128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:19.157392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:19.157433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:19.157439] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:19.157447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:19.347327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:19.357698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:19.357736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:19.357743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:19.357753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:19.386878] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:19.551877] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4346, replace_start_pos=8700000, replace_num=100000) [2024-09-11 16:20:19.551928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:19.558009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:19.558046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:19.558051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:19.558059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:19.752104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:19.758287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:19.758329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:19.758336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:19.758345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:19.952239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:19.958655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:19.958692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:19.958699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:19.958708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:20.031399] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:20.129592] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042820129588, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:20:20.131089] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=142] PNIO [ratelimit] time: 1726042820131086, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:20:20.152452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:20.158952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:20.158994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:20.159000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:20.159007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:20.165588] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6567, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:20:20.352582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:20.365879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:20.365939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:20.365948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:20.365957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:20.387010] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:20.552704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:20.566206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:20.566250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:20.566256] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:20.566264] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:20.752824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:20.766527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:20.766577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:20.766585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:20.766595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:20.953032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:20.966852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:20.966892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:20.966900] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:20.966938] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:21.032324] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:21.137200] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042821137195, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:20:21.138740] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042821138737, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007651, add_bytes: 0 [2024-09-11 16:20:21.153155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:21.167166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:21.167212] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:21.167237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:21.167245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:21.353335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:21.367475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:21.367525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:21.367533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:21.367542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:21.387216] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:21.553518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:21.567787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:21.567831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:21.567839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:21.567848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:21.757941] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4231, replace_start_pos=8800000, replace_num=100000) [2024-09-11 16:20:21.757989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:21.768094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:21.768139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:21.768147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:21.768175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:21.958135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:21.968482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:21.968524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:21.968532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:21.968542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:22.033697] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:22.144833] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042822144829, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:20:22.146270] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042822146267, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 16:20:22.158257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:22.168833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:22.168879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:22.168887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:22.168897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:22.177255] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8316, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:20:22.358383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:22.377499] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:22.377544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:22.377550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:22.377557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:22.387329] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:22.558503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:22.577788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:22.577832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:22.577840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:22.577849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:22.758661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=81] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:22.778087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:22.778126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:22.778132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:22.778140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:22.864455] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:22.864508] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:22.864590] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] update_check_range(min_check_version=184, max_check_version=185, global_version=186) [2024-09-11 16:20:22.866604] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2013 [2024-09-11 16:20:22.866640] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:22.866697] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:20:22.866734] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:20:22.866818] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:22.866938] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:20:22.866995] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:20:22.867007] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:20:22.867018] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:20:22.867054] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:20:22.867114] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:20:22.867155] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:20:22.958867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:22.978373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:22.978413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:22.978421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:22.978430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:23.034914] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:23.152443] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042823152440, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:20:23.153945] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042823153942, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:20:23.159007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:23.178727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:23.178774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:23.178783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:23.178792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:23.359126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:23.379099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:23.379140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:23.379148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:23.379159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:23.387547] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:23.559260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:23.579391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:23.579436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:23.579442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:23.579470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:23.759380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:23.779766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:23.779806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:23.779813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:23.779822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:23.963153] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3644, replace_start_pos=8900000, replace_num=100000) [2024-09-11 16:20:23.963200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:23.980067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:23.980112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:23.980120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:23.980129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:24.035762] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:24.160059] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042824160054, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:20:24.161499] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042824161496, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:20:24.163279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:24.180427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:24.180469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:24.180476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:24.180484] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:24.187452] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6955, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:20:24.363380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:24.387692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:24.387732] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:24.387747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:24.387765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:24.387773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:24.563507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:24.588030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:24.588077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:24.588083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:24.588090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:24.763628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:24.788308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:24.788341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:24.788346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:24.788354] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:24.963753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:24.988636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:24.988691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:24.988702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:24.988716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:25.036813] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:25.163871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:25.167733] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042825167730, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:20:25.169112] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=124] PNIO [ratelimit] time: 1726042825169110, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:20:25.188970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:25.189003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:25.189008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:25.189016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:25.364048] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=82] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:25.387849] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:25.389260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:25.389297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:25.389305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:25.389315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:25.564204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:25.589661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:25.589705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:25.589713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:25.589723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:25.764324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:25.790061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:25.790105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:25.790111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:25.790119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:25.964417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:25.990348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:25.990389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:25.990397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:25.990406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:26.037778] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:26.169023] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4368, replace_start_pos=9000000, replace_num=100000) [2024-09-11 16:20:26.169072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:26.175297] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042826175292, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:20:26.176813] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042826176810, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 16:20:26.190641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:26.190685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:26.190692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:26.190702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:26.198529] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7814, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:20:26.369154] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:26.388079] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=92] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:26.398856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:26.398936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:26.398944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:26.398953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:26.569253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:26.599177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:26.599223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:26.599229] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:26.599237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:26.769370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:26.799446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:26.799491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:26.799497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:26.799505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:26.969496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:26.999793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:26.999835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:26.999843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:26.999851] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:27.038668] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:27.169620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:27.182907] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042827182896, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:20:27.184400] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042827184397, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007587, add_bytes: 0 [2024-09-11 16:20:27.200110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:27.200178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:27.200186] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:27.200194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:27.369747] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:27.388221] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:27.400500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:27.400547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:27.400555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:27.400565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:27.569872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:27.600816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:27.600864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:27.600872] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:27.600881] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:27.770070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:27.801107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:27.801144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:27.801166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:27.801175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:27.970194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:28.001414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:28.001453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:28.001460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:28.001469] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:28.039518] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:28.170323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:28.190523] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042828190519, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:20:28.191961] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042828191958, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:20:28.201709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:28.201752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:28.201759] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:28.201768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:28.209883] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8101, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:20:28.373781] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3340, replace_start_pos=9100000, replace_num=100000) [2024-09-11 16:20:28.373822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:28.388436] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:28.410179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:28.410225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:28.410232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:28.410242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:28.573928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:28.610556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:28.610600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:28.610609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:28.610620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:28.610835] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=80, refresh_score_time=63, wash_time=0) [2024-09-11 16:20:28.774066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:28.811060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:28.811096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:28.811102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:28.811109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:28.974277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:29.011347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:29.011387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:29.011395] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:29.011404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:29.040440] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:29.174452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:29.198200] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042829198195, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:20:29.199572] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042829199567, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:20:29.211717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:29.211758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:29.211785] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:29.211795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:29.374606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:29.388572] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:29.412081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:29.412126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:29.412134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:29.412143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:29.574728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:29.612376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:29.612417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:29.612424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:29.612434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:29.774847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:29.812753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:29.812804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:29.812812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:29.812821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:29.974998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:30.013085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:30.013124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:30.013132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:30.013141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:30.041355] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:30.175114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:30.205813] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042830205809, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:20:30.207174] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042830207172, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:20:30.213374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:30.213406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:30.213413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:30.213421] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:30.221057] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7624, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:20:30.375235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:30.388782] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:30.421385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:30.421431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:30.421439] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:30.421449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:30.421637] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:20:30.579173] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3823, replace_start_pos=9200000, replace_num=100000) [2024-09-11 16:20:30.579238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:30.621893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:30.621973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:30.621981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:30.621992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:30.779416] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:30.822309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:30.822355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:30.822364] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:30.822374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:30.979602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:31.022628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:31.022680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:31.022687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:31.022696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:31.042614] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:31.179719] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:31.213428] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042831213423, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:20:31.214859] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042831214857, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:20:31.222973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:31.223016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:31.223024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:31.223033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:31.379835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:31.388988] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:31.423288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:31.423327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:31.423335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:31.423344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:31.579953] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:31.623575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:31.623617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:31.623624] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:31.623632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:31.780148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:31.823861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:31.823923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:31.823931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:31.823939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:31.980280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:32.024260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:32.024314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:32.024324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:32.024334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:32.043668] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:32.180419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:32.220975] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042832220971, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:20:32.222527] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042832222524, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:20:32.224569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:32.224598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:32.224605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:32.224615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:32.232718] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8090, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:20:32.380618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:32.389099] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:32.432960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:32.433005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:32.433011] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:32.433019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:32.580811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:32.633314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:32.633357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:32.633364] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:32.633389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:32.785041] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4104, replace_start_pos=9300000, replace_num=100000) [2024-09-11 16:20:32.785088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:32.833602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:32.833645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:32.833651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:32.833659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:32.881656] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:32.881699] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:32.881768] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] update_check_range(min_check_version=185, max_check_version=186, global_version=187) [2024-09-11 16:20:32.883518] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1748 [2024-09-11 16:20:32.883556] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:32.883600] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:20:32.883633] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:20:32.883709] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:32.883791] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:20:32.883840] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:20:32.883849] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:20:32.883858] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:20:32.883890] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:20:32.883949] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:20:32.883968] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:20:32.985249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:33.033879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:33.033946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:33.033953] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:33.033960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:33.044633] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:33.185387] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:33.228601] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042833228597, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:20:33.230031] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042833230030, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007506, add_bytes: 0 [2024-09-11 16:20:33.234256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:33.234296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:33.234304] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:33.234312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:33.385517] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:33.389297] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:33.434515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:33.434552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:33.434558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:33.434566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:33.585636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:33.634779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:33.634822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:33.634828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:33.634836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:33.785753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:33.835081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:33.835128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:33.835134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:33.835142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:33.985958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:34.035371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:34.035415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:34.035423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:34.035431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:34.045562] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:34.186085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:34.235669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:34.235725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:34.235732] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:34.235764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:34.236209] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042834236206, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:20:34.237651] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726042834237649, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:20:34.244665] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8886, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:20:34.386202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:34.389410] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:34.444982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:34.445045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:34.445052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:34.445061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:34.586322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:34.645309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:34.645355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:34.645363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:34.645372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:34.786439] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:34.845613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:34.845659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:34.845667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:34.845678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:34.990550] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3992, replace_start_pos=9400000, replace_num=100000) [2024-09-11 16:20:34.990594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:35.045941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:35.045986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:35.045994] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:35.046026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:35.046435] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:35.190686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:35.243829] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042835243826, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:20:35.245281] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042835245278, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:20:35.246324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:35.246351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:35.246359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:35.246369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:35.389593] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:35.390802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:35.446593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:35.446630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:35.446636] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:35.446644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:35.590925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:35.646868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:35.646927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:35.646934] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:35.646942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:35.791055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:35.847159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:35.847221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:35.847242] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:35.847249] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:35.991200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:36.047463] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:36.047511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:36.047561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:36.047569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:36.047578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:36.191326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:36.247882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:36.247950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:36.247960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:36.247970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:36.251506] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726042836251503, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:20:36.252921] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042836252899, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:20:36.256159] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8176, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:20:36.389877] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:36.391452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:36.456473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:36.456519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:36.456528] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:36.456537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:36.591555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:36.656863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:36.656928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:36.656937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:36.656946] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:36.791680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:36.857246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:36.857290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:36.857298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:36.857308] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:36.991802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:37.048803] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:37.057539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:37.057575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:37.057582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:37.057592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:37.195277] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3352, replace_start_pos=9500000, replace_num=100000) [2024-09-11 16:20:37.195320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:37.257849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:37.257888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:37.257896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:37.257933] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:37.259056] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042837259053, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:20:37.260488] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042837260487, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007588, add_bytes: 0 [2024-09-11 16:20:37.390012] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:37.395401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:37.458184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:37.458226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:37.458234] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:37.458243] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:37.595510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:37.658473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:37.658518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:37.658525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:37.658535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:37.795623] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:37.858740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:37.858774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:37.858780] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:37.858787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:37.995739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:38.050081] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:38.059071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:38.059104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:38.059111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:38.059131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:38.195858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:38.259352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:38.259391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:38.259400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:38.259412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:38.266681] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042838266677, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:20:38.267173] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7747, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:20:38.268105] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042838268104, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:20:38.390140] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:38.395995] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:38.467480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:38.467523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:38.467532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:38.467541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:38.596113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:38.667785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:38.667849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:38.667857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:38.667866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:38.796226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:38.868084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:38.868129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:38.868136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:38.868144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:38.996353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:39.051184] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:39.068374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:39.068417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:39.068424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:39.068433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:39.196475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:39.268638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:39.268686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:39.268699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:39.268707] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:39.274316] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042839274311, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:20:39.275821] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726042839275818, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007714, add_bytes: 0 [2024-09-11 16:20:39.390330] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:39.400360] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3767, replace_start_pos=9600000, replace_num=100000) [2024-09-11 16:20:39.400411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:39.469022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:39.469062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:39.469068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:39.469075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:39.600501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:39.669303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:39.669344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:39.669352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:39.669361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:39.800616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:39.869671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:39.869715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:39.869723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:39.869732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:40.000728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:40.052171] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:40.069997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:40.070042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:40.070050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:40.070059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:40.200859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:40.270381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:40.270428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:40.270436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:40.270446] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:40.278965] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8505, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:20:40.281971] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042840281968, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:20:40.283462] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042840283461, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007643, add_bytes: 0 [2024-09-11 16:20:40.390448] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:40.401010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:40.479214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:40.479247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:40.479253] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:40.479261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:40.601117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:40.679576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:40.679622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:40.679630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:40.679640] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:40.801237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:40.879922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:40.879963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:40.879970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:40.879978] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:41.001365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:41.053510] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:41.080215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:41.080260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:41.080268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:41.080277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:41.201487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:41.280521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:41.280565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:41.280572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:41.280581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:41.289589] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042841289585, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:20:41.291012] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042841291011, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:20:41.390608] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:41.401623] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:41.480818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:41.480859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:41.480883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:41.480892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:41.605757] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3986, replace_start_pos=9700000, replace_num=100000) [2024-09-11 16:20:41.605806] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:41.681156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:41.681198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:41.681206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:41.681215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:41.805922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:41.881446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:41.881484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:41.881491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:41.881500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:42.006041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:42.054625] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:42.081743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:42.081784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:42.081792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:42.081801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:42.206159] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:42.282156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:42.282236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:42.282245] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:42.282276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:42.290595] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8305, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:20:42.297208] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042842297204, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:20:42.298643] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042842298640, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:20:42.390725] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:42.406292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:42.490950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:42.490989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:42.490997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:42.491006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:42.606421] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:42.691329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:42.691374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:42.691382] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:42.691391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:42.806542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:42.891638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:42.891700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:42.891708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:42.891717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:42.897940] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:42.897984] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:42.898070] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=186, max_check_version=187, global_version=188) [2024-09-11 16:20:42.900081] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2010 [2024-09-11 16:20:42.900115] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:42.900150] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:20:42.900188] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:20:42.900296] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:42.900379] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:20:42.900435] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:20:42.900450] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:20:42.900469] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:20:42.900501] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:20:42.900548] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:20:42.900566] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:20:43.006654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:43.055559] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:43.092042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:43.092081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:43.092089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:43.092098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:43.206766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:43.292325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:43.292359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:43.292366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:43.292376] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:43.304767] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042843304763, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:20:43.306179] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042843306177, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:20:43.390937] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:43.406880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:43.492689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:43.492735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:43.492744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:43.492753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:43.607008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:43.693033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:43.693077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:43.693084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:43.693094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:43.811506] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4379, replace_start_pos=9800000, replace_num=100000) [2024-09-11 16:20:43.811554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:43.893322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:43.893362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:43.893386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:43.893396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:44.011638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:44.056533] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:44.093629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:44.093693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:44.093700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:44.093709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:44.211767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:44.294044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:44.294100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:44.294108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:44.294117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:44.301284] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7152, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:20:44.312366] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042844312363, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:20:44.313892] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042844313889, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007712, add_bytes: 0 [2024-09-11 16:20:44.391114] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:44.411942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:44.501647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:44.501692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:44.501700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:44.501710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:44.612058] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:44.701988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:44.702034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:44.702042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:44.702051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:44.812211] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:44.902282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:44.902327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:44.902335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:44.902344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:45.012358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:45.057612] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:45.102613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:45.102655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:45.102664] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:45.102674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:45.212499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:45.302991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:45.303035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:45.303042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:45.303051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:45.319999] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042845319996, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:20:45.321425] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042845321422, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007533, add_bytes: 0 [2024-09-11 16:20:45.391322] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:45.412624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:45.503276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:45.503319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:45.503326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:45.503335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:45.612748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:45.703639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:45.703677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:45.703690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:45.703700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:45.812870] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:45.903964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:45.904009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:45.904016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:45.904025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:46.017315] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4307, replace_start_pos=9900000, replace_num=100000) [2024-09-11 16:20:46.017357] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:46.058421] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:46.104332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:46.104379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:46.104387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:46.104397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:46.217462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:46.304647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:46.304691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:46.304697] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:46.304705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:46.311243] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6528, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:20:46.327603] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042846327599, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:20:46.329112] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042846329109, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:20:46.391555] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:46.417579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:46.511519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:46.511567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:46.511575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:46.511585] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:46.617697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:46.711812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:46.711851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:46.711876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:46.711885] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:46.817813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:46.912090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:46.912138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:46.912146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:46.912155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:47.017984] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:47.059578] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:47.112378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:47.112422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:47.112431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:47.112439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:47.218147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=92] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:47.312665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:47.312705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:47.312711] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:47.312720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:47.335284] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042847335280, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:20:47.336645] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042847336643, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 16:20:47.391685] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:47.418275] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:47.512961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:47.513024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:47.513031] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:47.513041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:47.618406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:47.713281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:47.713318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:47.713325] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:47.713334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:47.818533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:47.913568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:47.913607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:47.913614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:47.913622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:48.018669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:48.060518] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:48.113846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:48.113884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:48.113891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:48.113900] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:48.222170] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3366, replace_start_pos=10000000, replace_num=100000) [2024-09-11 16:20:48.222212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:48.314141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:48.314194] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:48.314201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:48.314210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:48.322757] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8534, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:20:48.342841] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042848342838, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:20:48.344258] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042848344256, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:20:48.391818] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:48.422311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:48.523085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:48.523131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:48.523139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:48.523149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:48.622534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:48.723373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:48.723415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:48.723422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:48.723431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:48.822667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:48.923662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:48.923705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:48.923713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:48.923722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:48.923954] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=76, refresh_score_time=61, wash_time=0) [2024-09-11 16:20:49.022817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:49.061554] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:49.124183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:49.124228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:49.124236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:49.124245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:49.222946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:49.324542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:49.324600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:49.324609] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:49.324625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:49.350464] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042849350459, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:20:49.351937] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042849351936, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:20:49.391945] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:49.423069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:49.524879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:49.524938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:49.524946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:49.524972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:49.623263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:49.725202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:49.725246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:49.725254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:49.725263] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:49.823390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:49.925537] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:49.925582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:49.925589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:49.925598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:50.023578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:50.062594] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:50.125958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:50.126005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:50.126013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:50.126022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:50.223709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:50.326259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:50.326298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:50.326306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:50.326315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:50.334587] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8246, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:20:50.358065] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042850358061, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:20:50.359491] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042850359491, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:20:50.392175] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:50.427194] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3352, replace_start_pos=10100000, replace_num=100000) [2024-09-11 16:20:50.427275] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:50.534849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:50.534893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:50.534913] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:50.534923] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:50.627366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:50.735141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:50.735190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:50.735196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:50.735204] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:50.827578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:50.935428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:50.935491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:50.935499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:50.935508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:51.027713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:51.063533] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:51.135750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:51.135795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:51.135803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:51.135812] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:51.227913] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:51.336054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:51.336103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:51.336111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:51.336120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:51.365751] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042851365747, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:20:51.367120] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726042851367119, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:20:51.392318] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:51.428039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:51.536343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:51.536383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:51.536389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:51.536398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:51.628180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:51.736616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:51.736659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:51.736665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:51.736673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:51.828322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:51.936920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:51.936960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:51.936966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:51.936976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:52.028455] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:52.064340] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:52.137192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:52.137240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:52.137246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:52.137253] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:52.228590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:52.337486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:52.337531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:52.337538] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:52.337547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:52.345234] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7674, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:20:52.373309] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042852373303, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:20:52.374796] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042852374794, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:20:52.392435] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:52.428712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:52.545556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:52.545604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:52.545612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:52.545622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:52.633212] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4358, replace_start_pos=10200000, replace_num=100000) [2024-09-11 16:20:52.633261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:52.745818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:52.745863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:52.745870] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:52.745877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:52.833356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:52.915138] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:52.915192] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:20:52.915277] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=187, max_check_version=188, global_version=189) [2024-09-11 16:20:52.917341] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2064 [2024-09-11 16:20:52.917378] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:52.917413] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:20:52.917452] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:20:52.917537] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:20:52.917656] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:20:52.917714] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:20:52.917726] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:20:52.917737] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:20:52.917774] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:20:52.917839] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:20:52.917861] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:20:52.946189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:52.946234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:52.946241] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:52.946251] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:53.033490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:53.065376] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:53.146553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:53.146595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:53.146601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:53.146609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:53.233616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:53.346813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:53.346848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:53.346854] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:53.346861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:53.380938] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726042853380934, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:20:53.382345] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042853382342, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:20:53.392635] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:53.433755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:53.547106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:53.547151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:53.547158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:53.547168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:53.633894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:53.747401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:53.747448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:53.747455] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:53.747462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:53.834035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:53.947725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:53.947771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:53.947778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:53.947787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:54.034166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:54.066245] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:54.148081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:54.148125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:54.148133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:54.148143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:54.234371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:54.348371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:54.348425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:54.348433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:54.348442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:54.356881] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8426, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:20:54.388529] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042854388526, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:20:54.390057] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042854390054, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007712, add_bytes: 0 [2024-09-11 16:20:54.392746] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:54.434533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:54.557161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:54.557203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:54.557211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:54.557220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:54.634708] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:54.757446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:54.757486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:54.757493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:54.757502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:54.838885] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4044, replace_start_pos=10300000, replace_num=100000) [2024-09-11 16:20:54.838937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:54.957751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:54.957795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:54.957803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:54.957811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:55.039083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:55.067331] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:55.158039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:55.158075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:55.158081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:55.158089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:55.239284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:55.358392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:55.358434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:55.358442] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:55.358451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:55.392858] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:55.396213] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042855396210, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:20:55.397582] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042855397580, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007526, add_bytes: 0 [2024-09-11 16:20:55.439470] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:55.558692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:55.558748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:55.558756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:55.558766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:55.639686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:55.759014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:55.759054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:55.759064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:55.759072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:55.839867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:55.959307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:55.959342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:55.959348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:55.959356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:56.040082] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:56.068418] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:56.159644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:56.159692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:56.159699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:56.159709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:56.240299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:56.359960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:56.360003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:56.360020] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:56.360057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:56.368575] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8503, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:20:56.393022] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:56.403831] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042856403827, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:20:56.405200] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042856405198, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:20:56.440424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:56.568833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:56.568873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:56.568881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:56.568890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:56.640609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:56.769273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:56.769327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:56.769335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:56.769344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:56.840800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:56.969589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:56.969659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:56.969667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:56.969676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:57.044856] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3867, replace_start_pos=10400000, replace_num=100000) [2024-09-11 16:20:57.044898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:57.069738] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:57.169931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:57.169978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:57.169985] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:57.169994] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:57.245071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:57.370239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:57.370278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:57.370286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:57.370296] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:57.393141] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:57.411381] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042857411377, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:20:57.412805] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042857412804, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:20:57.445256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:57.570532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:57.570579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:57.570587] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:57.570608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:57.645435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:57.770879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:57.770950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:57.770958] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:57.770968] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:57.845555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:20:57.971195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:57.971239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:57.971246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:57.971256] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:58.045743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:20:58.070960] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:58.171463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:58.171507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:58.171513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:58.171520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:58.245881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:20:58.371741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:58.371785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:58.371792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:58.371805] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:58.379489] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7669, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:20:58.393321] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:58.419064] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042858419060, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:20:58.420423] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042858420421, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:20:58.446085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:20:58.579759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:58.579807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:58.579815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:58.579823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:58.646269] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:20:58.780060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:58.780107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:58.780115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:58.780124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:58.846468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:20:58.980350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:58.980395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:58.980403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:58.980412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:59.046653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:20:59.072462] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:20:59.180674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:59.180722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:59.180729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:59.180757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:59.251185] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4340, replace_start_pos=10500000, replace_num=100000) [2024-09-11 16:20:59.251232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:20:59.381070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:59.381122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:59.381130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:59.381139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:59.393456] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:20:59.426609] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042859426605, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:20:59.428035] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042859428035, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:20:59.451385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:20:59.581381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:59.581437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:59.581445] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:59.581455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:59.651570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:20:59.781774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:59.781826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:59.781834] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:59.781842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:20:59.851771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:20:59.982075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:20:59.982120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:20:59.982128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:20:59.982137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:00.051918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:00.073864] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:00.182443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:00.182489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:00.182496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:00.182505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:00.252046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:00.382764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:00.382808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:00.382816] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:00.382824] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:00.390542] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7705, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:21:00.393640] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:00.423718] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:21:00.429712] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:21:00.434310] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042860434307, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007702, add_bytes: 0 [2024-09-11 16:21:00.434353] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:21:00.435664] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726042860435663, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:21:00.435678] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:21:00.452184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:00.590863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:00.590931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:00.590941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:00.590951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:00.591140] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:21:00.652315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:00.791402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:00.791449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:00.791457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:00.791466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:00.852452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:00.991692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:00.991754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:00.991762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:00.991770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:01.052581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:01.074873] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=112] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:01.192027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:01.192073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:01.192080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:01.192088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:01.252719] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:01.392318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:01.392366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:01.392373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:01.392382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:01.393775] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:01.441929] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042861441925, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:21:01.443279] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726042861443278, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:21:01.456340] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3421, replace_start_pos=10600000, replace_num=100000) [2024-09-11 16:21:01.456383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:01.592682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:01.592728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:01.592737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:01.592747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:01.656472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:01.793030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:01.793075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:01.793083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:01.793092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:01.856654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:01.993337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:01.993381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:01.993388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:01.993407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:02.056773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:02.076011] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:02.193635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:02.193681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:02.193689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:02.193698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:02.256950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:02.393879] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=21] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:02.393977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:02.393994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:02.394000] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:02.394007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:02.402229] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8195, clean_start_pos=0, clean_num=200000) [2024-09-11 16:21:02.449525] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042862449521, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:21:02.450888] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042862450887, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:21:02.457133] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:02.602556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:02.602602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:02.602610] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:02.602619] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:02.657308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:02.802825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:02.802866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:02.802877] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:02.802884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:02.857494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:02.934061] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:02.934115] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:02.934196] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=188, max_check_version=189, global_version=190) [2024-09-11 16:21:02.936267] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2069 [2024-09-11 16:21:02.936310] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:02.936346] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:21:02.936393] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:21:02.936481] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:02.936602] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 12 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:21:02.936657] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:21:02.936669] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:21:02.936679] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:21:02.936720] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:21:02.936784] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:21:02.936806] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:21:03.003180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:03.003218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:03.003225] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:03.003234] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:03.057619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:03.077293] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:03.203480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:03.203524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:03.203531] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:03.203541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:03.257736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:03.394094] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:03.403791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:03.403833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:03.403841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:03.403850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:03.457086] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042863457083, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:21:03.457849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:03.458512] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042863458510, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:21:03.604133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:03.604176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:03.604183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:03.604192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:03.662290] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4337, replace_start_pos=10700000, replace_num=100000) [2024-09-11 16:21:03.662338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:03.804493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:03.804539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:03.804547] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:03.804557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:03.862417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:04.004883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:04.004951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:04.004960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:04.004970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:04.062533] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:04.078103] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:04.205267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:04.205311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:04.205324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:04.205334] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:04.262653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:04.394274] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:04.405594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:04.405634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:04.405641] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:04.405650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:04.413227] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7564, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:21:04.462819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:04.464753] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726042864464751, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:21:04.466132] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042864466130, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:21:04.613495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:04.613536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:04.613543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:04.613553] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:04.662938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:04.813807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:04.813853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:04.813878] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:04.813887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:04.863057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:05.014140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:05.014176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:05.014184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:05.014193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:05.063171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:05.178924] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:05.214431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:05.214473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:05.214481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:05.214491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:05.263277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:05.394481] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:05.414837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:05.414882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:05.414890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:05.414899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:05.463440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:05.472318] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042865472315, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:21:05.473734] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042865473732, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:21:05.615156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:05.615214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:05.615220] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:05.615228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:05.663623] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:05.815460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:05.815503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:05.815511] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:05.815520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:05.868166] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4361, replace_start_pos=10800000, replace_num=100000) [2024-09-11 16:21:05.868216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:06.015794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:06.015836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:06.015844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:06.015853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:06.068360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:06.180152] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:06.216074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:06.216111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:06.216118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:06.216125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:06.268475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:06.394684] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:06.416362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:06.416405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:06.416413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:06.416422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:06.424610] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8172, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:21:06.468590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:06.479992] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042866479989, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:21:06.481356] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042866481353, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:21:06.624897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:06.624956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:06.624964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:06.624974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:06.668711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:06.825201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:06.825245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:06.825251] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:06.825258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:06.868828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:07.025494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:07.025536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:07.025544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:07.025554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:07.068968] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:07.181125] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:07.225844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:07.225886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:07.225894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:07.225924] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:07.269073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:07.394892] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:07.426236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:07.426282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:07.426290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:07.426300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:07.469186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:07.487537] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042867487533, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:21:07.488964] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042867488963, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:21:07.626539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:07.626585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:07.626592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:07.626601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:07.669365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:07.826930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:07.826970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:07.826976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:07.826984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:07.869488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:08.027236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:08.027283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:08.027292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:08.027302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:08.074072] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4459, replace_start_pos=10900000, replace_num=100000) [2024-09-11 16:21:08.074116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:08.182295] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:08.227606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:08.227652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:08.227659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:08.227667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:08.274208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:08.395033] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:08.427898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:08.427966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:08.427974] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:08.427999] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:08.435481] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7457, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:21:08.474322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:08.495228] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042868495224, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:21:08.496656] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726042868496653, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:21:08.635741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:08.635787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:08.635794] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:08.635803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:08.674443] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:08.836105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:08.836145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:08.836152] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:08.836162] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:08.874617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:09.036404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:09.036448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:09.036475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:09.036485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:09.074734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:09.183084] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:09.236721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:09.236777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:09.236784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:09.236791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:09.237005] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=85, refresh_score_time=56, wash_time=0) [2024-09-11 16:21:09.274957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:09.395159] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:09.437261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:09.437321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:09.437354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:09.437364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:09.475082] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:09.502777] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042869502772, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:21:09.504202] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042869504201, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007548, add_bytes: 0 [2024-09-11 16:21:09.637652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:09.637696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:09.637702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:09.637710] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:09.675203] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:09.837968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:09.838012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:09.838020] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:09.838029] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:09.875406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:10.038253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:10.038298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:10.038305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:10.038314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:10.075592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:10.184161] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:10.238555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:10.238600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:10.238607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:10.238616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:10.280025] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4316, replace_start_pos=11000000, replace_num=100000) [2024-09-11 16:21:10.280077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:10.395272] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:10.438864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:10.438934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:10.438944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:10.438954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:10.446489] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7505, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:21:10.480168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:10.510390] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042870510385, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:21:10.511812] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042870511811, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:21:10.646734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:10.646776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:10.646783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:10.646793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:10.680285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:10.847038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:10.847086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:10.847094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:10.847103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:10.880412] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:11.047303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:11.047362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:11.047369] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:11.047378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:11.080564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:11.185334] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:11.247627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:11.247675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:11.247682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:11.247708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:11.280755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:11.395424] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:11.447944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:11.447986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:11.447993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:11.448000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:11.480881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:11.517998] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042871517995, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:21:11.519431] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042871519431, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:21:11.648237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:11.648283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:11.648290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:11.648310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:11.681038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:11.848560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:11.848606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:11.848632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:11.848641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:11.881151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:12.048884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:12.048959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:12.048966] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:12.048975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:12.081327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:12.186395] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:12.249189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:12.249233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:12.249240] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:12.249248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:12.281447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:12.395610] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:12.449480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:12.449520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:12.449527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:12.449537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:12.457486] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7937, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:21:12.485767] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4194, replace_start_pos=11100000, replace_num=100000) [2024-09-11 16:21:12.485814] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:12.525614] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042872525611, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:21:12.527043] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726042872527042, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:21:12.657816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:12.657859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:12.657867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:12.657877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:12.685926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:12.858179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:12.858222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:12.858230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:12.858240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:12.886048] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:12.951001] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:12.951055] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:12.951138] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=189, max_check_version=190, global_version=191) [2024-09-11 16:21:12.953135] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1997 [2024-09-11 16:21:12.953188] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=40] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:12.953222] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:21:12.953260] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:21:12.953342] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:12.953449] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:21:12.953512] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:21:12.953523] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:21:12.953534] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:21:12.953571] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:21:12.953634] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:21:12.953653] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:21:13.058448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:13.058491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:13.058496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:13.058505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:13.086251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:13.187712] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:13.258740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:13.258783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:13.258790] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:13.258800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:13.286384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:13.395738] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:13.459049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:13.459092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:13.459098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:13.459106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:13.486503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:13.533241] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042873533238, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:21:13.534726] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726042873534725, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:21:13.659344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:13.659429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=84][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:13.659440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:13.659454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:13.686692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:13.859673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:13.859716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:13.859722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:13.859729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:13.886817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:14.059981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:14.060018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:14.060025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:14.060033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:14.087005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:14.188464] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:14.260272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:14.260314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:14.260322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:14.260331] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:14.287157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:14.395849] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:14.460551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:14.460603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:14.460625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:14.460633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:14.467309] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6663, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:21:14.487308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:14.540948] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042874540944, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007706, add_bytes: 0 [2024-09-11 16:21:14.542280] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042874542278, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:21:14.667552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:14.667596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:14.667602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:14.667609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:14.691600] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4146, replace_start_pos=11200000, replace_num=100000) [2024-09-11 16:21:14.691643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:14.867838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:14.867887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:14.867894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:14.867925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:14.891739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:15.068132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:15.068175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:15.068182] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:15.068189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:15.091877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:15.189256] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:15.268420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:15.268461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:15.268468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:15.268477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:15.292024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:15.395992] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:15.468714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:15.468755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:15.468764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:15.468773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:15.492221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:15.548579] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042875548575, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:21:15.549914] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726042875549913, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:21:15.669011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:15.669054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:15.669061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:15.669068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:15.692349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:15.869294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:15.869345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:15.869354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:15.869364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:15.892480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:16.069621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:16.069665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:16.069671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:16.069679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:16.092665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:16.190190] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:16.269919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:16.269962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:16.269968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:16.269976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:16.292789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:16.396202] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:16.470206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:16.470250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:16.470258] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:16.470267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:16.478216] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7918, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:21:16.492971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:16.556152] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042876556147, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 16:21:16.557513] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726042876557511, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:21:16.678452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:16.678494] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:16.678500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:16.678507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:16.693086] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:16.878712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:16.878750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:16.878757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:16.878764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:16.896541] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3346, replace_start_pos=11300000, replace_num=100000) [2024-09-11 16:21:16.896586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:17.079012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:17.079056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:17.079079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:17.079089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:17.096743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:17.191126] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=92] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:17.279380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:17.279439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:17.279448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:17.279458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:17.296861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:17.396348] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:17.479868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:17.479932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:17.479942] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:17.479953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:17.497063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:17.563775] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042877563770, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:21:17.565197] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042877565195, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:21:17.680187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:17.680231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:17.680239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:17.680248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:17.697248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:17.880549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:17.880613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:17.880623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:17.880633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:17.897429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:18.080974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:18.081014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:18.081022] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:18.081031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:18.097547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:18.191952] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:18.281261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:18.281303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:18.281311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:18.281320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:18.297667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:18.396516] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:18.481562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:18.481606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:18.481613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:18.481623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:18.490044] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8408, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:21:18.497779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:18.571347] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042878571342, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 16:21:18.572746] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042878572745, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:21:18.690288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:18.690329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:18.690335] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:18.690343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:18.697926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:18.890565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:18.890604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:18.890611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:18.890620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:18.898046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:19.090966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:19.091010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:19.091018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:19.091028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:19.102562] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4389, replace_start_pos=11400000, replace_num=100000) [2024-09-11 16:21:19.102608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:19.193008] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:19.291264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:19.291308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:19.291315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:19.291324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:19.302773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:19.396659] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:19.491638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:19.491694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:19.491707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:19.491718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:19.502957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:19.579002] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726042879578997, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007655, add_bytes: 0 [2024-09-11 16:21:19.580354] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726042879580352, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:21:19.691962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:19.692008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:19.692014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:19.692022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:19.703144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:19.892269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:19.892311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:19.892319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:19.892328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:19.903292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:20.092651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:20.092696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:20.092703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:20.092711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:20.103479] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:20.194294] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:20.292965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:20.293008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:20.293015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:20.293024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:20.303592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:20.396792] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:20.493253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:20.493294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:20.493301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:20.493311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:20.501920] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8595, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:21:20.503755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:20.586560] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042880586556, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:21:20.587974] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042880587973, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:21:20.702185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:20.702254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:20.702261] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:20.702270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:20.703858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:20.902492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:20.902534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:20.902541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:20.902548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:20.903949] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:21.102777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:21.102818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:21.102825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:21.102832] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:21.104034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:21.195189] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:21.303090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:21.303130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:21.303137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:21.303144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:21.308466] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4341, replace_start_pos=11500000, replace_num=100000) [2024-09-11 16:21:21.308503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:21.396941] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:21.503388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:21.503433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:21.503440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:21.503449] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:21.508590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:21.594271] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042881594267, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007711, add_bytes: 0 [2024-09-11 16:21:21.595596] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726042881595594, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:21:21.703680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:21.703723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:21.703730] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:21.703738] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:21.708761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:21.903996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:21.904040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:21.904048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:21.904057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:21.908883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:22.104298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:22.104356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:22.104363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:22.104373] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:22.109091] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:22.196125] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:22.304629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:22.304677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:22.304685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:22.304694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:22.309281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:22.397059] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:22.504960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:22.505004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:22.505012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:22.505021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:22.509463] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:22.512960] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7926, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:21:22.601790] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042882601786, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007519, add_bytes: 0 [2024-09-11 16:21:22.603207] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042882603206, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:21:22.709642] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:22.713196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:22.713227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:22.713250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:22.713258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:22.909763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:22.913491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:22.913533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:22.913543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:22.913552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:22.967968] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:22.968019] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:22.968097] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=190, max_check_version=191, global_version=192) [2024-09-11 16:21:22.970202] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2104 [2024-09-11 16:21:22.970243] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:22.970279] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:21:22.970336] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:21:22.970419] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:22.970527] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:21:22.970579] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:21:22.970594] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:21:22.970605] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:21:22.970642] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:21:22.970702] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:21:22.970724] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:21:23.109989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:23.113776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:23.113822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:23.113830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:23.113839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:23.197239] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:23.310109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:23.314077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:23.314111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:23.314117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:23.314126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:23.397199] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:23.514334] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=103] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3984, replace_start_pos=11600000, replace_num=100000) [2024-09-11 16:21:23.514354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:23.514384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:23.514397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:23.514404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:23.514413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:23.609403] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042883609398, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:21:23.610821] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726042883610820, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:21:23.714481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=14] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:23.714640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:23.714673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:23.714681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:23.714690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:23.914616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:23.914961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:23.914990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:23.914997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:23.915005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:24.114739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:24.115221] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:24.115246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:24.115252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:24.115260] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:24.198126] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:24.314922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:24.315483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:24.315508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:24.315515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:24.315523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:24.397385] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:24.515150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:24.515792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:24.516572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=779][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:24.516589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:24.516599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:24.524857] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8228, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:21:24.617093] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042884617089, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:21:24.618505] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726042884618503, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:21:24.715346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:24.725104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:24.725152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:24.725160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:24.725171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:24.915538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:24.925428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:24.925477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:24.925485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:24.925494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:25.115694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:25.125789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:25.125834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:25.125841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:25.125850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:25.199229] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:25.315919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:25.326106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:25.326150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:25.326157] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:25.326183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:25.397512] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:25.516104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:25.526485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:25.526529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:25.526536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:25.526545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:25.624635] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042885624630, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:21:25.626050] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042885626048, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:21:25.720000] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3721, replace_start_pos=11700000, replace_num=100000) [2024-09-11 16:21:25.720043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:25.726830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:25.726866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:25.726873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:25.726883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:25.920125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:25.927172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:25.927223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:25.927231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:25.927240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:26.120332] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:26.127482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:26.127522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:26.127530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:26.127539] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:26.200157] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:26.320454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:26.327769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:26.327804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:26.327810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:26.327818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:26.397653] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:26.520566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:26.528055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:26.528091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:26.528099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:26.528108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:26.536319] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8197, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:21:26.632349] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042886632344, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007714, add_bytes: 0 [2024-09-11 16:21:26.633680] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042886633678, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:21:26.720688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:26.736694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:26.736734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:26.736742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:26.736752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:26.920866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:26.937040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:26.937083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:26.937091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:26.937100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:27.121067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:27.137339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:27.137383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:27.137390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:27.137398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:27.201313] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:27.321188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:27.337624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:27.337669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:27.337675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:27.337683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:27.397782] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:27.521314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:27.537958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:27.538003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:27.538011] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:27.538020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:27.639864] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726042887639860, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007516, add_bytes: 0 [2024-09-11 16:21:27.641287] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726042887641284, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:21:27.721511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:27.738279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:27.738325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:27.738332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:27.738341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:27.926045] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=11800000, replace_num=100000) [2024-09-11 16:21:27.926089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:27.938572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:27.938611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:27.938618] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:27.938626] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:28.126175] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:28.138874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:28.138936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:28.138943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:28.138952] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:28.202336] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:28.326295] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:28.339207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:28.339252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:28.339259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:28.339268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:28.397917] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:28.526483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:28.539574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:28.539615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:28.539623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:28.539632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:28.546811] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7165, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:21:28.647526] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726042888647521, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 16:21:28.648921] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042888648918, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:21:28.726673] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:28.747062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:28.747123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:28.747129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:28.747137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:28.926857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:28.947442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:28.947487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:28.947495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:28.947505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:29.127000] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:29.147751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:29.147797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:29.147805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:29.147814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:29.203397] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:29.327121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:29.348132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:29.348175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:29.348182] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:29.348191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:29.398048] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:29.527243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:29.548528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:29.548575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:29.548602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:29.548612] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:29.548831] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=99, refresh_score_time=65, wash_time=0) [2024-09-11 16:21:29.655260] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042889655255, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007734, add_bytes: 0 [2024-09-11 16:21:29.656523] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042889656521, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:21:29.727371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:29.749074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:29.749117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:29.749125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:29.749135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:29.927553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:29.949466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:29.949511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:29.949519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:29.949529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:30.132110] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4367, replace_start_pos=11900000, replace_num=100000) [2024-09-11 16:21:30.132157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:30.149835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:30.149880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:30.149887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:30.149896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:30.204360] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:30.332264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:30.350146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:30.350189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:30.350197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:30.350206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:30.398224] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:30.532442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:30.550447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:30.550493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:30.550500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:30.550509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:30.557621] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7099, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:21:30.662720] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042890662715, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007460, add_bytes: 0 [2024-09-11 16:21:30.664222] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726042890664219, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007698, add_bytes: 0 [2024-09-11 16:21:30.732565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:30.757888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:30.757954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:30.757962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:30.757987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:30.758168] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | [2024-09-11 16:21:30.932750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:30.958472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:30.958517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:30.958524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:30.958534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:31.132878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:31.158779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:31.158824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:31.158832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:31.158841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:31.205530] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:31.333014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:31.359106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:31.359152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:31.359159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:31.359168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:31.398470] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:31.533197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:31.559482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:31.559531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:31.559558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:31.559568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:31.670458] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726042891670453, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007738, add_bytes: 0 [2024-09-11 16:21:31.671758] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042891671756, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:21:31.733330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:31.759806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:31.759853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:31.759860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:31.759868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:31.933506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:31.960097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:31.960141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:31.960148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:31.960156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:32.133632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:32.160392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:32.160437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:32.160460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:32.160470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:32.206724] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:32.338185] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4361, replace_start_pos=12000000, replace_num=100000) [2024-09-11 16:21:32.338236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:32.360737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:32.360788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:32.360795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:32.360802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:32.398601] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:32.538397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:32.561046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:32.561164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=117][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:32.561172] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:32.561180] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:32.567754] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6562, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:21:32.678031] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042892678027, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 16:21:32.679375] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042892679374, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:21:32.738585] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:32.768080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:32.768127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:32.768135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:32.768144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:32.938712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:32.968398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:32.968445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:32.968453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:32.968462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:32.984613] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:32.984638] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:32.984718] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=191, max_check_version=192, global_version=193) [2024-09-11 16:21:32.986691] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1973 [2024-09-11 16:21:32.986729] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:32.986760] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:21:32.986813] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:21:32.986888] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:32.986989] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:21:32.987036] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:21:32.987049] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:21:32.987058] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:21:32.987089] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:21:32.987138] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:21:32.987159] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:21:33.138937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:33.168696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:33.168742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:33.168749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:33.168777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:33.207813] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:33.339071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:33.369045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:33.369137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=88][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:33.369159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:33.369170] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:33.398801] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:33.539199] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:33.569391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:33.569434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:33.569440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:33.569448] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:33.685572] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042893685568, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:21:33.687054] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042893687052, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:21:33.739312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:33.769749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:33.769793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:33.769800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:33.769809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:33.939488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:33.970110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:33.970180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:33.970189] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:33.970199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:34.139615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:34.170431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:34.170474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:34.170480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:34.170488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:34.208824] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:34.339737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:34.370732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:34.370774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:34.370783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:34.370792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:34.399002] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:34.544303] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4380, replace_start_pos=12100000, replace_num=100000) [2024-09-11 16:21:34.544352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:34.571047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:34.571097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:34.571110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:34.571120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:34.579645] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8511, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:21:34.693245] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042894693240, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:21:34.694605] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042894694603, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:21:34.744454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:34.779949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:34.779989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:34.779995] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:34.780002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:34.944638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:34.980250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:34.980293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:34.980301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:34.980311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:35.144768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:35.180613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:35.180657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:35.180664] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:35.180671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:35.209955] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:35.344879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:35.380963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:35.381015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:35.381023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:35.381033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:35.399199] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:35.545085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:35.581372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:35.581417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:35.581425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:35.581435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:35.700803] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042895700798, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:21:35.702214] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042895702213, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:21:35.745273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:35.781674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:35.781720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:35.781729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:35.781738] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:35.945407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:35.982011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:35.982055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:35.982063] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:35.982072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:36.145604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:36.182321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:36.182367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:36.182375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:36.182384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:36.211055] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:36.345734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:36.382608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:36.382651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:36.382658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:36.382667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:36.399419] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:36.545921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:36.582959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:36.583010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:36.583018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:36.583027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:36.590862] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7822, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:21:36.708475] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042896708470, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:21:36.709835] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042896709833, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:21:36.750470] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4429, replace_start_pos=12200000, replace_num=100000) [2024-09-11 16:21:36.750518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:36.791107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:36.791149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:36.791156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:36.791163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:36.950622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:36.991411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:36.991457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:36.991465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:36.991474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:37.150738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:37.191853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:37.191895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:37.191925] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:37.191935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:37.212319] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:37.350841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:37.392257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:37.392299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:37.392306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:37.392314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:37.399608] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:37.550965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:37.592536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:37.592585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:37.592592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:37.592599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:37.716090] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042897716085, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:21:37.717518] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042897717516, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:21:37.751103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:37.792812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:37.792846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:37.792853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:37.792861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:37.951223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:37.993087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:37.993129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:37.993136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:37.993146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:38.151345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:38.193390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:38.193450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:38.193458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:38.193467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:38.213310] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:38.351465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:38.393834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:38.393880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:38.393888] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:38.393897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:38.399786] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:38.551599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:38.594216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:38.594264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:38.594273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:38.594283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:38.602488] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8190, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:21:38.723660] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042898723656, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007571, add_bytes: 0 [2024-09-11 16:21:38.725061] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726042898725060, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:21:38.751717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:38.802725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:38.802767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:38.802778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:38.802786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:38.956152] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4318, replace_start_pos=12300000, replace_num=100000) [2024-09-11 16:21:38.956201] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:39.003075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:39.003121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:39.003129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:39.003138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:39.156286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:39.203373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:39.203419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:39.203427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:39.203435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:39.214156] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:39.356408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:39.399933] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:39.403681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:39.403717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:39.403726] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:39.403736] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:39.556523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:39.603976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:39.604030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:39.604036] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:39.604069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:39.731250] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042899731246, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 16:21:39.732746] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042899732743, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:21:39.756639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:39.804282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:39.804323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:39.804329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:39.804337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:39.956754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:40.004576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:40.004622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:40.004630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:40.004640] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:40.156881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:40.204847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:40.204885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:40.204899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:40.204930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:40.215071] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:40.357018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:40.400116] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:40.405244] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:40.405284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:40.405309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:40.405319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:40.557131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:40.605575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:40.605621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:40.605629] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:40.605638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:40.612560] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6910, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:21:40.738871] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042900738867, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:21:40.740295] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042900740293, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:21:40.757253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:40.812869] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:40.812933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:40.812943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:40.812952] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:40.957363] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:41.013193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:41.013253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:41.013261] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:41.013312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:41.161694] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4212, replace_start_pos=12400000, replace_num=100000) [2024-09-11 16:21:41.161735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:41.213610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:41.213655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:41.213663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:41.213672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:41.216196] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:41.361825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:41.400347] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:41.413921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:41.413967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:41.413975] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:41.413985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:41.561936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:41.614192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:41.614234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:41.614240] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:41.614248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:41.746495] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726042901746491, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:21:41.747907] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042901747906, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:21:41.762047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:41.814484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:41.814530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:41.814537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:41.814546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:41.962164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:42.014754] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:42.014796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:42.014802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:42.014809] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:42.162282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:42.215073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:42.215117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:42.215125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:42.215135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:42.217177] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:42.362399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:42.400467] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:42.415446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:42.415489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:42.415495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:42.415503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:42.562519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:42.615760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:42.615814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:42.615826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:42.615839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:42.623807] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7953, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:21:42.754168] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726042902754164, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:21:42.755540] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726042902755538, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:21:42.762642] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:42.824061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:42.824101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:42.824109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:42.824118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:42.962742] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:43.001363] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:43.001412] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:43.001483] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] update_check_range(min_check_version=192, max_check_version=193, global_version=194) [2024-09-11 16:21:43.003254] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1770 [2024-09-11 16:21:43.003293] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:43.003324] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:21:43.003357] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:21:43.003558] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:43.003739] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:21:43.003792] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:21:43.003802] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:21:43.003811] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:21:43.003843] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:21:43.003895] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:21:43.003926] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:21:43.024413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:43.024453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:43.024460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:43.024469] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:43.162864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:43.218283] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:43.224766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:43.224804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:43.224812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:43.224821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:43.366613] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3612, replace_start_pos=12500000, replace_num=100000) [2024-09-11 16:21:43.366661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:43.400597] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:43.425069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:43.425111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:43.425130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:43.425143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:43.566750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:43.625409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:43.625454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:43.625461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:43.625470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:43.761781] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042903761777, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:21:43.763211] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726042903763209, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:21:43.768015] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:43.825785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:43.825830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:43.825839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:43.825848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:43.968123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:44.026152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:44.026193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:44.026202] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:44.026212] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:44.168313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:44.219446] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:44.226457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:44.226500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:44.226508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:44.226517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:44.368466] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:44.400712] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:44.426785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:44.426828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:44.426835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:44.426844] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:44.568599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:44.627145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:44.627200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:44.627209] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:44.627219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:44.635646] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8413, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:21:44.768726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:44.769437] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042904769434, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:21:44.770768] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042904770765, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:21:44.835934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:44.835977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:44.836002] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:44.836012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:44.968936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:45.036309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:45.036355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:45.036362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:45.036372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:45.169073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:45.220513] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:45.236606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:45.236652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:45.236659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:45.236668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:45.369269] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:45.400842] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:45.436997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:45.437040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:45.437047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:45.437056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:45.574578] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=5173, replace_start_pos=0, replace_num=100000) [2024-09-11 16:21:45.574635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:45.637350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:45.637397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:45.637427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:45.637437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:45.774730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:45.777014] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042905777011, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007577, add_bytes: 0 [2024-09-11 16:21:45.778382] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042905778380, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:21:45.837676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:45.837716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:45.837724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:45.837733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:45.974843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:46.037983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:46.038029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:46.038035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:46.038043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:46.174971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:46.221863] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:46.238268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:46.238312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:46.238319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:46.238326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:46.375091] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:46.401057] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=84] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:46.438547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:46.438588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:46.438596] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:46.438605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:46.575204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:46.638899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:46.638960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:46.638967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:46.638976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:46.647513] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8524, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:21:46.775334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:46.784630] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042906784626, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:21:46.786055] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726042906786053, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:21:46.847822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:46.847866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:46.847873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:46.847881] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:46.975520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:47.048151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:47.048200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:47.048208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:47.048218] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:47.175748] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:47.223055] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=101] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:47.248456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:47.248502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:47.248510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:47.248519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:47.375987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:47.401221] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:47.448734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:47.448777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:47.448783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:47.448790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:47.576177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:47.649034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:47.649077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:47.649084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:47.649091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:47.780746] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4385, replace_start_pos=100000, replace_num=100000) [2024-09-11 16:21:47.780813] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:47.792201] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042907792196, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:21:47.793672] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042907793671, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:21:47.849319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:47.849363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:47.849371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:47.849380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:47.980926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:48.049682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:48.049727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:48.049736] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:48.049745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:48.181061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:48.224267] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:48.249983] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:48.250018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:48.250024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:48.250032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:48.381194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:48.401403] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:48.450269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:48.450307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:48.450314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:48.450339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:48.581313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:48.650569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:48.650612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:48.650620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:48.650629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:48.659144] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8502, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:21:48.781431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:48.799858] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042908799854, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007658, add_bytes: 0 [2024-09-11 16:21:48.801330] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042908801328, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:21:48.859401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:48.859443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:48.859451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:48.859460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:48.981551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:49.059825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:49.059865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:49.059890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:49.059915] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:49.181682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:49.225557] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:49.260197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:49.260248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:49.260256] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:49.260266] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:49.381811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:49.401564] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:49.460496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:49.460540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:49.460548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:49.460557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:49.581929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:49.660803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:49.660857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:49.660881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:49.660891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:49.782045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:49.807476] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726042909807472, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:21:49.808839] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042909808838, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007510, add_bytes: 0 [2024-09-11 16:21:49.861143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:49.861199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:49.861207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:49.861216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:49.861430] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=88, refresh_score_time=65, wash_time=0) [2024-09-11 16:21:49.986630] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4410, replace_start_pos=200000, replace_num=100000) [2024-09-11 16:21:49.986679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:50.061662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:50.061708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:50.061716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:50.061725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:50.186827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:50.226833] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:50.262078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:50.262122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:50.262130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:50.262139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:50.387018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:50.401754] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:50.462430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:50.462468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:50.462476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:50.462485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:50.587209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:50.662736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:50.662783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:50.662799] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:50.662813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:50.671404] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8575, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:21:50.787391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:50.815032] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042910815027, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:21:50.816456] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042910816455, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:21:50.871682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:50.871724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:50.871731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:50.871740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:50.987593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:51.072061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:51.072108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:51.072117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:51.072127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:51.187780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:51.228015] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=104] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:51.272457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:51.272502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:51.272511] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:51.272554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:51.387942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:51.401915] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:51.472766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:51.472808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:51.472814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:51.472822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:51.588134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:51.673094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:51.673140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:51.673147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:51.673157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:51.788323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:51.822719] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042911822715, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:21:51.824076] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726042911824074, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:21:51.873397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:51.873436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:51.873465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:51.873474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:51.988507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:52.073716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:52.073757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:52.073765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:52.073774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:52.193131] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4433, replace_start_pos=300000, replace_num=100000) [2024-09-11 16:21:52.193180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:52.229489] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:52.274028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:52.274071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:52.274078] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:52.274087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:52.393334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:52.402042] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:52.474316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:52.474361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:52.474368] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:52.474377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:52.593541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:52.674630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:52.674676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:52.674701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:52.674711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:52.683184] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8460, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:21:52.793679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:52.830259] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042912830254, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:21:52.831693] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042912831690, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:21:52.883444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:52.883487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:52.883494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:52.883503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:52.993866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:53.018499] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:53.018547] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:21:53.018629] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=193, max_check_version=194, global_version=195) [2024-09-11 16:21:53.020591] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1961 [2024-09-11 16:21:53.020638] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:53.020670] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:21:53.020702] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:21:53.020776] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:21:53.020859] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:21:53.020920] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:21:53.020930] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:21:53.020939] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:21:53.020970] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:21:53.021022] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:21:53.021040] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:21:53.083873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:53.083935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:53.083945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:53.083955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:53.194068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:53.230920] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:53.284248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:53.284292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:53.284300] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:53.284309] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:53.394296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:53.402169] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:53.484611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:53.484655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:53.484663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:53.484672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:53.594484] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:53.684995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:53.685039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:53.685046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:53.685072] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:53.794623] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:53.837946] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042913837942, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:21:53.839310] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042913839309, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:21:53.885368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:53.885414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:53.885422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:53.885431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:53.994854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:54.085669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:54.085714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:54.085722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:54.085731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:54.195068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:54.232089] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:54.286050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:54.286094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:54.286101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:54.286111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:54.399612] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=400000, replace_num=100000) [2024-09-11 16:21:54.399659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:54.402283] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:54.486424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:54.486470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:54.486478] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:54.486487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:54.599819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:54.686786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:54.686842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:54.686858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:54.686868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:54.695408] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8527, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:21:54.800018] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:54.845553] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042914845549, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:21:54.846925] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726042914846924, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:21:54.895665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:54.895715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:54.895724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:54.895732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:55.000146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:55.095996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:55.096039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:55.096047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:55.096056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:55.200358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:55.233590] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:55.296280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:55.296326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:55.296333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:55.296343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:55.400537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:55.402423] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:55.496565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:55.496605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:55.496612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:55.496622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:55.600656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:55.696859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:55.696923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:55.696932] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:55.696941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:55.800802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:55.853177] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042915853173, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:21:55.854603] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042915854601, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:21:55.897236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:55.897281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:55.897289] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:55.897298] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:56.000998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:56.097596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:56.097641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:56.097649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:56.097659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:56.201178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:56.234897] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:56.297971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:56.298017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:56.298025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:56.298034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:56.401370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:56.402546] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:56.498345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:56.498392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:56.498400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:56.498409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:56.605913] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4354, replace_start_pos=500000, replace_num=100000) [2024-09-11 16:21:56.605962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:56.698666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:56.698718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:56.698726] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:56.698735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:56.707214] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8465, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:21:56.806054] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:56.860788] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042916860784, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:21:56.862178] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042916862176, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 16:21:56.907486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:56.907529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:56.907537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:56.907546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:57.006280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:57.107782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:57.107827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:57.107851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:57.107861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:57.206407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:57.236295] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:57.308105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:57.308170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:57.308177] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:57.308186] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:57.402678] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:57.406532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:57.508416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:57.508459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:57.508467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:57.508475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:57.606718] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:57.708811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:57.708855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:57.708862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:57.708873] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:57.806921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:21:57.868351] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042917868347, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:21:57.869766] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042917869764, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007588, add_bytes: 0 [2024-09-11 16:21:57.909229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:57.909311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:57.909320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:57.909329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:58.007108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:21:58.109641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:58.109685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:58.109693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:58.109702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:58.207302] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:21:58.237758] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:58.310036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:58.310076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:58.310084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:58.310093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:58.402795] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:58.407424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:21:58.510393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:58.510438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:58.510446] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:58.510456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:58.607585] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:21:58.710759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:58.710806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:58.710836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:58.710846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:58.718598] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7739, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:21:58.812123] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4356, replace_start_pos=600000, replace_num=100000) [2024-09-11 16:21:58.812173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:21:58.875951] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042918875948, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:21:58.877378] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042918877377, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:21:58.918866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:58.918940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:58.918950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:58.918959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:59.012321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:21:59.119208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:59.119245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:59.119253] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:59.119262] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:59.212512] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:21:59.239061] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:21:59.319527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:59.319568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:59.319575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:59.319584] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:59.402915] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:21:59.412730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:21:59.519891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:59.519956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:59.519965] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:59.519975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:59.612929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:21:59.720284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:59.720337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:59.720352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:59.720362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:21:59.813124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:21:59.883645] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042919883641, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:21:59.885006] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=10] PNIO [ratelimit] time: 1726042919885004, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:21:59.920599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:21:59.920645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:21:59.920652] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:21:59.920662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:00.013249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:00.120899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:00.120952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:00.120958] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:00.120966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:00.213435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:00.240546] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:00.321210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:00.321254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:00.321262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:00.321271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:00.403121] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:00.413622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:00.521571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:00.521615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:00.521622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:00.521630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:00.613805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:00.721981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:00.722023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:00.722030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:00.722039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:00.729230] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7157, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:22:00.813985] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:00.880738] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=63] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:22:00.886674] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:22:00.891188] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042920891186, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:22:00.891218] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:22:00.892679] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042920892677, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:22:00.892702] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:22:00.929482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:00.929518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:00.929526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:00.929535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:00.929719] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:22:01.018492] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4381, replace_start_pos=700000, replace_num=100000) [2024-09-11 16:22:01.018540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:01.129953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:01.129995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:01.130017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:01.130024] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:01.218689] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:01.241952] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:01.330318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:01.330382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:01.330391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:01.330401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:01.403267] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:01.418821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:01.530634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:01.530680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:01.530688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:01.530697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:01.618971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:01.731024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:01.731070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:01.731078] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:01.731087] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:01.819093] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:01.898819] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726042921898816, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:22:01.900234] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042921900232, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:22:01.931315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:01.931377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:01.931384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:01.931391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:02.019212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:02.131617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:02.131654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:02.131661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:02.131670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:02.219329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:02.243214] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:02.331884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:02.331949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:02.331956] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:02.331963] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:02.403380] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:02.419450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:02.532257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:02.532300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:02.532307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:02.532315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:02.619583] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:02.732558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:02.732622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:02.732631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:02.732640] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:02.740759] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8099, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:22:02.819708] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:02.906439] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042922906435, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:22:02.907849] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042922907848, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:22:02.941079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:02.941125] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:02.941133] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:02.941143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:03.019824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:03.035231] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:03.035286] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:03.035371] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=194, max_check_version=195, global_version=196) [2024-09-11 16:22:03.037281] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1910 [2024-09-11 16:22:03.037333] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:03.037365] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:22:03.037403] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:22:03.037478] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:03.037561] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 12 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:22:03.037612] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:22:03.037622] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:22:03.037631] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:22:03.037662] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:22:03.037716] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:22:03.037732] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:22:03.141448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:03.141492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:03.141501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:03.141512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:03.223282] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3348, replace_start_pos=800000, replace_num=100000) [2024-09-11 16:22:03.223329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:03.244725] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:03.341746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:03.341784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:03.341791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:03.341800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:03.403521] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:03.423406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:03.542064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:03.542104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:03.542111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:03.542121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:03.623524] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:03.742373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:03.742421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:03.742447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:03.742456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:03.823645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:03.914108] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042923914104, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:22:03.915464] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726042923915461, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:22:03.942696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:03.942740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:03.942747] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:03.942757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:04.023757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:04.143009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:04.143053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:04.143061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:04.143070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:04.223879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:04.245963] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:04.343375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:04.343420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:04.343428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:04.343437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:04.403638] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:04.424007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:04.543715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:04.543765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:04.543776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:04.543790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:04.624133] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:04.744084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:04.744140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:04.744153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:04.744163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:04.750773] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6598, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:22:04.824246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:04.921728] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042924921724, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:22:04.923086] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042924923085, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:22:04.951095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:04.951141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:04.951150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:04.951159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:05.024450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=90] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:05.151451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:05.151490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:05.151498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:05.151508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:05.224649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:05.247260] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:05.351803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:05.351846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:05.351854] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:05.351864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:05.403769] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:05.429172] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4339, replace_start_pos=900000, replace_num=100000) [2024-09-11 16:22:05.429223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:05.552173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:05.552217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:05.552226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:05.552235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:05.629370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:05.752538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:05.752584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:05.752592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:05.752602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:05.829603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:05.929331] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042925929326, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:22:05.930700] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042925930699, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:22:05.952867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:05.952939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:05.952950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:05.952959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:06.029824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:06.153287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:06.153334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:06.153342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:06.153352] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:06.230019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:06.248466] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:06.353650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:06.353693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:06.353702] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:06.353711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:06.403915] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:06.430211] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:06.553968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:06.554007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:06.554014] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:06.554036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:06.630396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:06.754334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:06.754378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:06.754387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:06.754397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:06.762893] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8471, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:22:06.830596] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:06.936949] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042926936945, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:22:06.938318] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042926938315, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:22:06.963173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:06.963216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:06.963224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:06.963232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:07.030725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:07.163478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:07.163523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:07.163548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:07.163557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:07.230941] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:07.249539] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:07.363788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:07.363849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:07.363857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:07.363866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:07.404109] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:07.431063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:07.564104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:07.564148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:07.564156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:07.564165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:07.635600] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4354, replace_start_pos=1000000, replace_num=100000) [2024-09-11 16:22:07.635652] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:07.764419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:07.764464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:07.764472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:07.764482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:07.835747] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:07.944516] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042927944511, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:22:07.945998] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042927945996, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:22:07.964721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:07.964762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:07.964770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:07.964779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:08.035936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:08.165036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:08.165084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:08.165092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:08.165102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:08.236153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:08.250928] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:08.365316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:08.365352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:08.365358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:08.365365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:08.404223] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:08.436345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:08.565601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:08.565647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:08.565656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:08.565665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:08.636523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:08.765875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:08.765934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:08.765942] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:08.765950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:08.774253] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8292, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:22:08.836668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:08.952109] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726042928952106, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 16:22:08.953548] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042928953546, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:22:08.974595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:08.974641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:08.974649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:08.974659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:09.036796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:09.174927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:09.174974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:09.174981] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:09.174991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:09.237006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:09.252071] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:09.375232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:09.375273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:09.375291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:09.375301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:09.404351] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:09.437198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:09.575561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:09.575603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:09.575611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:09.575620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:09.637414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:09.775849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:09.775945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=94][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:09.775958] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:09.775967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:09.841538] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4001, replace_start_pos=1100000, replace_num=100000) [2024-09-11 16:22:09.841581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:09.959732] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042929959728, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:22:09.961159] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042929961158, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:22:09.976228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:09.976267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:09.976293] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:09.976303] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:10.041734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:10.176542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:10.176599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:10.176611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:10.176623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:10.176841] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash time detail, (compute_wash_size_time=99, refresh_score_time=66, wash_time=0) [2024-09-11 16:22:10.241931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:10.252945] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:10.377137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:10.377180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:10.377188] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:10.377198] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:10.404467] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:10.442122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:10.577526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:10.577570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:10.577579] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:10.577589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:10.642250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:10.777813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:10.777852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:10.777871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:10.777879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:10.784491] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6599, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:22:10.842443] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:10.967409] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042930967405, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:22:10.968782] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726042930968781, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:22:10.984767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:10.984812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:10.984820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:10.984829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:11.042579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:11.185058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:11.185102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:11.185109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:11.185117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:11.242730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:11.253868] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:11.385386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:11.385431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:11.385439] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:11.385448] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:11.404676] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:11.442942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:11.585685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:11.585731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:11.585739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:11.585748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:11.643125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:11.785992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:11.786034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:11.786040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:11.786048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:11.843310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:11.975034] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042931975029, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:22:11.976405] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042931976403, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:22:11.986259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:11.986297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:11.986304] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:11.986311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:12.047756] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4323, replace_start_pos=1200000, replace_num=100000) [2024-09-11 16:22:12.047826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:12.186519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:12.186563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:12.186569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:12.186576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:12.248001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:12.254815] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:12.386807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:12.386849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:12.386857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:12.386866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:12.404806] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:12.448120] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:12.587181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:12.587222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:12.587229] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:12.587239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:12.648241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:12.787559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:12.787608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:12.787615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:12.787623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:12.795688] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8028, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:22:12.848362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:12.982578] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042932982574, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:22:12.984011] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042932984010, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:22:12.996005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:12.996047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:12.996055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:12.996064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:13.048481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:13.053745] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:13.053790] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=44] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:13.053877] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=195, max_check_version=196, global_version=197) [2024-09-11 16:22:13.055915] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2039 [2024-09-11 16:22:13.055949] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:13.056007] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:22:13.056045] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:22:13.056146] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:13.056256] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 12 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:22:13.056314] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:22:13.056325] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:22:13.056336] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:22:13.056373] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:22:13.056433] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:22:13.056457] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:22:13.196295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:13.196341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:13.196349] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:13.196358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:13.248674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:13.256197] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:13.396605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:13.396645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:13.396652] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:13.396661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:13.404916] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:13.448866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:13.596995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:13.597046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:13.597054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:13.597063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:13.649084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:13.797303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:13.797347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:13.797353] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:13.797361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:13.849217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:13.990287] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042933990282, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007708, add_bytes: 0 [2024-09-11 16:22:13.991693] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726042933991691, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:22:13.997579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:13.997613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:13.997621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:13.997630] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:14.049360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:14.197845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:14.197895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:14.197921] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:14.197929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:14.253872] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=1300000, replace_num=100000) [2024-09-11 16:22:14.253927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:14.257434] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:14.398141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:14.398189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:14.398195] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:14.398203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:14.405027] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:14.454161] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:14.598433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:14.598479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:14.598487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:14.598521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:14.654299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:14.798762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:14.798817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:14.798831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:14.798839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:14.805720] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6868, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:22:14.854490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:14.997824] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042934997821, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:22:14.999303] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042934999302, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:22:15.006082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:15.006115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:15.006123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:15.006131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:15.054666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:15.206406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:15.206446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:15.206466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:15.206474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:15.254853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:15.258367] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:15.405157] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:15.406693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:15.406723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:15.406729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:15.406737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:15.455055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:15.607067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:15.607109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:15.607117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:15.607126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:15.655186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:15.807357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:15.807403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:15.807411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:15.807420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:15.855312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:16.005544] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042936005540, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007719, add_bytes: 0 [2024-09-11 16:22:16.006921] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042936006919, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:22:16.007657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:16.007709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:16.007717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:16.007726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:16.055432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:16.207978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:16.208019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:16.208026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:16.208034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:16.255556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:16.259356] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:16.405314] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=87] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:16.408267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:16.408300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:16.408307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:16.408315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:16.460051] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4373, replace_start_pos=1400000, replace_num=100000) [2024-09-11 16:22:16.460095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:16.608609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:16.608653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:16.608660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:16.608670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:16.660237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:16.808888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:16.808977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=88][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:16.808984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:16.808994] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:16.816776] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7770, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:22:16.860447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:17.013104] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042937013100, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:22:17.014467] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042937014465, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:22:17.017034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:17.017058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:17.017065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:17.017073] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:17.060561] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:17.217362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:17.217401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:17.217409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:17.217419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:17.260275] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:17.260676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:17.405519] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:17.417653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:17.417688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:17.417696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:17.417718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:17.460761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=13] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:17.617961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:17.618006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:17.618013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:17.618023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:17.660879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:17.818254] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:17.818294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:17.818302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:17.818311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:17.861084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:18.018529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:18.018569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:18.018577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:18.018586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:18.020653] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042938020652, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:22:18.022155] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726042938022152, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:22:18.061299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:18.218816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:18.218860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:18.218866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:18.218873] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:18.261414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:18.261557] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:18.405633] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:18.419143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:18.419173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:18.419180] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:18.419189] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:18.461532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:18.619417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:18.619456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:18.619464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:18.619473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:18.665957] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4316, replace_start_pos=1500000, replace_num=100000) [2024-09-11 16:22:18.666005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:18.819719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:18.819764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:18.819772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:18.819802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:18.827632] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7816, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:22:18.866085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:19.027988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:19.028033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:19.028041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:19.028050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:19.028268] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042939028265, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:22:19.029776] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042939029773, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:22:19.066205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:19.228380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:19.228424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:19.228432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:19.228442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:19.262810] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:19.266308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:19.405768] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:19.428781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:19.428823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:19.428831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:19.428840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:19.466411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:19.629135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:19.629170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:19.629176] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:19.629184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:19.666561] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:19.829478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:19.829530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:19.829544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:19.829552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:19.866684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:20.029890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:20.029944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:20.029950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:20.029958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:20.035959] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726042940035956, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:22:20.037333] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042940037331, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:22:20.066857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:20.230285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:20.230348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:20.230357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:20.230367] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:20.263733] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:20.267003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:20.405881] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:20.430606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:20.430649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:20.430657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:20.430666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:20.467131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:20.630929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:20.630976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:20.630984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:20.630994] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:20.667301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:20.831231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:20.831275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:20.831283] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:20.831292] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:20.839940] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8635, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:22:20.871089] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3664, replace_start_pos=1600000, replace_num=100000) [2024-09-11 16:22:20.871270] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=178] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:21.040218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:21.040260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:21.040267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:21.040276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:21.043575] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042941043573, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:22:21.044949] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042941044948, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:22:21.071364] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:21.240581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:21.240626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:21.240633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:21.240643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:21.264990] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:21.271495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:21.406046] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=96] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:21.440876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:21.440921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:21.440929] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:21.440938] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:21.471611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:21.641242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:21.641283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:21.641289] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:21.641317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:21.671800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:21.841640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:21.841684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:21.841692] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:21.841702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:21.871993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:22.041977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:22.042023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:22.042031] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:22.042040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:22.051126] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726042942051122, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:22:22.052551] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042942052550, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:22:22.072198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:22.242282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:22.242324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:22.242331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:22.242361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:22.266135] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:22.272399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:22.406162] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:22.442666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:22.442736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:22.442745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:22.442754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:22.472515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:22.643075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:22.643121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:22.643130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:22.643139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:22.672632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:22.843372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:22.843417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:22.843423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:22.843430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:22.851218] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7773, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:22:22.872753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:23.051483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:23.051531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:23.051539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:23.051570] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:23.058753] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042943058750, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:22:23.060237] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726042943060234, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:22:23.071862] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:23.071947] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=83] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:23.072033] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=196, max_check_version=197, global_version=198) [2024-09-11 16:22:23.074015] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1981 [2024-09-11 16:22:23.074047] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:23.074078] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:22:23.074111] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:22:23.074203] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:23.074286] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 12 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:22:23.074332] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:22:23.074342] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:22:23.074355] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:22:23.074386] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:22:23.074434] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:22:23.074457] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:22:23.076192] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3316, replace_start_pos=1700000, replace_num=100000) [2024-09-11 16:22:23.076219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:23.251828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:23.251866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:23.251873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:23.251882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:23.267385] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:23.276304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:23.406302] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:23.452208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:23.452255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:23.452280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:23.452289] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:23.476487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:23.652513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:23.652556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:23.652562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:23.652570] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:23.676680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:23.852796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:23.852836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:23.852843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:23.852853] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:23.876872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:24.053159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:24.053206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:24.053214] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:24.053224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:24.066372] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042944066369, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:22:24.067801] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042944067798, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:22:24.077078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:24.253457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:24.253501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:24.253507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:24.253514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:24.268776] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:24.277295] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:24.406419] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:24.453750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:24.453795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:24.453802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:24.453811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:24.477479] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:24.654154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:24.654200] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:24.654208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:24.654218] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:24.677604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:24.854468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:24.854519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:24.854532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:24.854744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=208] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:24.863264] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8502, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:22:24.877722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:25.063526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:25.063572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:25.063580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:25.063589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:25.074042] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042945074039, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:22:25.075402] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042945075401, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:22:25.077900] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:25.263819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:25.263866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:25.263874] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:25.263884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:25.270000] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:25.282062] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4021, replace_start_pos=1800000, replace_num=100000) [2024-09-11 16:22:25.282101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:25.406612] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:25.464157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:25.464198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:25.464206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:25.464216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:25.482315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:25.664460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:25.664504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:25.664511] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:25.664520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:25.682437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:25.864767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:25.864813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:25.864820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:25.864830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:25.882570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:26.065043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:26.065087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:26.065094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:26.065102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:26.081674] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042946081669, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:22:26.082764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:26.083019] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042946083017, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:22:26.265414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:26.265459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:26.265467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:26.265491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:26.271415] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:26.282951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:26.406759] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:26.465730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:26.465777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:26.465784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:26.465794] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:26.483064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:26.666094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:26.666141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:26.666149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:26.666158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:26.683164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:26.866462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:26.866510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:26.866518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:26.866528] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:26.873426] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6880, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:22:26.883279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:27.073772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:27.073818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:27.073826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:27.073835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:27.083492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:27.089198] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042947089194, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007525, add_bytes: 0 [2024-09-11 16:22:27.090698] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042947090695, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:22:27.272411] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:27.274077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:27.274107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:27.274114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:27.274123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:27.283607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:27.406897] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:27.474426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:27.474471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:27.474479] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:27.474489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:27.487083] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3369, replace_start_pos=1900000, replace_num=100000) [2024-09-11 16:22:27.487132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:27.674775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:27.674835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:27.674843] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:27.674852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:27.687212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:27.875167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:27.875207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:27.875215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:27.875225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:27.887334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:28.075524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:28.075573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:28.075581] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:28.075591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:28.087448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:28.096931] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042948096926, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007732, add_bytes: 0 [2024-09-11 16:22:28.098264] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042948098262, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:22:28.273475] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:28.275897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:28.275949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:28.275957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:28.275966] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:28.287571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:28.407044] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:28.476259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:28.476303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:28.476311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:28.476321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:28.487685] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:28.676649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:28.676697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:28.676705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:28.676714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:28.687800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:28.876970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:28.877013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:28.877021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:28.877030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:28.884359] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7316, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:22:28.887910] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:29.084635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:29.084697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:29.084705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:29.084714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:29.088009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:29.104523] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042949104519, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:22:29.105932] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726042949105931, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:22:29.274437] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:29.285052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:29.285097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:29.285104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:29.285113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:29.288126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:29.407251] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:29.485354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:29.485411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:29.485423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:29.485434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:29.488295] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:29.685661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:29.685707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:29.685721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:29.685734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:29.692825] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4347, replace_start_pos=2000000, replace_num=100000) [2024-09-11 16:22:29.692889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:29.886001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:29.886055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:29.886069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:29.886079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:29.892986] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:30.086296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:30.086340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:30.086347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:30.086354] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:30.093112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:30.112057] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042950112053, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 16:22:30.113484] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726042950113482, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:22:30.275454] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:30.286646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:30.286688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:30.286696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:30.286705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:30.293248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:30.407431] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:30.486967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:30.487013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:30.487021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:30.487046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:30.487262] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=95, refresh_score_time=64, wash_time=0) [2024-09-11 16:22:30.493353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:30.687480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:30.687523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:30.687529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:30.687537] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:30.693526] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:30.887831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:30.887874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:30.887882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:30.887892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:30.893627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:30.895752] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7831, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:22:31.093738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:31.096012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:31.096045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:31.096065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:31.096073] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:31.096222] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:22:31.119668] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042951119665, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:22:31.121162] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042951121159, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:22:31.276278] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:31.293857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:31.296458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:31.296491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:31.296498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:31.296506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:31.407580] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:31.493982] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:31.496735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:31.496764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:31.496770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:31.496779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:31.694099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:31.697043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:31.697080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:31.697087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:31.697096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:31.897373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:31.897416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:31.897427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:31.897440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:31.897534] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3318, replace_start_pos=2100000, replace_num=100000) [2024-09-11 16:22:31.897568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:32.097648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:32.097681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:32.097710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:32.097717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:32.097727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:32.127357] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042952127353, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:22:32.128783] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042952128780, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:22:32.277345] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:32.297761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:32.298041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:32.298074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:32.298082] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:32.298091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:32.407706] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:32.497879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:32.498384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:32.498418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:32.498444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:32.498455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:32.698001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:32.698771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:32.698804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:32.698812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:32.698821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:32.898140] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:32.899067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:32.899101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:32.899108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:32.899117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:32.908706] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=9558, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:22:33.088972] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:33.089022] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:33.089104] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=197, max_check_version=198, global_version=199) [2024-09-11 16:22:33.091155] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2050 [2024-09-11 16:22:33.091195] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:33.091230] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:22:33.091268] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:22:33.091359] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:33.091466] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:22:33.091511] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:22:33.091520] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:22:33.091529] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:22:33.091560] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:22:33.091626] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:22:33.091653] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:22:33.098266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:33.108963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:33.109002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:33.109009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:33.109016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:33.134969] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042953134964, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:22:33.136345] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042953136344, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:22:33.278400] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:33.298373] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:33.309250] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:33.309287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:33.309295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:33.309304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:33.407946] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:33.498489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:33.509605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:33.509646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:33.509653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:33.509681] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:33.698649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=89] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:33.709939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:33.709988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:33.709999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:33.710013] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:33.898767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:33.910246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:33.910285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:33.910292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:33.910301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:34.103201] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4299, replace_start_pos=2200000, replace_num=100000) [2024-09-11 16:22:34.103280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=77] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:34.110554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:34.110599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:34.110607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:34.110616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:34.142531] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042954142526, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:22:34.143947] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042954143944, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:22:34.279388] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:34.303380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:34.310871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:34.310942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:34.310951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:34.310960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:34.408076] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:34.503504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:34.511271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:34.511308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:34.511316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:34.511327] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:34.703628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:34.711571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:34.711608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:34.711616] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:34.711625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:34.903752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:34.911945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:34.911988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:34.911996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:34.912019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:34.918954] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6922, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:22:35.103889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:35.119215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:35.119259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:35.119267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:35.119275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:35.150184] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042955150181, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007655, add_bytes: 0 [2024-09-11 16:22:35.151654] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042955151651, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007707, add_bytes: 0 [2024-09-11 16:22:35.280176] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:35.305214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:35.319536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:35.319575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:35.319582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:35.319591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:35.408203] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:35.505333] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:35.519882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:35.519941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:35.519949] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:35.519958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:35.705452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:35.720224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:35.720270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:35.720278] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:35.720287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:35.905630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:35.920518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:35.920562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:35.920570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:35.920579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:36.105816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:36.120896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:36.120965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:36.120972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:36.120982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:36.157763] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042956157759, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007578, add_bytes: 0 [2024-09-11 16:22:36.159188] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042956159185, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 16:22:36.281011] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:36.310437] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4400, replace_start_pos=2300000, replace_num=100000) [2024-09-11 16:22:36.310486] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:36.321235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:36.321282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:36.321291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:36.321301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:36.408343] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:36.510579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:36.521618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:36.521664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:36.521672] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:36.521682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:36.710775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:36.721960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:36.722015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:36.722024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:36.722033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:36.910962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:36.922278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:36.922322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:36.922329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:36.922338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:36.930855] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8503, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:22:37.111208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:37.131162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:37.131218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:37.131229] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:37.131241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:37.165376] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042957165373, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:22:37.166853] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726042957166851, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:22:37.281895] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:37.311406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:37.331454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:37.331490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:37.331497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:37.331505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:37.408530] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:37.511532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:37.531726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:37.531768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:37.531775] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:37.531783] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:37.711736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:37.732017] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:37.732069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:37.732076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:37.732100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:37.911858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:37.932407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:37.932454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:37.932462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:37.932472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:38.112055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:38.132711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:38.132757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:38.132765] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:38.132774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:38.172995] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042958172991, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:22:38.174407] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042958174405, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:22:38.283297] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:38.312177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:38.333043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:38.333082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:38.333089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:38.333099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:38.408729] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:38.516746] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4393, replace_start_pos=2400000, replace_num=100000) [2024-09-11 16:22:38.516794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:38.533401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:38.533449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:38.533456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:38.533465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:38.716897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:38.733722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:38.733771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:38.733778] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:38.733787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:38.917052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:38.934045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:38.934091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:38.934100] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:38.934110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:38.940963] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6841, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:22:39.117165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:39.141247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:39.141310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:39.141318] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:39.141327] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:39.180659] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042959180656, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:22:39.182030] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726042959182028, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:22:39.284487] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:39.317338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:39.341554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:39.341593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:39.341599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:39.341607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:39.408868] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:39.517556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:39.541847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:39.541881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:39.541887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:39.541895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:39.717762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:39.742147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:39.742186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:39.742191] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:39.742199] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:39.917944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:39.942455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:39.942501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:39.942509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:39.942518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:40.121484] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=3395] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:40.142780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:40.142828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:40.142835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:40.142844] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:40.188277] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726042960188272, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:22:40.189660] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042960189658, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:22:40.285826] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:40.321599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:40.343099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:40.343137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:40.343146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:40.343154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:40.408999] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:40.521789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:40.543406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:40.543450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:40.543457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:40.543466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:40.725986] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3992, replace_start_pos=2500000, replace_num=100000) [2024-09-11 16:22:40.726027] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:40.743712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:40.743755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:40.743762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:40.743769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:40.926183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:40.944039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:40.944082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:40.944089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:40.944099] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:40.951921] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7808, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:22:41.126315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:41.152181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:41.152226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:41.152234] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:41.152243] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:41.195891] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042961195887, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:22:41.197249] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042961197248, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 16:22:41.287022] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:41.326437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:41.352517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:41.352581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:41.352590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:41.352599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:41.409215] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:41.526540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:41.552883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:41.552946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:41.552955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:41.552964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:41.726664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:41.753190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:41.753229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:41.753237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:41.753246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:41.926794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:41.953514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:41.953558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:41.953564] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:41.953587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:42.126931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:42.153839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:42.153883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:42.153890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:42.153899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:42.203465] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042962203460, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007573, add_bytes: 0 [2024-09-11 16:22:42.204943] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726042962204940, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:22:42.288321] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:42.327131] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:42.354145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:42.354191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:42.354199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:42.354207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:42.409400] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:42.527259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:42.554439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:42.554488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:42.554497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:42.554506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:42.727379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:42.754817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:42.754881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:42.754890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:42.754899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:42.930815] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3332, replace_start_pos=2600000, replace_num=100000) [2024-09-11 16:22:42.930852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:42.955151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:42.955195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:42.955202] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:42.955211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:42.963752] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8527, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:22:43.106819] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:43.106863] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:43.106943] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] update_check_range(min_check_version=198, max_check_version=199, global_version=200) [2024-09-11 16:22:43.108658] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1715 [2024-09-11 16:22:43.108714] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:43.108746] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:22:43.108780] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:22:43.108856] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:43.108962] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:22:43.109017] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:22:43.109026] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:22:43.109035] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:22:43.109067] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:22:43.109115] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:22:43.109133] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:22:43.130999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:43.164044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:43.164092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:43.164099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:43.164108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:43.211130] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042963211125, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:22:43.212492] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042963212490, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:22:43.289642] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:43.331122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:43.364340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:43.364400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:43.364408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:43.364418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:43.409523] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:43.531245] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:43.564639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:43.564683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:43.564689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:43.564698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:43.731374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:43.764961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:43.765007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:43.765030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:43.765039] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:43.931490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:43.965268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:43.965314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:43.965321] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:43.965330] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:44.131633] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:44.165635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:44.165683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:44.165691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:44.165702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:44.218676] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042964218672, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:22:44.220177] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042964220173, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:22:44.290943] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:44.331832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:44.366028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:44.366081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:44.366094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:44.366104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:44.409689] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:44.531976] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:44.566333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:44.566378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:44.566386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:44.566395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:44.732144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:44.766631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:44.766683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:44.766690] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:44.766699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:44.932263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:44.966943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:44.967000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:44.967006] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:44.967014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:44.974522] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7495, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:22:45.135825] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3349, replace_start_pos=2700000, replace_num=100000) [2024-09-11 16:22:45.135869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:45.174832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:45.174873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:45.174881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:45.174889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:45.226286] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726042965226281, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:22:45.227795] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042965227792, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:22:45.292107] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:45.336051] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:45.375153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:45.375193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:45.375201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:45.375210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:45.409883] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:45.536178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:45.575473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:45.575524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:45.575532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:45.575541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:45.736425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:45.775774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:45.775819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:45.775826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:45.775836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:45.936559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:45.976092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:45.976140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:45.976147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:45.976157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:46.136686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:46.176404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:46.176450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:46.176457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:46.176467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:46.233977] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042966233972, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:22:46.235404] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042966235402, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:22:46.293297] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:46.336874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:46.376698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:46.376737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:46.376745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:46.376754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:46.410042] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=90] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:46.537033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:46.576997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:46.577033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:46.577041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:46.577064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:46.737166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:46.777302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:46.777356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:46.777363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:46.777371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:46.937291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:46.977644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:46.977688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:46.977696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:46.977705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:46.985479] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7759, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:22:47.137493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:47.185769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:47.185815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:47.185822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:47.185831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:47.241599] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726042967241595, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:22:47.242958] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042967242956, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:22:47.294533] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:47.340944] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3331, replace_start_pos=2800000, replace_num=100000) [2024-09-11 16:22:47.340988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:47.386161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:47.386207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:47.386215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:47.386224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:47.410151] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:47.541118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:47.586467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:47.586512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:47.586520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:47.586529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:47.741358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:47.786757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:47.786803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:47.786809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:47.786816] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:47.941490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:47.987130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:47.987192] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:47.987200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:47.987209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:48.141607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:48.187516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:48.187561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:48.187569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:48.187579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:48.249134] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042968249130, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007535, add_bytes: 0 [2024-09-11 16:22:48.250639] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042968250636, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:22:48.295837] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:48.341745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:48.387881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:48.387946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:48.387955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:48.387965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:48.410292] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:48.541862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:48.588371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:48.588420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:48.588428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:48.588438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:48.742079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:48.788738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:48.788780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:48.788787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:48.788795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:48.942235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:48.989095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:48.989139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:48.989147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:48.989157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:48.996985] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7814, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:22:49.142368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:49.197313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:49.197361] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:49.197369] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:49.197378] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:49.256752] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042969256749, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:22:49.258261] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042969258258, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:22:49.297062] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=102] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:49.342500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:49.397604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:49.397649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:49.397655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:49.397664] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:49.410431] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:49.547117] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4420, replace_start_pos=2900000, replace_num=100000) [2024-09-11 16:22:49.547230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=112] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:49.597942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:49.597987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:49.597994] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:49.598003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:49.747319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:49.798231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:49.798279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:49.798288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:49.798315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:49.947456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:49.998540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:49.998596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:49.998604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:49.998613] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:50.147577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:50.198874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:50.198938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:50.198946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:50.198955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:50.264368] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042970264364, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:22:50.265871] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726042970265868, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:22:50.298354] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:50.347822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:50.399189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:50.399234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:50.399241] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:50.399251] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:50.410550] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:50.547944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:50.599555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:50.599597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:50.599604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:50.599612] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:50.748137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:50.799836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:50.799877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:50.799884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:50.799931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:50.800147] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Wash time detail, (compute_wash_size_time=113, refresh_score_time=65, wash_time=0) [2024-09-11 16:22:50.948251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:51.000358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:51.000396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:51.000405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:51.000414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:51.008278] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7851, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:22:51.148447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:51.208609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:51.208654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:51.208662] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:51.208671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:51.271996] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042971271991, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:22:51.273490] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726042971273487, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:22:51.299198] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:51.348576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:51.409003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:51.409044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:51.409052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:51.409061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:51.410760] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:51.548701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:51.609383] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:51.609430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:51.609438] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:51.609447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:51.752845] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4001, replace_start_pos=3000000, replace_num=100000) [2024-09-11 16:22:51.752888] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:51.809699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:51.809743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:51.809751] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:51.809759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:51.953034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:52.010031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:52.010079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:52.010087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:52.010096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:52.153163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:52.210338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:52.210380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:52.210387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:52.210396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:52.279674] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042972279669, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:22:52.281051] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042972281049, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:22:52.300167] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:52.353301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:52.410617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:52.410679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:52.410685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:52.410694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:52.410885] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:52.553418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:52.611043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:52.611086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:52.611093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:52.611102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:52.753548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:52.811333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:52.811381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:52.811387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:52.811394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:52.953736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:53.011661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:53.011702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:53.011710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:53.011719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:53.020337] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8604, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:22:53.123677] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:53.123726] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:22:53.123806] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=199, max_check_version=200, global_version=201) [2024-09-11 16:22:53.125882] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2075 [2024-09-11 16:22:53.125945] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:53.125982] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:22:53.126035] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:22:53.126125] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:22:53.126232] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:22:53.126287] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:22:53.126304] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:22:53.126315] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:22:53.126352] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:22:53.126412] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:22:53.126435] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:22:53.153926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:53.220594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:53.220641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:53.220665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:53.220675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:53.287317] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042973287313, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 16:22:53.288650] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042973288648, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:22:53.301197] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:53.354046] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:53.411031] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=11] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:53.420946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:53.420990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:53.420998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:53.421007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:53.554155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:53.621245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:53.621287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:53.621295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:53.621304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:53.754276] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:53.821534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:53.821576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:53.821583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:53.821590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:53.958701] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4299, replace_start_pos=3100000, replace_num=100000) [2024-09-11 16:22:53.958770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:54.021815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:54.021857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:54.021862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:54.021870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:54.158938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:54.222103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:54.222151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:54.222159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:54.222168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:54.294925] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042974294920, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:22:54.296279] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042974296278, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:22:54.302157] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:54.359064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:54.411220] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:54.422404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:54.422447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:54.422454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:54.422463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:54.559252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:54.622694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:54.622739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:54.622745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:54.622770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:54.759451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:54.823015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:54.823063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:54.823070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:54.823078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:54.959641] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:55.023374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:55.023417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:55.023426] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:55.023436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:55.031995] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8544, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:22:55.159766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:55.232438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:55.232489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:55.232497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:55.232506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:55.302448] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042975302444, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007524, add_bytes: 0 [2024-09-11 16:22:55.303096] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:55.303875] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726042975303874, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:22:55.359886] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:55.411419] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:55.432764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:55.432807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:55.432814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:55.432821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:55.560043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:55.633050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:55.633095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:55.633101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:55.633109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:55.760241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:55.833342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:55.833386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:55.833393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:55.833403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:55.960361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:56.033740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:56.033784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:56.033792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:56.033818] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:56.163882] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3380, replace_start_pos=3200000, replace_num=100000) [2024-09-11 16:22:56.163937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:56.234086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:56.234133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:56.234141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:56.234150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:56.304021] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:56.310065] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042976310062, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:22:56.311568] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042976311566, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:22:56.364021] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:56.411594] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=91] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:56.434456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:56.434504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:56.434512] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:56.434522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:56.564214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:56.634773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:56.634820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:56.634828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:56.634837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:56.764325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:56.835082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:56.835126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:56.835132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:56.835140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:56.964460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:57.035419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:57.035463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:57.035471] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:57.035480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:57.043735] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8241, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:22:57.164595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:57.244110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:57.244153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:57.244161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:57.244170] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:57.305054] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:57.317684] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042977317680, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:22:57.319181] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726042977319178, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:22:57.364776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:57.411793] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:57.444490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:57.444532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:57.444539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:57.444561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:57.564850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:57.644875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:57.644938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:57.644948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:57.644958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:57.764986] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:22:57.845275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:57.845320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:57.845328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:57.845338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:57.965112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:22:58.045576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:58.045621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:58.045629] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:58.045638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:58.165231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:22:58.245878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:58.245938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:58.245947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:58.245956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:58.306225] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:58.325315] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042978325312, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:22:58.326724] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042978326722, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:22:58.369507] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4137, replace_start_pos=3300000, replace_num=100000) [2024-09-11 16:22:58.369548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:22:58.411922] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:58.446252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:58.446296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:58.446304] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:58.446313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:58.569630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:22:58.646544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:58.646587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:58.646593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:58.646601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:58.769749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:22:58.846834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:58.846873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:58.846879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:58.846921] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:58.969865] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:22:59.047171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:59.047215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:59.047223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:59.047232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:59.055855] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8608, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:22:59.169996] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:22:59.256165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:59.256210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:59.256218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:59.256228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:59.307180] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:22:59.332927] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042979332923, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:22:59.334339] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726042979334337, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:22:59.370112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:22:59.412049] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:22:59.456476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:59.456521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:59.456529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:59.456539] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:59.570279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:22:59.656774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:59.656818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:59.656825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:59.656834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:59.770485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:22:59.857140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:22:59.857186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:22:59.857193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:22:59.857203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:22:59.970606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:00.057426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:00.057480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:00.057489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:00.057499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:00.170731] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:00.257751] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:00.257815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:00.257844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:00.257873] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:00.308068] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:00.330027] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:23:00.336021] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:23:00.340561] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042980340558, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:23:00.340601] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:23:00.342036] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042980342034, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007697, add_bytes: 0 [2024-09-11 16:23:00.342070] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:23:00.370852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:00.412155] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:00.458185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:00.458229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:00.458236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:00.458245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:00.575421] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4390, replace_start_pos=3400000, replace_num=100000) [2024-09-11 16:23:00.575472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:00.658549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:00.658592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:00.658600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:00.658609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:00.775555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:00.858854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:00.858935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:00.858944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:00.858954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:00.975652] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:01.059347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:01.059394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:01.059403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:01.059413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:01.066778] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7350, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:23:01.175776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:01.267041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:01.267084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:01.267090] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:01.267097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:01.267251] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:23:01.308913] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:01.348155] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=8] PNIO [ratelimit] time: 1726042981348151, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007593, add_bytes: 0 [2024-09-11 16:23:01.349611] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726042981349608, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 16:23:01.375894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:01.412310] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:01.467488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:01.467531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:01.467537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:01.467561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:01.576037] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:01.667807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:01.667856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:01.667866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:01.667876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:01.776172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:01.868124] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:01.868169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:01.868176] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:01.868185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:01.976288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:02.068482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:02.068529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:02.068537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:02.068545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:02.176428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:02.268887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:02.268962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:02.268971] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:02.268980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:02.309872] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:02.355777] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726042982355771, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:23:02.357260] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726042982357257, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007649, add_bytes: 0 [2024-09-11 16:23:02.376562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:02.412432] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:02.469206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:02.469251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:02.469258] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:02.469267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:02.576697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:02.669498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:02.669542] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:02.669550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:02.669559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:02.780171] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3339, replace_start_pos=3500000, replace_num=100000) [2024-09-11 16:23:02.780218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:02.869792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:02.869832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:02.869839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:02.869861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:02.980376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:03.070073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:03.070115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:03.070122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:03.070129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:03.077553] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7411, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:23:03.139330] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:03.139393] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=61] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:03.139468] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=200, max_check_version=201, global_version=202) [2024-09-11 16:23:03.141226] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1756 [2024-09-11 16:23:03.141276] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:03.141339] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:23:03.141374] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:23:03.141452] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:03.141536] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:23:03.141880] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=304] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:23:03.141897] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:23:03.141924] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:23:03.141962] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:23:03.142015] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:23:03.142037] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:23:03.180619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:03.277827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:03.277875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:03.277883] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:03.277892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:03.310938] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=93] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:03.363400] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042983363396, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:23:03.364878] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726042983364876, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:23:03.380759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:03.412562] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:03.478150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:03.478185] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:03.478192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:03.478201] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:03.580864] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:03.678430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:03.678478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:03.678485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:03.678493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:03.780983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:03.878703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:03.878748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:03.878755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:03.878763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:03.981128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:04.079048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:04.079096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:04.079102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:04.079110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:04.181333] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:04.279346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:04.279389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:04.279396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:04.279405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:04.312004] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:04.371005] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726042984371002, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:23:04.372490] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726042984372487, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:23:04.381535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:04.412666] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:04.479655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:04.479702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:04.479711] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:04.479720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:04.581655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:04.679994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:04.680043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:04.680050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:04.680079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:04.781796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:04.880327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:04.880371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:04.880379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:04.880388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:04.986274] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4344, replace_start_pos=3600000, replace_num=100000) [2024-09-11 16:23:04.986324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:05.080730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:05.080772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:05.080779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:05.080786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:05.087336] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6537, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:23:05.186472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:05.287598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:05.287652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:05.287668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:05.287697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:05.313157] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:05.378681] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042985378677, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:23:05.380033] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042985380032, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:23:05.386595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:05.412859] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:05.488008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:05.488053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:05.488059] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:05.488067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:05.586711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:05.688298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:05.688342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:05.688350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:05.688359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:05.786825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:05.888599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:05.888645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:05.888653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:05.888662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:05.986959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:06.089033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:06.089094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:06.089102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:06.089111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:06.187095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:06.289344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:06.289391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:06.289398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:06.289407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:06.313915] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:06.386244] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726042986386240, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:23:06.387232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:06.387728] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726042986387727, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 16:23:06.413100] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=104] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:06.489629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:06.489672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:06.489678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:06.489685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:06.587352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:06.689917] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:06.689962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:06.689968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:06.689976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:06.787488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:06.890193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:06.890238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:06.890244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:06.890251] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:06.987650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:07.090548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:07.090593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:07.090602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:07.090611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:07.097990] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7366, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:23:07.192230] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4387, replace_start_pos=3700000, replace_num=100000) [2024-09-11 16:23:07.192281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:07.298282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:07.298331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:07.298339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:07.298348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:07.314739] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:07.392430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:07.393861] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042987393858, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:23:07.395266] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042987395263, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007536, add_bytes: 0 [2024-09-11 16:23:07.413296] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:07.498575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:07.498637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:07.498645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:07.498654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:07.592563] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:07.698880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:07.698942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:07.698951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:07.698960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:07.792686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:07.899193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:07.899239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:07.899248] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:07.899258] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:07.992825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:08.099489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:08.099532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:08.099539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:08.099548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:08.192947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:08.299799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:08.299845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:08.299853] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:08.299862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:08.315718] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:08.393077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:08.401536] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042988401533, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:23:08.402891] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042988402889, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:23:08.413410] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:08.500094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:08.500134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:08.500141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:08.500150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:08.593212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:08.700377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:08.700424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:08.700431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:08.700440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:08.793337] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:08.900678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:08.900725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:08.900752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:08.900762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:08.993468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:09.101035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:09.101079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:09.101085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:09.101093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:09.107703] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6599, clean_start_pos=0, clean_num=200000) [2024-09-11 16:23:09.193658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:09.307973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:09.308020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:09.308028] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:09.308037] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:09.316745] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:09.398137] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=3800000, replace_num=100000) [2024-09-11 16:23:09.398182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:09.409091] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042989409087, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:23:09.410573] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726042989410570, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:23:09.413527] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:09.508258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:09.508303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:09.508311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:09.508320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:09.598274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:09.708564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:09.708608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:09.708616] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:09.708625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:09.798393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:09.908851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:09.908892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:09.908922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:09.908933] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:09.998511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:10.109160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:10.109205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:10.109213] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:10.109221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:10.198643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:10.309515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:10.311143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=1625][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:10.311160] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:10.311171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:10.317748] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:10.398780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:10.413702] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=29] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:10.416785] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042990416781, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007694, add_bytes: 0 [2024-09-11 16:23:10.418135] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726042990418134, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:23:10.511417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:10.511461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:10.511468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:10.511478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:10.598946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:10.711772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:10.711821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:10.711829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:10.711838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:10.799075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:10.912111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:10.912156] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:10.912163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:10.912173] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:10.999195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:11.112399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:11.112446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:11.112454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:11.112463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:11.112689] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=79, refresh_score_time=62, wash_time=0) [2024-09-11 16:23:11.120785] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8080, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:23:11.199428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:11.318887] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:11.321096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:11.321130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:11.321138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:11.321147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:11.399559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:11.413850] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:11.424321] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042991424318, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:23:11.425827] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726042991425825, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:23:11.521400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:11.521444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:11.521453] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:11.521461] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:11.603506] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3764, replace_start_pos=3900000, replace_num=100000) [2024-09-11 16:23:11.603554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:11.721687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:11.721732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:11.721739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:11.721748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:11.803672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:11.922076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:11.922121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:11.922130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:11.922139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:12.003868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:12.122365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:12.122414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:12.122421] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:12.122430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:12.204028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:12.319793] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:12.322735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:12.322773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:12.322781] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:12.322791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:12.404163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:12.413964] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:12.431931] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726042992431928, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:23:12.433357] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726042992433355, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 16:23:12.523039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:12.523084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:12.523091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:12.523101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:12.604402] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:12.723329] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:12.723376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:12.723383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:12.723392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:12.804542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:12.923637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:12.923679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:12.923687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:12.923696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:13.004671] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:13.123981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:13.124045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:13.124053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:13.124062] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:13.131253] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7177, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:23:13.154755] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:13.154810] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:13.154889] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=201, max_check_version=202, global_version=203) [2024-09-11 16:23:13.156895] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2006 [2024-09-11 16:23:13.156961] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:13.156998] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:23:13.157055] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:23:13.157139] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:13.157247] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:23:13.157300] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:23:13.157316] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:23:13.157327] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:23:13.157364] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:23:13.157424] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:23:13.157448] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:23:13.204847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:13.320643] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:13.331502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:13.331532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:13.331539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:13.331549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:13.404983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:13.414094] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:13.439619] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1726042993439614, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:23:13.440985] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042993440982, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:23:13.531773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:13.531818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:13.531825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:13.531834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:13.605106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:13.732057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:13.732116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:13.732124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:13.732133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:13.809582] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4340, replace_start_pos=4000000, replace_num=100000) [2024-09-11 16:23:13.809628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:13.932376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:13.932427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:13.932438] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:13.932453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:14.009725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:14.132713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:14.132769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:14.132777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:14.132786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:14.209927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:14.321459] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:14.333051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:14.333095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:14.333103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:14.333112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:14.410055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:14.414197] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:14.447221] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042994447217, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:23:14.448599] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042994448597, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:23:14.533347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:14.533392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:14.533400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:14.533409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:14.610289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:14.733624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:14.733671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:14.733678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:14.733687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:14.810410] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:14.933943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:14.933984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:14.933992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:14.934001] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:15.010572] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:15.134233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:15.134277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:15.134286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:15.134295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:15.141421] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7112, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:23:15.210707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:15.322283] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:15.341671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:15.341708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:15.341715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:15.341724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:15.410897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:15.414315] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:15.454786] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042995454783, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:23:15.456220] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726042995456217, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:23:15.541967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:15.542008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:15.542015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:15.542041] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:15.611073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:15.742259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:15.742296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:15.742304] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:15.742313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:15.811193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:15.942609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:15.942649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:15.942656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:15.942665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:16.015182] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3866, replace_start_pos=4100000, replace_num=100000) [2024-09-11 16:23:16.015221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:16.142937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:16.142967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:16.142973] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:16.142980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:16.215368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:16.323171] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:16.343248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:16.343292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:16.343299] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:16.343329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:16.414435] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:16.415496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:16.462411] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042996462407, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:23:16.463834] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726042996463832, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:23:16.543632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:16.543677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:16.543686] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:16.543695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:16.615701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:16.744042] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:16.744087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:16.744095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:16.744104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:16.815832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:16.944336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:16.944379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:16.944387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:16.944417] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:17.015954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:17.144642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:17.144679] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:17.144685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:17.144694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:17.151964] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7256, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:23:17.216081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:17.324013] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:17.352243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:17.352289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:17.352296] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:17.352306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:17.414560] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:17.416199] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:17.470021] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726042997470017, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:23:17.471457] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726042997471454, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:23:17.552608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:17.552652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:17.552661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:17.552671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:17.616311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:17.752947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:17.752990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:17.752998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:17.753007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:17.816471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:17.953251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:17.953294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:17.953302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:17.953311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:18.016559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:18.153544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:18.153592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:18.153606] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:18.153620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:18.221052] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4293, replace_start_pos=4200000, replace_num=100000) [2024-09-11 16:23:18.221096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:18.325145] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:18.353855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:18.353896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:18.353923] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:18.353932] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:18.414769] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:18.421177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:18.477630] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726042998477626, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:23:18.479047] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726042998479046, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:23:18.554161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:18.554203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:18.554209] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:18.554218] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:18.621280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:18.754447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:18.754486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:18.754492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:18.754500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:18.821380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:18.954753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:18.954802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:18.954810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:18.954819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:19.021498] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:19.155151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:19.155198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:19.155206] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:19.155216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:19.163004] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7773, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:23:19.221692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:19.326249] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:19.363268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:19.363316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:19.363324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:19.363333] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:19.414994] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:19.421883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:19.485301] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726042999485297, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:23:19.486666] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726042999486665, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:23:19.563584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:19.563630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:19.563638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:19.563647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:19.622085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:19.763980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:19.764027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:19.764035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:19.764065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:19.822220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:19.964294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:19.964337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:19.964343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:19.964351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:20.022354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:20.164564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:20.164604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:20.164610] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:20.164617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:20.222469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:20.327248] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:20.364870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:20.364945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:20.364961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:20.364971] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:20.415181] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:20.426893] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4302, replace_start_pos=4300000, replace_num=100000) [2024-09-11 16:23:20.426942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:20.492854] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043000492850, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:23:20.494276] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726043000494275, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:23:20.565220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:20.565264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:20.565272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:20.565281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:20.627026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:20.765517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:20.765562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:20.765569] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:20.765579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:20.827149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:20.965829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:20.965872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:20.965879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:20.965889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:21.027264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:21.166152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:21.166197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:21.166226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:21.166235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:21.174796] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8546, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:23:21.227369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:21.328144] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:21.375145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:21.375189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:21.375197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:21.375206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:21.415391] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:21.427487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:21.500471] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043001500466, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:23:21.501890] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043001501889, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:23:21.575429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:21.575467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:21.575475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:21.575483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:21.627606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:21.775777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:21.775819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:21.775827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:21.775836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:21.827727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:21.976087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:21.976127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:21.976135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:21.976144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:22.027872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:22.176397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:22.176443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:22.176449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:22.176456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:22.228015] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:22.329167] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:22.376778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:22.376822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:22.376829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:22.376838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:22.415526] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:22.428136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:22.508091] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043002508088, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:23:22.509515] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043002509513, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:23:22.577071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:22.577117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:22.577124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:22.577133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:22.632596] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4338, replace_start_pos=4400000, replace_num=100000) [2024-09-11 16:23:22.632645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:22.777392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:22.777436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:22.777443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:22.777453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:22.832730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:22.977777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:22.977823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:22.977831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:22.977841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:23.032846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:23.170115] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:23.170165] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:23.170247] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=202, max_check_version=203, global_version=204) [2024-09-11 16:23:23.172285] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2036 [2024-09-11 16:23:23.172350] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:23.172386] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:23:23.172424] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:23:23.172509] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:23.172617] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,701,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,701,344 used= 76,287,284 count= 1,552 avg_used= 49,154 mod=SUMMARY [2024-09-11 16:23:23.172676] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:23:23.172688] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:23:23.172699] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:23:23.172735] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:23:23.172801] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:23:23.172820] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:23:23.178157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:23.178202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:23.178210] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:23.178220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:23.186475] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8242, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:23:23.232966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:23.330074] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:23.386791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:23.386834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:23.386842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:23.386852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:23.415676] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:23.433094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:23.515707] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043003515703, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:23:23.517198] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043003517196, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:23:23.587065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:23.587109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:23.587117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:23.587126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:23.633215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:23.787366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:23.787409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:23.787415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:23.787422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:23.833337] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:23.987732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:23.987778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:23.987786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:23.987796] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:24.033454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:24.188056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:24.188100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:24.188108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:24.188117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:24.233575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:24.330884] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:24.388353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:24.388386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:24.388393] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:24.388402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:24.415798] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:24.433696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:24.523389] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043004523385, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:23:24.524815] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043004524812, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:23:24.588631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:24.588666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:24.588673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:24.588682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:24.633819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:24.788916] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:24.788951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:24.788958] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:24.788967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:24.838399] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4459, replace_start_pos=4500000, replace_num=100000) [2024-09-11 16:23:24.838451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:24.989263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:24.989308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:24.989316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:24.989325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:25.038606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:25.189578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:25.189621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:25.189628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:25.189638] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:25.197983] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8333, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:23:25.238720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:25.331892] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:25.398323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:25.398372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:25.398387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:25.398397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:25.416039] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=84] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:25.438839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:25.531004] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043005531000, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:23:25.532424] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043005532421, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:23:25.598724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:25.598766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:25.598774] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:25.598783] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:25.638954] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:25.799082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:25.799139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:25.799147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:25.799157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:25.839068] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:25.999406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:25.999453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:25.999461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:25.999471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:26.039180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:26.199775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:26.199823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:26.199831] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:26.199841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:26.239297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:26.332953] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=109] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:26.400068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:26.400110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:26.400118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:26.400128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:26.416183] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:26.439418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:26.538563] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043006538560, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:23:26.539977] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043006539976, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:23:26.600423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:26.600466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:26.600472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:26.600480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:26.639553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:26.800805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:26.800850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:26.800857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:26.800868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:26.839680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:27.001068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:27.001112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:27.001120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:27.001129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:27.043122] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3326, replace_start_pos=4600000, replace_num=100000) [2024-09-11 16:23:27.043171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:27.201433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:27.201501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:27.201510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:27.201519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:27.210083] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8550, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:23:27.243330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:27.333969] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:27.410411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:27.410457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:27.410465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:27.410475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:27.416312] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:27.443535] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:27.546229] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043007546226, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:23:27.547586] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043007547584, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:23:27.610775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:27.610820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:27.610826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:27.610834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:27.643669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:27.811062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:27.811098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:27.811105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:27.811114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:27.843789] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:28.011369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:28.011408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:28.011415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:28.011425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:28.043991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:28.211724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:28.211771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:28.211779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:28.211788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:28.244105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:28.335194] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:28.412034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:28.412068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:28.412075] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:28.412084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:28.416426] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:28.444221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:28.553848] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043008553845, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:23:28.555324] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043008555323, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007739, add_bytes: 0 [2024-09-11 16:23:28.612384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:28.612428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:28.612436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:28.612468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:28.644335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:28.812704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:28.812749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:28.812756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:28.812766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:28.844450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:29.013083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:29.013126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:29.013134] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:29.013144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:29.044567] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:29.213377] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:29.213421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:29.213428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:29.213439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:29.220540] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7088, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:23:29.248578] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3895, replace_start_pos=4700000, replace_num=100000) [2024-09-11 16:23:29.248629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:29.336112] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:29.416531] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:29.420877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:29.420929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:29.420939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:29.420948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:29.448712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:29.561480] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043009561476, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:23:29.562892] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043009562891, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 16:23:29.621251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:29.621296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:29.621304] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:29.621313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:29.648836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:29.821672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:29.821713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:29.821721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:29.821730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:29.848962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:30.021979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:30.022048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:30.022056] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:30.022065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:30.049070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:30.222362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:30.222404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:30.222412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:30.222422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:30.249173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:30.337027] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:30.416679] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:30.422747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:30.422790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:30.422798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:30.422808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:30.449290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:30.569098] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043010569094, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:23:30.570440] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726043010570437, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:23:30.623058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:30.623101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:30.623109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:30.623119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:30.649440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:30.823420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:30.823465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:30.823473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:30.823482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:30.849581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:31.023718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:31.023762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:31.023770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:31.023779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:31.049767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:31.224095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:31.224142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:31.224150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:31.224161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:31.232176] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8002, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:23:31.249956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:31.338103] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:31.416858] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=91] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:31.432573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:31.432619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:31.432627] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:31.432637] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:31.432873] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash time detail, (compute_wash_size_time=100, refresh_score_time=67, wash_time=0) [2024-09-11 16:23:31.433082] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:23:31.454502] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4360, replace_start_pos=4800000, replace_num=100000) [2024-09-11 16:23:31.454552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:31.576706] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043011576701, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:23:31.578129] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043011578126, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:23:31.633311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:31.633356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:31.633363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:31.633372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:31.654632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:31.833713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:31.833762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:31.833770] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:31.833780] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:31.854794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:32.034082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:32.034145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:32.034154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:32.034163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:32.054982] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:32.234459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:32.234504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:32.234512] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:32.234522] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:32.255173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:32.339004] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:32.416995] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:32.434756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:32.434795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:32.434803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:32.434813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:32.455358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:32.584241] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043012584237, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007536, add_bytes: 0 [2024-09-11 16:23:32.585752] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043012585749, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:23:32.635111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:32.635159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:32.635169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:32.635178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:32.655540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:32.835474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:32.835521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:32.835533] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:32.835543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:32.855754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:33.035843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:33.035884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:33.035892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:33.035925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:33.055874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:33.186753] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:33.186802] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=47] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:33.186879] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=203, max_check_version=204, global_version=205) [2024-09-11 16:23:33.188678] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1797 [2024-09-11 16:23:33.188732] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:33.188765] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:23:33.188798] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:23:33.188876] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:33.188977] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,232 used= 76,302,780 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:23:33.189030] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:23:33.189040] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:23:33.189049] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:23:33.189081] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:23:33.189132] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:23:33.189151] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:23:33.236165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:33.236208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:33.236216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:33.236224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:33.244364] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8126, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:23:33.256098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:33.340083] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:33.417127] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:33.444693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:33.444734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:33.444742] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:33.444752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:33.456286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:33.591856] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043013591852, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:23:33.593288] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043013593285, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007536, add_bytes: 0 [2024-09-11 16:23:33.645070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:33.645116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:33.645124] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:33.645134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:33.660772] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4363, replace_start_pos=4900000, replace_num=100000) [2024-09-11 16:23:33.660820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:33.845367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:33.845412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:33.845419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:33.845428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:33.860921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:34.045728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:34.045775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:34.045783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:34.045793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:34.061038] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:34.246056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:34.246098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:34.246105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:34.246114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:34.261227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:34.341227] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:34.417235] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:34.446415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:34.446456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:34.446464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:34.446474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:34.461446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:34.599473] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726043014599469, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:23:34.600980] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043014600977, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:23:34.646710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:34.646765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:34.646774] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:34.646784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:34.661665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:34.847039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:34.847084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:34.847092] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:34.847101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:34.861797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:35.047393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:35.047433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:35.047441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:35.047450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:35.061978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:35.247765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:35.247833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:35.247842] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:35.247852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:35.256601] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8736, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:23:35.262175] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:35.342231] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:35.417364] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:35.456960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:35.457009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:35.457033] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:35.457043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:35.462290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:35.607109] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043015607104, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:23:35.608581] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043015608579, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:23:35.657293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:35.657338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:35.657346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:35.657354] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:35.662457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:35.857659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:35.857700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:35.857708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:35.857717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:35.867211] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4650, replace_start_pos=5000000, replace_num=100000) [2024-09-11 16:23:35.867267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:36.058070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:36.058110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:36.058118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:36.058127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:36.067377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:36.258426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:36.258472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:36.258480] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:36.258489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:36.267525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:36.343395] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:36.417520] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:36.458789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:36.458829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:36.458838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:36.458847] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:36.467714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:36.614704] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043016614700, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:23:36.616251] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043016616248, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:23:36.659157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:36.659217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:36.659226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:36.659237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:36.667846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:36.859470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:36.859516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:36.859524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:36.859532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:36.867974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:37.059763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:37.059809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:37.059817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:37.059827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:37.068100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:37.260059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:37.260105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:37.260113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:37.260122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:37.268213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:37.268678] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8520, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:23:37.344386] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:37.417648] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:37.468340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:37.468940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:37.468978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:37.468989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:37.469002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:37.622339] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043017622335, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:23:37.623762] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043017623760, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007512, add_bytes: 0 [2024-09-11 16:23:37.668475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:37.669354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:37.669388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:37.669396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:37.669405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:37.868659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:37.869656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:37.869687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:37.869695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:37.869704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:38.069962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:38.070024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:38.070031] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:38.070040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:38.072324] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3541, replace_start_pos=5100000, replace_num=100000) [2024-09-11 16:23:38.072361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:38.270287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:38.270326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:38.270333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:38.270343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:38.272581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:38.345389] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:38.417786] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:38.470592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:38.470633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:38.470640] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:38.470649] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:38.472758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:38.629970] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043018629965, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:23:38.631370] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043018631369, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:23:38.670882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:38.670943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:38.670950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:38.670958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:38.672870] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:38.871301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:38.871347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:38.871354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:38.871364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:38.873072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:39.071672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:39.071718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:39.071726] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:39.071735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:39.073170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:39.272064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:39.272111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:39.272119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:39.272129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:39.273267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:39.279121] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6977, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:23:39.346325] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:39.417924] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:39.473379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:39.479456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:39.479496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:39.479522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:39.479532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:39.637553] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043019637549, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007584, add_bytes: 0 [2024-09-11 16:23:39.638996] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726043019638993, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:23:39.673497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:39.679831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:39.679865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:39.679874] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:39.679883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:39.873633] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:39.880059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:39.880082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:39.880089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:39.880098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:40.073827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:40.080397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:40.080441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:40.080449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:40.080483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:40.278301] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4350, replace_start_pos=5200000, replace_num=100000) [2024-09-11 16:23:40.278349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:40.280802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:40.280826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:40.280833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:40.280840] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:40.418047] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:40.447109] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:40.478434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:40.481070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:40.481104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:40.481112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:40.481121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:40.645309] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043020645306, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007757, add_bytes: 0 [2024-09-11 16:23:40.646615] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043020646614, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:23:40.678568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:40.681423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:40.681451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:40.681459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:40.681469] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:40.878687] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:40.881697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:40.881734] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:40.881741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:40.881750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:41.078830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:41.081988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:41.082016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:41.082024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:41.082033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:41.279010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:41.282235] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:41.282259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:41.282266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:41.282274] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:41.288759] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6475, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:23:41.418195] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:41.448115] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=100] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:41.479135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:41.489009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:41.489036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:41.489043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:41.489052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:41.652949] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043021652895, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007589, add_bytes: 0 [2024-09-11 16:23:41.654225] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043021654224, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:23:41.679257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:41.689355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:41.689384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:41.689392] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:41.689401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:41.879365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:41.889623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:41.889661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:41.889669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:41.889678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:42.079483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:42.089897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:42.089937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:42.089944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:42.089954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:42.279601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:42.290265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:42.290303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:42.290309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:42.290318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:42.418363] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:42.449050] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:42.483358] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3560, replace_start_pos=5300000, replace_num=100000) [2024-09-11 16:23:42.483406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:42.490621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:42.490665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:42.490673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:42.490683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:42.660401] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726043022660396, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007501, add_bytes: 0 [2024-09-11 16:23:42.661841] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726043022661840, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:23:42.683488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:42.691010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:42.691049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:42.691056] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:42.691065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:42.883600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:42.891370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:42.891410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:42.891418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:42.891451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:43.083794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:43.091760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:43.091804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:43.091812] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:43.091821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:43.203506] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:43.203560] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:43.203643] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=204, max_check_version=205, global_version=206) [2024-09-11 16:23:43.205688] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2043 [2024-09-11 16:23:43.205725] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:43.205760] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:23:43.205817] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:23:43.205914] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:43.206023] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:23:43.206077] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:23:43.206091] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:23:43.206102] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:23:43.206143] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:23:43.206203] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:23:43.206226] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:23:43.284008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:43.292142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:43.292196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:43.292205] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:43.292214] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:43.300702] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8475, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:23:43.418556] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:43.450077] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:43.484202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:43.501067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:43.501110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:43.501119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:43.501129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:43.668089] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043023668085, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:23:43.669462] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726043023669460, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:23:43.684318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:43.701432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:43.701479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:43.701488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:43.701497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:43.884441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:43.901746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:43.901794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:43.901802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:43.901811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:44.084556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:44.102132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:44.102179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:44.102187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:44.102197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:44.284666] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:44.302444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:44.302486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:44.302493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:44.302502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:44.418676] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:44.450863] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:44.484800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:44.502811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:44.502856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:44.502864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:44.502874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:44.675633] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043024675629, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:23:44.677057] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043024677056, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:23:44.688735] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3800, replace_start_pos=5400000, replace_num=100000) [2024-09-11 16:23:44.688769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:44.703183] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:44.703249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:44.703259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:44.703268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:44.888847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:44.903610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:44.903673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:44.903681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:44.903691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:45.088976] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:45.103966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:45.104003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:45.104010] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:45.104020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:45.289094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:45.304255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:45.304295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:45.304303] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:45.304312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:45.312852] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8505, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:23:45.418816] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:45.451775] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:45.489281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:45.513203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:45.513286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=83][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:45.513295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:45.513304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:45.683321] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043025683315, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:23:45.684675] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726043025684672, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:23:45.689419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:45.713607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:45.713651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:45.713659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:45.713669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:45.889541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:45.913939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:45.913984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:45.913992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:45.914001] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:46.089661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:46.114319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:46.114381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:46.114389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:46.114399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:46.289778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:46.314708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:46.314753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:46.314761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:46.314770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:46.418959] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:46.452698] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:46.489892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:46.515046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:46.515093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:46.515102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:46.515111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:46.690025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:46.690878] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043026690875, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:23:46.692304] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043026692302, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:23:46.715332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:46.715366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:46.715375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:46.715386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:46.894720] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4471, replace_start_pos=5500000, replace_num=100000) [2024-09-11 16:23:46.894796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:46.915691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:46.915731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:46.915740] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:46.915750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:47.094894] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:47.115995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:47.116033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:47.116040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:47.116049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:47.295042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:47.316274] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:47.316319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:47.316326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:47.316335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:47.325018] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8670, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:23:47.419155] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:47.453618] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:47.495229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:47.525260] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:47.525305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:47.525313] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:47.525339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:47.695359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:47.698587] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043027698584, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007709, add_bytes: 0 [2024-09-11 16:23:47.699925] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043027699924, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:23:47.725538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:47.725582] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:47.725589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:47.725598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:47.895489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:47.925899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:47.925958] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:47.925964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:47.925972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:48.095617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:48.126201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:48.126242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:48.126250] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:48.126259] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:48.295739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:48.326566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:48.326609] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:48.326617] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:48.326626] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:48.419356] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:48.454674] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:48.495861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:48.526959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:48.527004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:48.527011] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:48.527020] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:48.696042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:48.706165] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043028706161, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007577, add_bytes: 0 [2024-09-11 16:23:48.707535] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043028707534, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:23:48.727248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:48.727294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:48.727302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:48.727311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:48.896184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:48.927549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:48.927590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:48.927614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:48.927623] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:49.099672] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3346, replace_start_pos=5600000, replace_num=100000) [2024-09-11 16:23:49.099721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:49.127939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:49.127984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:49.127991] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:49.128001] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:49.299828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:49.328291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:49.328335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:49.328343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:49.328352] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:49.336828] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8462, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:23:49.419501] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:49.455732] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:49.499973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:49.537179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:49.537225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:49.537232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:49.537241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:49.700165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:49.713734] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043029713729, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 16:23:49.715241] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043029715240, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007706, add_bytes: 0 [2024-09-11 16:23:49.737539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:49.737583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:49.737590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:49.737600] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:49.900337] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=77] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:49.937832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:49.937877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:49.937884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:49.937893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:50.100467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:50.138145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:50.138207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:50.138215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:50.138224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:50.300612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:50.338458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:50.338515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:50.338523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:50.338533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:50.419623] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:50.456492] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:50.500802] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:50.538764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:50.538829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:50.540476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=1645][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:50.540499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:50.700940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:50.721399] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043030721395, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:23:50.722861] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043030722859, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:23:50.740726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:50.740769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:50.740777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:50.740786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:50.901057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:50.941040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:50.941086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:50.941094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:50.941103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:51.101185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:51.141334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:51.141380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:51.141388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:51.141397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:51.305673] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4319, replace_start_pos=5700000, replace_num=100000) [2024-09-11 16:23:51.305725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:51.341636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:51.341680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:51.341687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:51.341696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:51.349773] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8063, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:23:51.419831] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:51.457256] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:51.505818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:51.550053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:51.550097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:51.550105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:51.550114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:51.705944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:51.728965] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043031728961, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:23:51.730390] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043031730388, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007529, add_bytes: 0 [2024-09-11 16:23:51.750409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:51.750469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:51.750477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:51.750486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:51.750703] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=94, refresh_score_time=61, wash_time=0) [2024-09-11 16:23:51.906066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:51.950957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:51.950997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:51.951003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:51.951010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:52.106190] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:52.151217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:52.151256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:52.151263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:52.151271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:52.306325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:52.351497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:52.351560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:52.351572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:52.351605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:52.420013] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:52.458100] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:52.506455] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:52.551932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:52.551999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:52.552007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:52.552016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:52.706598] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:52.736633] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043032736629, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:23:52.738060] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043032738058, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:23:52.752341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:52.752387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:52.752395] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:52.752405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:52.906713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:52.952721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:52.952758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:52.952766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:52.952775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:53.106839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:53.153079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:53.153148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:53.153157] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:53.153167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:53.219938] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:53.219985] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:23:53.220066] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=205, max_check_version=206, global_version=207) [2024-09-11 16:23:53.222083] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2016 [2024-09-11 16:23:53.222121] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:53.222156] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:23:53.222194] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:23:53.222299] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:23:53.222406] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,232 used= 76,302,780 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:23:53.222465] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:23:53.222477] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:23:53.222491] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:23:53.222528] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:23:53.222588] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:23:53.222609] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:23:53.307032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:53.353396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:53.353436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:53.353444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:53.353453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:53.361680] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8214, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:23:53.420149] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:53.458854] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:53.511600] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4426, replace_start_pos=5800000, replace_num=100000) [2024-09-11 16:23:53.511649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:53.562044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:53.562107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:53.562116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:53.562125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:53.711742] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:53.744196] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043033744192, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:23:53.745603] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043033745602, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:23:53.762365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:53.762396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:53.762403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:53.762412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:53.911932] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:53.962702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:53.962744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:53.962752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:53.962761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:54.112070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:54.163031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:54.163094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:54.163103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:54.163111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:54.312206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:54.363346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:54.363391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:54.363398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:54.363407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:54.420272] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:54.459758] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:54.512346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:54.563644] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:54.563687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:54.563694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:54.563703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:54.712482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:54.751844] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043034751839, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007647, add_bytes: 0 [2024-09-11 16:23:54.753315] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043034753312, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007710, add_bytes: 0 [2024-09-11 16:23:54.763969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:54.764014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:54.764021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:54.764031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:54.912615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:54.964323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:54.964366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:54.964374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:54.964384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:55.112758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:55.164681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:55.164726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:55.164734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:55.164744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:55.312892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:55.365003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:55.365040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:55.365048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:55.365056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:55.372869] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7800, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:23:55.420471] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:55.460509] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:55.513118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:55.573196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:55.573256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:55.573271] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:55.573281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:55.717475] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4216, replace_start_pos=5900000, replace_num=100000) [2024-09-11 16:23:55.717528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:55.759411] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043035759407, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 16:23:55.760940] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043035760937, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:23:55.773614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:55.773660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:55.773667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:55.773676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:55.917634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:55.973926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:55.973971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:55.973977] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:55.973985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:56.117770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:56.174239] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:56.174286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:56.174293] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:56.174302] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:56.317943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:56.374554] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:56.374598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:56.374605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:56.374614] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:56.420684] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:56.461329] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:56.518081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:56.574939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:56.574979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:56.574986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:56.574995] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:56.718213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:56.767038] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043036767034, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:23:56.768450] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726043036768448, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007511, add_bytes: 0 [2024-09-11 16:23:56.775363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:56.775400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:56.775407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:56.775416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:56.918350] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:56.975745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:56.975789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:56.975797] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:56.975830] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:57.118518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:57.176082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:57.176130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:57.176138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:57.176146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:57.318689] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:57.376457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:57.376514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:57.376525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:57.376538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:57.385126] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8570, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:23:57.420885] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:57.462304] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:57.518865] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:57.585466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:57.585512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:57.585520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:57.585529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:57.719057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:57.774657] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043037774653, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:23:57.776141] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043037776139, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:23:57.785772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:57.785817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:57.785824] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:57.785833] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:57.922827] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3635, replace_start_pos=6000000, replace_num=100000) [2024-09-11 16:23:57.922868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:23:57.986129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:57.986169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:57.986175] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:57.986183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:58.122958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:23:58.186482] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:58.186528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:58.186536] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:58.186547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:58.323128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:23:58.386801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:58.386855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:58.386862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:58.386872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:58.421030] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:58.463429] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:58.523237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:23:58.587104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:58.587150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:58.587158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:58.587168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:58.723354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:23:58.782325] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043038782321, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:23:58.783759] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726043038783757, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:23:58.787401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:58.787427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:58.787435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:58.787444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:58.923468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:23:58.987680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:58.987724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:58.987731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:58.987741] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:59.123582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:23:59.188059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:59.188107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:59.188116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:59.188126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:59.323730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:23:59.388430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:59.388501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:59.388513] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:59.388526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:59.395541] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7001, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:23:59.421171] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:23:59.464291] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:23:59.523849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:23:59.595873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:59.595933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:59.595943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:59.595954] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:59.723981] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:23:59.789888] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043039789884, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:23:59.791310] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043039791307, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:23:59.796160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:59.796184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:59.796190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:59.796208] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:23:59.924103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:23:59.996501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:23:59.996545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:23:59.996553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:23:59.996562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:00.127541] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3331, replace_start_pos=6100000, replace_num=100000) [2024-09-11 16:24:00.127587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:00.196855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:00.196899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:00.196936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:00.196945] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:00.327669] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:00.397178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:00.397217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:00.397230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:00.397239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:00.421295] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:00.465533] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:00.527795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:00.597496] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:00.597545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:00.597571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:00.597582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:00.727920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:00.787043] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:24:00.793054] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:24:00.797579] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1726043040797575, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:24:00.797613] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:24:00.797828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:00.797853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:00.797860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:00.797868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:00.798987] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043040798984, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:24:00.799020] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:24:00.928047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:00.998166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:00.998209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:00.998217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:00.998226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:01.128244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:01.198563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:01.198607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:01.198615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:01.198625] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:01.328370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:01.398870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:01.398938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:01.398948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:01.398957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:01.407276] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8306, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:24:01.421452] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:01.466306] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:01.528503] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:01.607591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:01.607639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:01.607647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:01.607656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:01.607851] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | [2024-09-11 16:24:01.728624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:01.805175] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726043041805171, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:24:01.806601] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726043041806599, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:24:01.808171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:01.808197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:01.808204] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:01.808213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:01.928754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:02.008513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:02.008559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:02.008568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:02.008577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:02.128896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:02.208822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:02.208871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:02.208878] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:02.208887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:02.332443] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3402, replace_start_pos=6200000, replace_num=100000) [2024-09-11 16:24:02.332489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:02.409138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:02.409193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:02.409199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:02.409207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:02.421570] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:02.467066] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:02.532570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:02.609457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:02.609497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:02.609504] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:02.609513] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:02.732713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:02.809749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:02.809794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:02.809801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:02.809810] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:02.812799] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043042812797, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:24:02.814167] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043042814166, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:24:02.932861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:03.010065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:03.010108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:03.010116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:03.010125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:03.133004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:03.210426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:03.210474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:03.210482] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:03.210491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:03.235361] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:03.235412] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:03.235493] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=206, max_check_version=207, global_version=208) [2024-09-11 16:24:03.237500] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2005 [2024-09-11 16:24:03.237540] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:03.237576] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:24:03.237631] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:24:03.237716] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:03.237828] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:24:03.237882] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:24:03.237897] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:24:03.237919] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:24:03.237957] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:24:03.238017] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:24:03.238039] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:24:03.333146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:03.410819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:03.410865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:03.410873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:03.410882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:03.418041] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7112, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:24:03.421706] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:03.467864] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:03.533257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:03.618314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:03.618359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:03.618366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:03.618375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:03.733390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:03.818626] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:03.818673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:03.818681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:03.818690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:03.820403] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043043820400, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:24:03.821774] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043043821773, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:24:03.933513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:04.018968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:04.019012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:04.019020] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:04.019029] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:04.133704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:04.219331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:04.219393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:04.219407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:04.219418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:04.333925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:04.419675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:04.419720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:04.419728] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:04.419737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:04.421894] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:04.468658] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:04.538466] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4360, replace_start_pos=6300000, replace_num=100000) [2024-09-11 16:24:04.538528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:04.620013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:04.620058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:04.620066] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:04.620075] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:04.738634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:04.820323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:04.820368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:04.820375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:04.820384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:04.828027] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043044828023, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:24:04.829390] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726043044829389, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:24:04.938774] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:05.020628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:05.020672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:05.020680] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:05.020689] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:05.138935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:05.221018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:05.221062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:05.221070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:05.221079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:05.339081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:05.421391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:05.421479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=87][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:05.421492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:05.421503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:05.422032] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:05.430075] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8558, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:24:05.469523] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:05.539215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:05.630428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:05.630486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:05.630503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:05.630527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:05.739336] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:05.830835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:05.830879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:05.830887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:05.830896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:05.835634] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726043045835630, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:24:05.837007] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726043045837006, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:24:05.939532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:06.031168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:06.031216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:06.031223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:06.031233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:06.139674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:06.231479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:06.231524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:06.231532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:06.231541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:06.339796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:06.422136] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:06.431879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:06.431937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:06.431946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:06.431955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:06.470367] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:06.539928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:06.632263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:06.632308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:06.632315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:06.632325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:06.743486] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3431, replace_start_pos=6400000, replace_num=100000) [2024-09-11 16:24:06.743540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:06.832638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:06.832698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:06.832710] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:06.832722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:06.843224] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043046843219, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007589, add_bytes: 0 [2024-09-11 16:24:06.844690] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726043046844687, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:24:06.943635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:07.032982] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:07.033041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:07.033049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:07.033058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:07.143829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:07.233295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:07.233332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:07.233340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:07.233349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:07.344007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:07.422263] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:07.433588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:07.433617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:07.433625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:07.433634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:07.440706] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7059, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:24:07.471152] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:07.544196] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:07.641045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:07.641092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:07.641101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:07.641110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:07.744390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:07.841346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:07.841384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:07.841391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:07.841400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:07.850867] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726043047850863, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2024-09-11 16:24:07.852295] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043047852293, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:24:07.944593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:08.041697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:08.041745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:08.041754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:08.041763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:08.144715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:08.242078] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:08.242123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:08.242131] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:08.242141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:08.344831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:08.422385] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:08.442401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:08.442439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:08.442447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:08.442456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:08.471938] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:08.544947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:08.642771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:08.642815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:08.642823] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:08.642834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:08.745064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:08.843138] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:08.843184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:08.843192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:08.843202] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:08.858427] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726043048858423, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:24:08.859858] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043048859855, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:24:08.949559] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4370, replace_start_pos=6500000, replace_num=100000) [2024-09-11 16:24:08.949609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:09.043502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:09.043546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:09.043555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:09.043564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:09.149697] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:09.243809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:09.243847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:09.243855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:09.243863] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:09.349815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:09.422585] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:09.444119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:09.444152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:09.444159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:09.444168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:09.452802] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8619, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:24:09.472710] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:09.549942] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:09.653077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:09.653117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:09.653123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:09.653131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:09.750061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:09.853378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:09.853422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:09.853430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:09.853456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:09.866042] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043049866039, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:24:09.867528] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043049867527, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:24:09.950180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:10.053699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:10.053738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:10.053746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:10.053755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:10.150309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:10.254031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:10.254076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:10.254083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:10.254092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:10.350431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:10.422702] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:10.454408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:10.454454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:10.454462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:10.454488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:10.473515] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:10.550567] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:10.654787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:10.654843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:10.654876] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:10.654887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:10.750695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:10.855176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:10.855223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:10.855232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:10.855242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:10.873666] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043050873662, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:24:10.875150] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043050875147, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:24:10.950819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:11.055483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:11.055530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:11.055537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:11.055546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:11.154247] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3315, replace_start_pos=6600000, replace_num=100000) [2024-09-11 16:24:11.154291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:11.255789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:11.255852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:11.255860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:11.255869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:11.354382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:11.422862] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=82] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:11.456099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:11.456141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:11.456149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:11.456158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:11.462938] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6767, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:24:11.474572] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:11.554509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:11.663266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:11.663304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:11.663312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:11.663322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:11.754629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:11.863556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:11.863602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:11.863610] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:11.863619] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:11.881283] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043051881278, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:24:11.882792] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043051882789, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007642, add_bytes: 0 [2024-09-11 16:24:11.954753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:12.063851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:12.063896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:12.063927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:12.063937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:12.064151] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=102, refresh_score_time=63, wash_time=0) [2024-09-11 16:24:12.154872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:12.264374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:12.264413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:12.264419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:12.264427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:12.355084] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:12.423099] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:12.464721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:12.464766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:12.464774] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:12.464784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:12.475661] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:12.555212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:12.665102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:12.665145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:12.665154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:12.665182] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:12.755393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:12.865437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:12.865475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:12.865483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:12.865492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:12.888896] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726043052888892, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:24:12.890381] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043052890379, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 16:24:12.955570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:13.065743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:13.065795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:13.065803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:13.065813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:13.155689] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:13.252714] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:13.252768] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:13.252855] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=207, max_check_version=208, global_version=209) [2024-09-11 16:24:13.254926] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2070 [2024-09-11 16:24:13.254964] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:13.255001] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:24:13.255039] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:24:13.255122] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:13.255243] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:24:13.255298] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:24:13.255309] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:24:13.255320] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:24:13.255356] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:24:13.255424] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:24:13.255441] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:24:13.266057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:13.266101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:13.266109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:13.266119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:13.359696] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3827, replace_start_pos=6700000, replace_num=100000) [2024-09-11 16:24:13.359735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:13.423241] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:13.466362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:13.466407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:13.466414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:13.466423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:13.473996] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7559, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:24:13.476636] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:13.559826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:13.674275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:13.674317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:13.674324] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:13.674349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:13.759950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:13.874608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:13.874651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:13.874659] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:13.874669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:13.896503] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726043053896500, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:24:13.897993] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043053897989, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:24:13.960135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:14.074945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:14.074992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:14.074999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:14.075008] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:14.160254] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:14.275257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:14.275302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:14.275308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:14.275315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:14.360434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:14.423353] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:14.475645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:14.475689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:14.475697] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:14.475706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:14.477643] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:14.560670] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:14.675970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:14.676012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:14.676019] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:14.676030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:14.760795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:14.876285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:14.876324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:14.876332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:14.876341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:14.904117] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043054904113, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:24:14.905559] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043054905556, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:24:14.960914] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:15.076569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:15.076614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:15.076637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:15.076646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:15.161107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:15.276890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:15.276960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:15.276968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:15.276977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:15.361246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:15.423551] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:15.477222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:15.477259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:15.477267] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:15.477276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:15.478633] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:15.485879] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8589, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:24:15.565687] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4338, replace_start_pos=6800000, replace_num=100000) [2024-09-11 16:24:15.565734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:15.686228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:15.686280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:15.686295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:15.686305] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:15.765830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:15.886598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:15.886645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:15.886653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:15.886662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:15.911744] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=626] PNIO [ratelimit] time: 1726043055911740, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:24:15.913222] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043055913220, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:24:15.965971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:16.086891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:16.086948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:16.086956] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:16.086965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:16.166089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:16.287285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:16.287332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:16.287340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:16.287351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:16.366217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:16.423765] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:16.479479] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:16.487650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:16.487686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:16.487695] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:16.487706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:16.566352] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:16.688052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:16.688097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:16.688105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:16.688114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:16.766471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:16.888344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:16.888387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:16.888394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:16.888404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:16.919363] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043056919359, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:24:16.920776] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043056920774, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:24:16.966596] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:17.088708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:17.088753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:17.088761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:17.088771] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:17.166723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:17.289074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:17.289119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:17.289127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:17.289137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:17.366868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:17.423925] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=78] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:17.480536] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:17.489438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:17.489483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:17.489492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:17.489502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:17.496932] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7415, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:24:17.567013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:17.697256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:17.697301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:17.697309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:17.697318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:17.771129] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3990, replace_start_pos=6900000, replace_num=100000) [2024-09-11 16:24:17.771175] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:17.897561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:17.897599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:17.897607] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:17.897629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:17.926967] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043057926962, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:24:17.928399] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043057928395, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:24:17.971323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:18.097959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:18.098002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:18.098009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:18.098019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:18.171506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:18.298264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:18.298304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:18.298312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:18.298321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:18.371738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:18.424071] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:18.481545] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:18.498622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:18.498666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:18.498674] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:18.498683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:18.571917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:18.698941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:18.698985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:18.699013] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:18.699023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:18.772106] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:18.899326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:18.899371] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:18.899379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:18.899388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:18.934577] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043058934573, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:24:18.936081] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043058936078, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:24:18.972316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:19.099685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:19.099728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:19.099737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:19.099747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:19.172497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:19.300062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:19.300104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:19.300132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:19.300142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:19.372691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:19.424281] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:19.482607] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:19.500435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:19.500478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:19.500486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:19.500495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:19.508094] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7585, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:24:19.572882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:19.708413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:19.708457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:19.708465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:19.708476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:19.773021] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:19.908722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:19.908767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:19.908775] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:19.908785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:19.942260] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043059942256, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:24:19.943634] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043059943632, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:24:19.976941] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3734, replace_start_pos=7000000, replace_num=100000) [2024-09-11 16:24:19.977009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:20.109095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:20.109142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:20.109150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:20.109159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:20.177093] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:20.309460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:20.309504] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:20.309512] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:20.309521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:20.377266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:20.424463] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:20.483898] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:20.509765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:20.509810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:20.509817] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:20.509827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:20.577393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:20.710130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:20.710187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:20.710207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:20.710217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:20.777506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:20.910556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:20.910602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:20.910610] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:20.910619] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:20.949870] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043060949866, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:24:20.951240] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043060951239, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:24:20.977710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:21.110944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:21.110989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:21.110997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:21.111006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:21.177896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:21.311306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:21.311351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:21.311359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:21.311369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:21.378045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:21.424678] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:21.484967] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:21.511699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:21.511747] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:21.511760] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:21.511792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:21.519927] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8119, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:24:21.578229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:21.720317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:21.720364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:21.720372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:21.720381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:21.778356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:21.920605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:21.920642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:21.920648] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:21.920655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:21.957427] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=72] PNIO [ratelimit] time: 1726043061957423, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:24:21.958923] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726043061958920, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:24:21.978488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:22.120891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:22.120948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:22.120970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:22.120979] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:22.182718] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4043, replace_start_pos=7100000, replace_num=100000) [2024-09-11 16:24:22.182765] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:22.321281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:22.321326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:22.321334] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:22.321344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:22.382862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:22.424806] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:22.485995] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:22.521640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:22.521685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:22.521693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:22.521702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:22.583007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:22.722028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:22.722073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:22.722081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:22.722090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:22.783144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:22.922336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:22.922381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:22.922405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:22.922414] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:22.965039] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043062965035, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:24:22.966537] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043062966535, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:24:22.983268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:23.122656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:23.122694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:23.122701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:23.122711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:23.183449] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:23.270628] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:23.270683] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:23.270762] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=208, max_check_version=209, global_version=210) [2024-09-11 16:24:23.272971] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2207 [2024-09-11 16:24:23.273016] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:23.273051] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:24:23.273089] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:24:23.273172] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:23.273279] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:24:23.273340] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:24:23.273352] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:24:23.273363] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:24:23.273399] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:24:23.273459] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:24:23.273481] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:24:23.322954] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:23.322986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:23.322992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:23.323000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:23.383637] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:23.425006] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:23.487133] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:23.523301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:23.523345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:23.523354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:23.523363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:23.531185] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7808, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:24:23.583820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:23.731525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:23.731568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:23.731576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:23.731586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:23.783963] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:23.931831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:23.931868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:23.931875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:23.931900] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:23.972666] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043063972662, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:24:23.974100] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043063974099, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:24:23.984151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:24.132160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:24.132202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:24.132208] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:24.132216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:24.184287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:24.332507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:24.332551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:24.332558] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:24.332565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:24.388077] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3662, replace_start_pos=7200000, replace_num=100000) [2024-09-11 16:24:24.388122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:24.425125] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:24.488061] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:24.532871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:24.532937] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:24.532947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:24.532956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:24.588206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:24.733261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:24.733307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:24.733315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:24.733324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:24.788347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:24.933627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:24.933670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:24.933678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:24.933688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:24.980351] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043064980346, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:24:24.981721] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726043064981720, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:24:24.988487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:25.134025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:25.134072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:25.134080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:25.134090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:25.188616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:25.334340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:25.334411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:25.334420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:25.334431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:25.388795] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:25.425258] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:25.488960] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:25.534730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:25.534771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:25.534779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:25.534788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:25.541912] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7108, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:24:25.588983] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:25.742173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:25.742223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:25.742239] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:25.742248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:25.789177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:25.942548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:25.942592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:25.942600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:25.942610] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:25.987932] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043065987928, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007582, add_bytes: 0 [2024-09-11 16:24:25.989375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:25.989470] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043065989468, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007748, add_bytes: 0 [2024-09-11 16:24:26.142929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:26.142978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:26.142986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:26.142996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:26.189547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:26.343311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:26.343358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:26.343367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:26.343377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:26.389761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:26.425466] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:26.490018] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:26.543698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:26.543742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:26.543750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:26.543760] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:26.594295] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4351, replace_start_pos=7300000, replace_num=100000) [2024-09-11 16:24:26.594343] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:26.744101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:26.744153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:26.744162] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:26.744193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:26.794497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:26.944447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:26.944492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:26.944499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:26.944509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:26.994613] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:26.995506] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=76] PNIO [ratelimit] time: 1726043066995503, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007575, add_bytes: 0 [2024-09-11 16:24:26.996939] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043066996937, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007469, add_bytes: 0 [2024-09-11 16:24:27.144755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:27.144800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:27.144807] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:27.144817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:27.194796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:27.345077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:27.345121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:27.345129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:27.345139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:27.394987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:27.425600] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:27.491137] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:27.545415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:27.545461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:27.545492] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:27.545502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:27.552557] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7043, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:24:27.595181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:27.752874] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:27.752930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:27.752939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:27.752949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:27.795383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:27.953243] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:27.953283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:27.953291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:27.953301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:27.995522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:28.003126] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043068003122, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:24:28.004566] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043068004564, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:24:28.153608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:28.153676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:28.153685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:28.153695] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:28.195712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:28.353916] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:28.353955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:28.353962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:28.353969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:28.395926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:28.425711] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:28.492175] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:28.554278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:28.554326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:28.554334] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:28.554344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:28.596114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:28.754650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:28.754692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:28.754698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:28.754706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:28.799548] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3312, replace_start_pos=7400000, replace_num=100000) [2024-09-11 16:24:28.799596] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:28.954956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:28.955000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:28.955008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:28.955017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:28.999704] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:29.010734] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043069010729, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:24:29.012186] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043069012183, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:24:29.155312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:29.155356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:29.155364] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:29.155374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:29.199840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:29.355605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:29.355649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:29.355657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:29.355666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:29.400032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:29.425895] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:29.493381] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:29.555990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:29.556035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:29.556043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:29.556053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:29.563195] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7105, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:24:29.600161] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:29.763516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:29.763559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:29.763567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:29.763577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:29.800284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:29.963877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:29.963944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:29.963953] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:29.963962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:30.000393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:30.018355] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043070018351, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:24:30.019805] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043070019802, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:24:30.164305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:30.164347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:30.164355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:30.164365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:30.200524] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:30.364685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:30.364724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:30.364733] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:30.364743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:30.400719] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:30.426125] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=89] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:30.494558] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:30.565086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:30.565131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:30.565139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:30.565148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:30.600920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:30.765452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:30.765508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:30.765523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:30.765535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:30.801042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:30.965834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:30.965876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:30.965884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:30.965893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:31.005588] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4364, replace_start_pos=7500000, replace_num=100000) [2024-09-11 16:24:31.005639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:31.026068] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043071026064, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007713, add_bytes: 0 [2024-09-11 16:24:31.027500] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043071027498, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007696, add_bytes: 0 [2024-09-11 16:24:31.166236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:31.166279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:31.166287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:31.166297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:31.205808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:31.366603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:31.366648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:31.366656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:31.366666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:31.405989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:31.426340] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:31.495617] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:31.567006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:31.567051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:31.567058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:31.567067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:31.575011] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7931, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:24:31.606122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:31.775375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:31.775412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:31.775420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:31.775430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:31.775618] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:24:31.806273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:31.975992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:31.976037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:31.976044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:31.976053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:32.006458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:32.033598] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043072033594, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 16:24:32.035083] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043072035081, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007583, add_bytes: 0 [2024-09-11 16:24:32.176293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:32.176338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:32.176346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:32.176356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:32.206594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:32.376611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:32.376653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:32.376660] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:32.376669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:32.376883] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=75, refresh_score_time=62, wash_time=0) [2024-09-11 16:24:32.406778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:32.426467] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:32.496604] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:32.577190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:32.577237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:32.577245] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:32.577255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:32.606923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:32.777484] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:32.777529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:32.777537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:32.777546] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:32.807108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:32.977861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:32.977923] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:32.977934] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:32.977943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:33.007294] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:33.041271] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043073041266, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:24:33.042644] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043073042642, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:24:33.178286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:33.178334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:33.178341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:33.178351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:33.211789] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4371, replace_start_pos=7600000, replace_num=100000) [2024-09-11 16:24:33.211835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:33.288511] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:33.288566] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:33.288651] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=209, max_check_version=210, global_version=211) [2024-09-11 16:24:33.290650] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1999 [2024-09-11 16:24:33.290686] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:33.290739] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:24:33.290777] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:24:33.290862] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:33.290984] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,232 used= 76,302,780 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:24:33.291041] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:24:33.291053] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:24:33.291064] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:24:33.291100] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:24:33.291160] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:24:33.291182] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:24:33.378657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:33.378704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:33.378712] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:33.378722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:33.411923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:33.426608] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:33.497572] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:33.579054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:33.579100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:33.579108] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:33.579117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:33.586673] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7544, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:24:33.612105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:33.787005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:33.787048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:33.787055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:33.787064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:33.812225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:33.987367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:33.987415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:33.987424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:33.987433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:34.012435] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:34.048882] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043074048879, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:24:34.050260] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726043074050258, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:24:34.187758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:34.187802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:34.187810] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:34.187820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:34.212565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:34.388119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:34.388162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:34.388170] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:34.388179] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:34.412692] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:34.426726] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:34.498492] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:34.588485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:34.588529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:34.588537] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:34.588548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:34.612809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:34.788774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:34.788813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:34.788820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:34.788846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:34.812924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:34.989076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:34.989117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:34.989125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:34.989134] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:35.013138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:35.056435] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726043075056431, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:24:35.057930] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043075057927, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:24:35.189438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:35.189487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:35.189494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:35.189504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:35.213260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:35.389729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:35.389776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:35.389783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:35.389793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:35.417762] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4379, replace_start_pos=7700000, replace_num=100000) [2024-09-11 16:24:35.417803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:35.426856] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:35.499525] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:35.590113] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:35.590160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:35.590167] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:35.590177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:35.598590] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8399, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:24:35.617889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:35.798931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:35.798986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:35.799021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:35.799032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:35.818034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:35.999372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:35.999419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:35.999428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:35.999437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:36.018172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:36.064051] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043076064047, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:24:36.065496] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043076065493, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:24:36.199743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:36.199790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:36.199798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:36.199808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:36.218290] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:36.400052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:36.400091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:36.400098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:36.400107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:36.418471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:36.427027] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=99] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:36.500561] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:36.600415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:36.600459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:36.600466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:36.600476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:36.618654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:36.800716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:36.800763] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:36.800769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:36.800776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:36.818775] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:37.001037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:37.001081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:37.001089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:37.001098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:37.018916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:37.071688] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1726043077071684, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:24:37.073158] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043077073157, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:24:37.201403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:37.201450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:37.201459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:37.201470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:37.219107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:37.401678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:37.401713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:37.401719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:37.401726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:37.419325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:37.427237] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:37.501712] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:37.602050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:37.602095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:37.602103] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:37.602112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:37.610639] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8492, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:24:37.623543] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4095, replace_start_pos=7800000, replace_num=100000) [2024-09-11 16:24:37.623584] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:37.810989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:37.811036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:37.811044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:37.811054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:37.823668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:38.011364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:38.011408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:38.011417] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:38.011426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:38.023839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:38.079289] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043078079285, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:24:38.080718] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043078080715, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:24:38.211733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:38.211777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:38.211803] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:38.211813] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:38.224016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:38.412111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:38.412158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:38.412166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:38.412175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:38.424151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:38.427377] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:38.502841] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:38.612422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:38.612467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:38.612475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:38.612485] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:38.624269] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:38.812816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:38.812864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:38.812872] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:38.812882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:38.824458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:39.013133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:39.013176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:39.013184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:39.013211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:39.024645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:39.086922] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043079086917, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:24:39.088327] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043079088326, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:24:39.213523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:39.213569] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:39.213577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:39.213587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:39.224770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:39.413921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:39.413964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:39.413972] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:39.413982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:39.424916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:39.427494] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:39.504017] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=103] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:39.614291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:39.614335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:39.614342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:39.614352] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:39.622946] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8580, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:24:39.625095] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:39.823207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:39.823251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:39.823258] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:39.823268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:39.829564] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4324, replace_start_pos=7900000, replace_num=100000) [2024-09-11 16:24:39.829604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:40.023516] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:40.023559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:40.023567] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:40.023576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:40.029738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:40.094540] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043080094536, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:24:40.095943] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726043080095941, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:24:40.223814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:40.223857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:40.223866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:40.223875] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:40.229920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:40.424171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:40.424215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:40.424223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:40.424232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:40.427602] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:40.430149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:40.505021] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:40.624556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:40.624600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:40.624608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:40.624618] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:40.630266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:40.824945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:40.825003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:40.825018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:40.825028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:40.830380] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:41.025347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:41.025390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:41.025400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:41.025411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:41.030548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:41.102199] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043081102195, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007659, add_bytes: 0 [2024-09-11 16:24:41.103635] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043081103634, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:24:41.225713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:41.225760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:41.225768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:41.225777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:41.230805] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:41.426075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:41.426120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:41.426128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:41.426137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:41.427742] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:41.430988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:41.506170] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:41.626433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:41.626478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:41.626487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:41.626497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:41.631112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:41.634104] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7594, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:24:41.831288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:41.834427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:41.834457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:41.834483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:41.834492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:42.034739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:42.034787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:42.034795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:42.034804] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:42.035752] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=8000000, replace_num=100000) [2024-09-11 16:24:42.035792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:42.109828] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043082109824, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:24:42.111243] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043082111241, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:24:42.235168] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:42.235211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:42.235219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:42.235228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:42.235883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:42.427919] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=30] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:42.435464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:42.435525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:42.435534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:42.435543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:42.435997] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:42.507191] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:42.635851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:42.635898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:42.635927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:42.635937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:42.636114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:42.836182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:42.836226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:42.836247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:42.836259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:42.836272] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:43.036362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:43.036633] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:43.036667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:43.036675] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:43.036685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:43.117365] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043083117361, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:24:43.118854] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043083118851, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:24:43.236502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:43.237019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:43.237053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:43.237062] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:43.237071] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:43.307296] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:43.307350] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:43.307451] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] update_check_range(min_check_version=210, max_check_version=211, global_version=212) [2024-09-11 16:24:43.309446] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1994 [2024-09-11 16:24:43.309482] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:43.309516] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:24:43.309573] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:24:43.309657] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:43.309764] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:24:43.309815] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:24:43.309831] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:24:43.309842] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:24:43.309878] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:24:43.309952] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:24:43.309976] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:24:43.428071] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:43.436624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:43.437366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:43.437400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:43.437408] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:43.437435] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:43.508341] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:43.636820] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:43.637682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:43.637711] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:43.637735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:43.637744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:43.645790] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8032, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:24:43.836937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:43.846120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:43.846165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:43.846174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:43.846184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:44.037132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:44.046487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:44.046531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:44.046539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:44.046549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:44.125215] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043084125210, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007849, add_bytes: 0 [2024-09-11 16:24:44.126406] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043084126406, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:24:44.240697] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3370, replace_start_pos=8100000, replace_num=100000) [2024-09-11 16:24:44.240739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:44.246784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:44.246823] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:44.246830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:44.246839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:44.428194] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:44.440839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:44.447092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:44.447139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:44.447147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:44.447157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:44.509176] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:44.641033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:44.647396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:44.647441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:44.647449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:44.647458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:44.841217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:44.847776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:44.847819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:44.847827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:44.847837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:45.041407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:45.048087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:45.048127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:45.048135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:45.048144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:45.132607] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043085132602, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007392, add_bytes: 0 [2024-09-11 16:24:45.134022] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726043085134021, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:24:45.241616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:45.248447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:45.248486] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:45.248494] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:45.248503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:45.428423] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:45.441755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:45.448804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:45.448847] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:45.448855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:45.448865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:45.510276] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:45.641920] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:45.649170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:45.649214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:45.649222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:45.649231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:45.657115] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7845, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:24:45.842047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:45.857434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:45.857481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:45.857489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:45.857499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:46.042192] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:46.057797] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:46.057842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:46.057850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:46.057860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:46.140212] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043086140207, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:24:46.141635] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726043086141634, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:24:46.242384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:46.258150] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:46.258189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:46.258197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:46.258206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:46.428634] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=133] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:46.446953] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4381, replace_start_pos=8200000, replace_num=100000) [2024-09-11 16:24:46.447001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:46.458461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:46.458508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:46.458515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:46.458524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:46.511226] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:46.647091] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:46.658785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:46.658827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:46.658835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:46.658844] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:46.847284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:46.859093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:46.859139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:46.859147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:46.859156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:47.047405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:47.059454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:47.059498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:47.059506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:47.059534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:47.147831] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043087147828, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:24:47.149262] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726043087149260, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:24:47.247586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:47.259830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:47.259873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:47.259881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:47.259890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:47.428767] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:47.447793] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:47.460145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:47.460187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:47.460195] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:47.460205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:47.512138] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:47.647926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:47.660538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:47.660586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:47.660595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:47.660605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:47.668849] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8230, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:24:47.848105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:47.869106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:47.869151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:47.869159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:47.869168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:48.048298] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:48.069470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:48.069515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:48.069523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:48.069534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:48.155450] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043088155446, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:24:48.156899] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726043088156897, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:24:48.248483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:48.269841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:48.269900] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:48.269930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:48.269945] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:48.428971] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:48.448610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:48.470245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:48.470290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:48.470298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:48.470308] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:48.513370] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:48.653141] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4335, replace_start_pos=8300000, replace_num=100000) [2024-09-11 16:24:48.653193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:48.670604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:48.670648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:48.670656] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:48.670666] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:48.853344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:48.871007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:48.871047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:48.871054] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:48.871063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:49.053536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:49.071380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:49.071423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:49.071431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:49.071440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:49.163074] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043089163070, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:24:49.164551] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043089164548, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007651, add_bytes: 0 [2024-09-11 16:24:49.253664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:49.271740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:49.271787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:49.271796] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:49.271805] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:49.429116] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:49.453846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:49.472070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:49.472114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:49.472121] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:49.472131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:49.514300] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:49.654033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:49.672364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:49.672408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:49.672415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:49.672424] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:49.681018] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8580, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:24:49.854165] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:49.881285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:49.881325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:49.881332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:49.881361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:50.054287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:50.081728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:50.081775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:50.081783] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:50.081792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:50.170680] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1726043090170675, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:24:50.172102] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043090172101, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:24:50.254467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:50.282101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:50.282149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:50.282158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:50.282169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:50.429248] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:50.454656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:50.482471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:50.482517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:50.482526] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:50.482554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:50.515297] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:50.654782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:50.682834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:50.682883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:50.682890] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:50.682898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:50.859351] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4392, replace_start_pos=8400000, replace_num=100000) [2024-09-11 16:24:50.859407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:50.883175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:50.883216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:50.883223] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:50.883232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:51.059565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=16] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:51.083477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:51.083522] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:51.083530] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:51.083540] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:51.178290] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043091178287, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:24:51.179720] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO [ratelimit] time: 1726043091179719, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:24:51.259756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:51.283781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:51.283843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:51.283851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:51.283860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:51.429398] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:51.459946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:51.484107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:51.484148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:51.484156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:51.484165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:51.516226] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:51.660070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:51.684409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:51.684450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:51.684458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:51.684467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:51.693120] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8639, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:24:51.860252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:51.893387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:51.893430] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:51.893438] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:51.893447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:52.060437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:52.093777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:52.093821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:52.093830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:52.093839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:52.185964] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043092185961, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:24:52.187332] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726043092187331, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:24:52.260646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:52.294144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:52.294188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:52.294196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:52.294206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:52.429609] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:52.460851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:52.494517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:52.494562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:52.494570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:52.494580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:52.517142] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:52.661039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:52.694831] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:52.694877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:52.694884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:52.694893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:52.695148] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash time detail, (compute_wash_size_time=116, refresh_score_time=69, wash_time=0) [2024-09-11 16:24:52.861230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:52.895397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:52.895445] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:52.895452] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:52.895460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:53.065723] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4366, replace_start_pos=8500000, replace_num=100000) [2024-09-11 16:24:53.065772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:53.095737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:53.095780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:53.095786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:53.095794] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:53.193591] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043093193587, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:24:53.194959] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726043093194958, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:24:53.265940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:53.296110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:53.296158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:53.296184] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:53.296194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:53.326163] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:53.326210] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:24:53.326296] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] update_check_range(min_check_version=211, max_check_version=212, global_version=213) [2024-09-11 16:24:53.328359] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2060 [2024-09-11 16:24:53.328397] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:53.328431] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:24:53.328464] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:24:53.328560] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:24:53.328643] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,232 used= 76,302,780 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:24:53.328686] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:24:53.328695] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:24:53.328707] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:24:53.328739] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:24:53.328787] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:24:53.328806] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:24:53.429739] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:53.466129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:53.496447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:53.496490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:53.496498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:53.496507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:53.518122] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:53.666268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:53.697287] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:53.697336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:53.697344] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:53.697354] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:53.705395] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8006, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:24:53.866397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:53.905680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:53.905725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:53.905732] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:53.905742] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:54.066587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:54.106086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:54.106135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:54.106142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:54.106152] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:54.201151] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043094201148, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:24:54.202568] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043094202567, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:24:54.266721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:54.306467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:54.306510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:54.306518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:54.306527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:54.429842] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:54.466899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:54.506844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:54.506889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:54.506897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:54.506928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:54.519071] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:54.667094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:54.707227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:54.707269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:54.707277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:54.707287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:54.867281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:54.907586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:54.907625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:54.907633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:54.907643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:55.067490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:55.107979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:55.108023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:55.108030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:55.108040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:55.208777] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043095208773, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:24:55.210191] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726043095210189, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:24:55.271040] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3352, replace_start_pos=8600000, replace_num=100000) [2024-09-11 16:24:55.271085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:55.308301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:55.308342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:55.308350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:55.308359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:55.429993] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:55.471177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:55.508662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:55.508707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:55.508715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:55.508726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:55.520154] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:55.671360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:55.709005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:55.709052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:55.709059] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:55.709068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:55.716059] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6977, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:24:55.871549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:55.916382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:55.916428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:55.916436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:55.916445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:56.073356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=1662] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:56.116757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:56.116803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:56.116811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:56.116821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:56.216443] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043096216438, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:24:56.217818] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043096217816, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:24:56.273490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:56.317076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:56.317119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:56.317127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:56.317136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:56.430226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:56.473681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:56.517433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:56.517475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:56.517483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:56.517493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:56.521139] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:56.673889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:56.717792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:56.717838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:56.717846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:56.717856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:56.874099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:56.918149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:56.918193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:56.918201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:56.918211] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:57.074286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:57.118444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:57.118487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:57.118495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:57.118504] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:57.224008] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043097224003, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 16:24:57.225503] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043097225499, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:24:57.274423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:57.318728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:57.318772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:57.318779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:57.318788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:57.430424] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:57.478913] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=8700000, replace_num=100000) [2024-09-11 16:24:57.478961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:57.519153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:57.519195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:57.519203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:57.519213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:57.522080] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:57.679048] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:57.719447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:57.719491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:57.719498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:57.719507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:57.728002] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8482, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:24:57.879278] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:24:57.928364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:57.928409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:57.928417] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:57.928443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:58.079410] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:24:58.128671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:58.128708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:58.128715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:58.128724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:58.231623] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043098231619, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:24:58.233036] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043098233034, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007535, add_bytes: 0 [2024-09-11 16:24:58.279532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:24:58.329028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:58.329074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:58.329081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:58.329092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:58.430546] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:58.479651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:24:58.523230] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:58.529395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:58.529428] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:58.529436] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:58.529445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:58.679833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:24:58.729758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:58.729804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:58.729840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:58.729852] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:58.879971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:24:58.930182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:58.930230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:58.930238] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:58.930248] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:59.080091] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:24:59.130548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:59.130593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:59.130601] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:59.130611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:59.239229] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043099239226, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:24:59.240646] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043099240645, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:24:59.280259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:24:59.330921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:59.330963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:59.330987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:59.330997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:59.430671] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:24:59.480472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:24:59.524310] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:24:59.531288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:59.531325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:59.531333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:59.531342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:59.685050] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4387, replace_start_pos=8800000, replace_num=100000) [2024-09-11 16:24:59.685101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:24:59.731568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:59.731612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:59.731620] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:59.731629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:24:59.740115] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8474, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:24:59.885250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:24:59.940443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:24:59.940490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:24:59.940498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:24:59.940507] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:00.085378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:00.140807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:00.140850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:00.140859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:00.140869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:00.236337] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:25:00.242390] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:25:00.246851] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043100246847, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:25:00.246888] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:25:00.248263] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043100248260, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:25:00.248293] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:25:00.285522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:00.341165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:00.341209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:00.341217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:00.341226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:00.430813] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:00.485651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:00.525358] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:00.541459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:00.541493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:00.541500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:00.541510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:00.685851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:00.741806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:00.741851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:00.741858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:00.741865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:00.886016] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:00.942178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:00.942245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:00.942254] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:00.942263] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:01.086207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:01.142568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:01.142613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:01.142621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:01.142632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:01.254474] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726043101254470, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:25:01.255877] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726043101255876, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:25:01.286408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:01.342972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:01.343038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:01.343047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:01.343057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:01.430998] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=85] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:01.486594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:01.526372] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:01.543367] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:01.543411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:01.543419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:01.543428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:01.686782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:01.743674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:01.743725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:01.743733] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:01.743743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:01.750987] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7230, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:25:01.890828] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3864, replace_start_pos=8900000, replace_num=100000) [2024-09-11 16:25:01.890875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:01.951302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:01.951348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:01.951357] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:01.951366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:01.951581] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:25:02.090971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:02.151822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:02.151867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:02.151875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:02.151884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:02.262140] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043102262135, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:25:02.263495] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726043102263493, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:25:02.291103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:02.352109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:02.352155] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:02.352163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:02.352172] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:02.431123] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:02.491233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:02.527244] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:02.552385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:02.552434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:02.552441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:02.552462] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:02.691429] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:02.752684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:02.752742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:02.752749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:02.752756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:02.891641] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:02.953016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:02.953056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:02.953064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:02.953073] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:03.091850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:03.153285] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:03.153324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:03.153331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:03.153339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:03.269754] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043103269750, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:25:03.271184] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043103271182, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:25:03.292005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:03.344444] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:03.344507] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=60] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:03.344587] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=212, max_check_version=213, global_version=214) [2024-09-11 16:25:03.346618] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2029 [2024-09-11 16:25:03.346653] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:03.346689] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:25:03.346727] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:25:03.346809] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:03.346941] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:25:03.346998] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:25:03.347009] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:25:03.347020] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:25:03.347060] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:25:03.347134] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:25:03.347158] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:25:03.353564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:03.353597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:03.353604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:03.353613] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:03.431226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:03.492129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:03.528244] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:03.553842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:03.553885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:03.553892] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:03.553917] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:03.692263] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:03.754218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:03.754263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:03.754271] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:03.754281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:03.762871] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8558, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:25:03.892396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:03.963126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:03.963167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:03.963173] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:03.963181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:04.095859] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3331, replace_start_pos=9000000, replace_num=100000) [2024-09-11 16:25:04.095910] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:04.163425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:04.163474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:04.163481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:04.163490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:04.277374] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043104277370, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:25:04.278744] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043104278741, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:25:04.295994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:04.363725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:04.363769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:04.363805] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:04.363814] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:04.431399] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:04.496168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:04.529197] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:04.564110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:04.564180] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:04.564191] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:04.564200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:04.696299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:04.764407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:04.764451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:04.764457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:04.764464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:04.896423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:04.964780] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:04.964825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:04.964832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:04.964841] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:05.096547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:05.165075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:05.165123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:05.165129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:05.165156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:05.284983] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043105284979, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:25:05.286359] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043105286357, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:25:05.296662] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:05.365370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:05.365412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:05.365418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:05.365425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:05.431589] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:05.496768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:05.530078] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:05.565658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:05.565700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:05.565706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:05.565714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:05.696876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:05.766002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:05.766041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:05.766048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:05.766057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:05.773706] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7636, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:25:05.897011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:05.973975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:05.974031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:05.974044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:05.974053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:06.097157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:06.174267] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:06.174299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:06.174305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:06.174313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:06.292622] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043106292617, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 16:25:06.293978] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043106293977, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:25:06.301642] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4354, replace_start_pos=9100000, replace_num=100000) [2024-09-11 16:25:06.301675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:06.374521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:06.374565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:06.374571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:06.374579] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:06.431802] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:06.501763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:06.531130] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:06.574949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:06.574992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:06.574999] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:06.575025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:06.701946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:06.775303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:06.775358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:06.775369] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:06.775382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:06.902143] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:06.975629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:06.975671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:06.975677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:06.975684] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:07.102334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:07.175967] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:07.176004] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:07.176012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:07.176021] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:07.300153] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043107300149, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007532, add_bytes: 0 [2024-09-11 16:25:07.301575] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043107301574, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:25:07.302564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:07.376332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:07.376372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:07.376379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:07.376387] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:07.431931] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:07.502714] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:07.532123] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:07.576614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:07.576658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:07.576665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:07.576675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:07.702927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:07.776970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:07.777014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:07.777021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:07.777030] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:07.785450] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8406, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:25:07.903048] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:07.985697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:07.985743] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:07.985750] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:07.985782] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:08.103159] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:08.186020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:08.186053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:08.186060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:08.186069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:08.303261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:08.307774] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1726043108307771, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:25:08.309202] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=10] PNIO [ratelimit] time: 1726043108309201, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:25:08.386290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:08.386331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:08.386339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:08.386348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:08.432101] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:08.507729] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4365, replace_start_pos=9200000, replace_num=100000) [2024-09-11 16:25:08.507770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:08.532972] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:08.586572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:08.586606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:08.586613] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:08.586621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:08.707940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:08.786946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:08.786989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:08.786997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:08.787006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:08.908144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:08.987310] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:08.987356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:08.987364] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:08.987374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:09.108279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:09.187672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:09.187719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:09.187727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:09.187737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:09.308467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:09.315392] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043109315388, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:25:09.316820] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043109316816, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:25:09.388064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:09.388105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:09.388113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:09.388122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:09.432228] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:09.508679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:09.534190] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:09.588419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:09.588464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:09.588472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:09.588481] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:09.708867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:09.788777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:09.788818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:09.788826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:09.788836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:09.797535] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8684, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:25:09.909020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:09.997868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:09.997934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:09.997943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:09.997953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:10.109204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:10.198249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:10.198293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:10.198301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:10.198310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:10.309415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:10.323064] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043110323060, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2024-09-11 16:25:10.324440] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043110324438, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:25:10.398608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:10.398653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:10.398661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:10.398671] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:10.432345] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:10.509601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:10.535128] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:10.598995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:10.599039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:10.599047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:10.599056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:10.714126] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4343, replace_start_pos=9300000, replace_num=100000) [2024-09-11 16:25:10.714176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:10.799350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:10.799397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:10.799405] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:10.799433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:10.914275] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:10.999659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:10.999710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:10.999719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:10.999735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:11.114401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:11.199973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:11.200003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:11.200009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:11.200017] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:11.314504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:11.330680] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043111330676, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:25:11.332105] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043111332103, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:25:11.400253] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:11.400299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:11.400307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:11.400332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:11.432488] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:11.514625] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:11.536140] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:11.600559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:11.600625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:11.600633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:11.600642] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:11.714774] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:11.800853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:11.800890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:11.800896] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:11.800925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:11.807536] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6594, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:25:11.914994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:12.007862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:12.007924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:12.007933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:12.007942] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:12.115186] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:12.208258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:12.208303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:12.208330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:12.208340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:12.315371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:12.338227] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043112338223, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007547, add_bytes: 0 [2024-09-11 16:25:12.339675] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043112339672, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007569, add_bytes: 0 [2024-09-11 16:25:12.408651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:12.408695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:12.408703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:12.408713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:12.432664] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:12.515560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:12.537176] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:12.609038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:12.609085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:12.609093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:12.609103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:12.715842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:12.809348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:12.809393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:12.809401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:12.809410] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:12.920366] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4339, replace_start_pos=9400000, replace_num=100000) [2024-09-11 16:25:12.920408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:13.009714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:13.009759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:13.009767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:13.009777] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:13.010018] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=79, refresh_score_time=62, wash_time=0) [2024-09-11 16:25:13.120587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:13.210268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:13.210312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:13.210320] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:13.210329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:13.320706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:13.345935] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043113345930, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007707, add_bytes: 0 [2024-09-11 16:25:13.347276] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043113347274, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:25:13.361981] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:13.362018] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:13.362100] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=213, max_check_version=214, global_version=215) [2024-09-11 16:25:13.364179] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2077 [2024-09-11 16:25:13.364235] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:13.364269] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:25:13.364308] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:25:13.364391] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:13.364499] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,232 used= 76,302,780 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:25:13.364557] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:25:13.364569] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:25:13.364580] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:25:13.364617] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:25:13.364688] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:25:13.364714] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:25:13.410558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:13.410593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:13.410599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:13.410608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:13.432855] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:13.520819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:13.538123] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:13.610851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:13.610891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:13.610898] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:13.610926] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:13.721033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:13.811230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:13.811276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:13.811285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:13.811295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:13.819164] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7856, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:25:13.921237] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:14.019489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:14.019534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:14.019542] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:14.019551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:14.121442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:14.219852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:14.219900] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:14.219933] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:14.219943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:14.321563] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:14.353535] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043114353531, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:25:14.354933] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043114354931, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2024-09-11 16:25:14.420172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:14.420216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:14.420224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:14.420235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:14.433026] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:14.521678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:14.539283] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:14.620467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:14.620510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:14.620518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:14.620527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:14.721876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:14.820781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:14.820825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:14.820833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:14.820842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:14.922094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:15.021074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:15.021119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:15.021127] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:15.021136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:15.125697] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3388, replace_start_pos=9500000, replace_num=100000) [2024-09-11 16:25:15.125743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:15.221372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:15.221419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:15.221427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:15.221436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:15.325893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:15.361176] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043115361172, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2024-09-11 16:25:15.362508] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043115362505, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007574, add_bytes: 0 [2024-09-11 16:25:15.421669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:15.421708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:15.421717] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:15.421726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:15.433220] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:15.526149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=89] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:15.540294] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:15.621960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:15.621996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:15.622003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:15.622012] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:15.726339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:15.822251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:15.822294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:15.822301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:15.822310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:15.830890] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8566, clean_start_pos=0, clean_num=200000) [2024-09-11 16:25:15.926543] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:16.031233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:16.031282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:16.031291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:16.031314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:16.126749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:16.231628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:16.231673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:16.231682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:16.231692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:16.326938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:16.368758] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043116368754, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007582, add_bytes: 0 [2024-09-11 16:25:16.370119] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043116370117, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:25:16.432023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:16.432069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:16.432077] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:16.432086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:16.433438] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:16.527077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:16.541383] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:16.632291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:16.632325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:16.632331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:16.632339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:16.727198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:16.832564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:16.832629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:16.832637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:16.832646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:16.927304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:17.032868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:17.032920] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:17.032928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:17.032937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:17.127407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:17.233159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:17.233193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:17.233200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:17.233209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:17.331836] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4325, replace_start_pos=9600000, replace_num=100000) [2024-09-11 16:25:17.331881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:17.376319] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043117376313, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:25:17.377739] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043117377737, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:25:17.433453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:17.433517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:17.433525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:17.433534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:17.433569] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:17.531963] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:17.542331] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:17.633759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:17.633805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:17.633814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:17.633825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:17.732078] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:17.834065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:17.834101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:17.834109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:17.834119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:17.842246] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8114, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:25:17.932259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:18.042567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:18.042610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:18.042619] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:18.042628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:18.132398] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:18.243016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:18.243060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:18.243068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:18.243077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:18.332597] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:18.383921] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043118383917, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:25:18.385374] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043118385371, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:25:18.433674] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:18.443409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:18.443450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:18.443458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:18.443467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:18.532807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:18.543714] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:18.643767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:18.643810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:18.643818] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:18.643827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:18.733015] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:18.844130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:18.844179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:18.844187] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:18.844197] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:18.933207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:19.044521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:19.044568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:19.044576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:19.044586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:19.133339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:19.244889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:19.244974] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=83][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:19.244983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:19.244992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:19.333465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:19.391537] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043119391533, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:25:19.392970] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043119392968, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:25:19.433788] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:19.445305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:19.445352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:19.445360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:19.445369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:19.538005] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=9700000, replace_num=100000) [2024-09-11 16:25:19.538050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:19.544791] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:19.645628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:19.645690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:19.645698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:19.645707] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:19.738129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:19.845950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:19.845988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:19.845995] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:19.846004] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:19.854385] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8368, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:25:19.938265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:20.054707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:20.054750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:20.054758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:20.054767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:20.138391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:20.255090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:20.255133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:20.255141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:20.255166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:20.338569] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:20.399153] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043120399150, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:25:20.400605] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043120400602, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:25:20.433914] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:20.455471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:20.455512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:20.455519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:20.455529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:20.538761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:20.545991] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:20.655833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:20.655878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:20.655886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:20.655896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:20.738944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:20.856226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:20.856271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:20.856279] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:20.856289] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:20.939124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:21.056581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:21.056645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:21.056654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:21.056663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:21.139313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:21.256894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:21.256962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:21.256970] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:21.256980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:21.339510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:21.406768] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043121406764, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:25:21.408198] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043121408197, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 16:25:21.434069] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:21.457273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:21.457318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:21.457326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:21.457355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:21.539696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:21.547003] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:21.657655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:21.657699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:21.657708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:21.657717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:21.744242] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4357, replace_start_pos=9800000, replace_num=100000) [2024-09-11 16:25:21.744307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:21.858037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:21.858080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:21.858089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:21.858098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:21.866641] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8529, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:25:21.944461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:22.067007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:22.067052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:22.067060] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:22.067070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:22.144654] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:22.267369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:22.267410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:22.267419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:22.267428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:22.344797] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:22.414453] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043122414449, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:25:22.415821] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043122415819, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:25:22.434187] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:22.467733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:22.467778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:22.467786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:22.467796] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:22.545015] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:22.548087] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:22.668099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:22.668146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:22.668154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:22.668163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:22.745205] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:22.868467] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:22.868509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:22.868517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:22.868527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:22.945397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:23.068762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:23.068799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:23.068806] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:23.068815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:23.145580] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:23.269172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:23.269220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:23.269228] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:23.269237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:23.345706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:23.379191] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:23.379244] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:23.379324] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=214, max_check_version=215, global_version=216) [2024-09-11 16:25:23.381374] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2047 [2024-09-11 16:25:23.381416] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:23.381451] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:25:23.381512] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:25:23.381594] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:23.381701] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,693,456 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 206,304 used= 193,824 count= 24 avg_used= 8,076 block_cnt= 24 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,693,456 used= 76,279,596 count= 1,551 avg_used= 49,180 mod=SUMMARY [2024-09-11 16:25:23.381753] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:25:23.381769] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:25:23.381780] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:25:23.381817] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:25:23.381877] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:25:23.381899] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:25:23.422003] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043123421999, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:25:23.423451] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043123423449, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:25:23.434313] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:23.469472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:23.469515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:23.469522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:23.469532] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:23.545882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:23.549002] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:23.669832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:23.669878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:23.669886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:23.669896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:23.746096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:23.870241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:23.870288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:23.870296] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:23.870306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:23.878928] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8609, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:25:23.950558] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4331, replace_start_pos=9900000, replace_num=100000) [2024-09-11 16:25:23.950607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:24.079264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:24.079307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:24.079315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:24.079324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:24.150762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:24.279641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:24.279686] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:24.279694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:24.279703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:24.350887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:24.429617] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043124429613, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:25:24.431126] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043124431124, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:25:24.434423] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:24.480044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:24.480086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:24.480094] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:24.480103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:24.549994] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:24.551100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:24.680344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:24.680388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:24.680396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:24.680405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:24.751315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:24.880671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:24.880716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:24.880724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:24.880755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:24.951525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:25.081045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:25.081088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:25.081096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:25.081105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:25.151737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:25.281419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:25.281466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:25.281473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:25.281483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:25.351929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:25.434536] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:25.437234] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726043125437232, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:25:25.438662] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043125438661, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:25:25.481803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:25.481841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:25.481868] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:25.481877] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:25.551062] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:25.552053] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:25.682129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:25.682182] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:25.682190] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:25.682200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:25.752225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:25.882421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:25.882457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:25.882464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:25.882472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:25.890008] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7522, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:25:25.952353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:26.090255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:26.090301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:26.090307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:26.090314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:26.156804] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4313, replace_start_pos=10000000, replace_num=100000) [2024-09-11 16:25:26.156853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:26.290567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:26.290653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=85][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:26.290666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:26.290676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:26.357011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:26.434680] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:26.444848] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726043126444846, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:25:26.446355] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726043126446352, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:25:26.490972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:26.491011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:26.491018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:26.491026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:26.552296] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:26.557197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:26.691273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:26.691315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:26.691322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:26.691329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:26.757385] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:26.891638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:26.891685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:26.891694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:26.891704] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:26.957523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:27.091960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:27.092006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:27.092012] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:27.092019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:27.157668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:27.292307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:27.292352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:27.292358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:27.292365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:27.357883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:27.434877] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:27.452475] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043127452471, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:25:27.453921] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043127453919, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:25:27.492601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:27.492651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:27.492657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:27.492665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:27.553408] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:27.558052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=87] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:27.692938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:27.692990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:27.692997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:27.693005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:27.758168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:27.893247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:27.893282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:27.893288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:27.893295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:27.899997] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6691, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:25:27.958271] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:28.100231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:28.100270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:28.100276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:28.100284] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:28.158438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:28.300574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:28.300615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:28.300623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:28.300633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:28.362536] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3912, replace_start_pos=10100000, replace_num=100000) [2024-09-11 16:25:28.362593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:28.434997] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:28.460182] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043128460179, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007708, add_bytes: 0 [2024-09-11 16:25:28.461520] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043128461519, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:25:28.500834] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:28.500868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:28.500875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:28.500882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:28.554216] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:28.562782] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:28.701107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:28.701149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:28.701156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:28.701165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:28.762950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:28.901364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:28.901404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:28.901410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:28.901418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:28.963065] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:29.101641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:29.101689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:29.101696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:29.101731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:29.163239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:29.301953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:29.301986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:29.301992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:29.302000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:29.363355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:29.435125] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:29.467697] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043129467694, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007515, add_bytes: 0 [2024-09-11 16:25:29.469132] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726043129469130, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:25:29.502232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:29.502277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:29.502284] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:29.502293] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:29.555278] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:29.563471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:29.702573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:29.702617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:29.702625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:29.702634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:29.763651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:29.902965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:29.903032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:29.903041] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:29.903050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:29.911071] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8007, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:25:29.963842] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:30.111379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:30.111421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:30.111427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:30.111436] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:30.163974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:30.311673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:30.311712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:30.311720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:30.311729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:30.364218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:30.435235] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:30.475339] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043130475335, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2024-09-11 16:25:30.476830] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043130476829, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007699, add_bytes: 0 [2024-09-11 16:25:30.511984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:30.512028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:30.512035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:30.512057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:30.556265] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:30.568797] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4379, replace_start_pos=10200000, replace_num=100000) [2024-09-11 16:25:30.568848] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:30.712279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:30.712323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:30.712330] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:30.712340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:30.768927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:30.912712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:30.912758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:30.912767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:30.912776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:30.969023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:31.113023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:31.113069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:31.113076] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:31.113085] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:31.169206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:31.313314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:31.313369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:31.313383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:31.313393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:31.369339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:31.435389] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:31.482939] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043131482935, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:25:31.484429] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043131484428, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:25:31.513617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:31.513658] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:31.513665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:31.513674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:31.557445] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:31.569462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:31.713965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:31.714015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:31.714023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:31.714032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:31.769645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:31.914258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:31.914300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:31.914307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:31.914314] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:31.922825] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8478, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:25:31.969780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:32.123116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:32.123158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:32.123165] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:32.123173] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:32.123351] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:25:32.169924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:32.323601] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:32.323640] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:32.323647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:32.323656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:32.370045] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:32.435515] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:32.490619] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043132490615, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:25:32.491984] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043132491983, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:25:32.523868] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:32.523945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:32.523952] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:32.523959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:32.558363] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:32.570213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:32.724191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:32.724236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:32.724243] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:32.724253] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:32.774672] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4308, replace_start_pos=10300000, replace_num=100000) [2024-09-11 16:25:32.774723] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:32.924479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:32.924525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:32.924534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:32.924545] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:32.974819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:33.124772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:33.124811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:33.124819] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:33.124828] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:33.174940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:33.325077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:33.325131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:33.325139] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:33.325148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:33.325361] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=87, refresh_score_time=63, wash_time=0) [2024-09-11 16:25:33.375055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:33.394541] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:33.394588] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:33.394666] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=215, max_check_version=216, global_version=217) [2024-09-11 16:25:33.396616] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1948 [2024-09-11 16:25:33.396655] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:33.396689] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:25:33.396740] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:25:33.396827] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:33.396952] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 9 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:25:33.397007] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:25:33.397021] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:25:33.397032] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:25:33.397066] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:25:33.397119] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:25:33.397139] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:25:33.435709] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:33.498165] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043133498161, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:25:33.499593] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726043133499592, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:25:33.525662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:33.525725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:33.525735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:33.525745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:33.559362] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:33.575168] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:33.725996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:33.726044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:33.726051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:33.726061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:33.775322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:33.926365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:33.926410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:33.926418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:33.926427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:33.934953] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8512, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:25:33.975433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:34.135296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:34.135342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:34.135350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:34.135360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:34.175552] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:34.335595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:34.335656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:34.335664] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:34.335672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:34.375680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:34.435829] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:34.505802] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043134505797, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:25:34.507224] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726043134507222, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:25:34.535921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:34.535968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:34.535976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:34.535984] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:34.560543] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:34.575811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:34.736213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:34.736256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:34.736262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:34.736270] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:34.775932] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:34.936508] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:34.936543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:34.936549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:34.936558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:34.979863] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3825, replace_start_pos=10400000, replace_num=100000) [2024-09-11 16:25:34.979933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:35.136796] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:35.136842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:35.136850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:35.136859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:35.180030] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:35.337089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:35.337134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:35.337142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:35.337151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:35.380150] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:35.436053] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:35.513399] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043135513394, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:25:35.514893] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043135514890, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:25:35.537447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:35.537492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:35.537500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:35.537509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:35.561923] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:35.580318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:35.737832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:35.737877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:35.737885] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:35.737934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:35.780554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:35.938172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:35.938216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:35.938224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:35.938233] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:35.946517] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8270, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:25:35.980745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:36.146776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:36.146821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:36.146828] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:36.146838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:36.180866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:36.347143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:36.347201] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:36.347216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:36.347226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:36.380959] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:36.436201] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=77] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:36.521031] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043136521026, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:25:36.522453] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726043136522450, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:25:36.547480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:36.547523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:36.547531] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:36.547541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:36.563198] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:36.581085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:36.747815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:36.748424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=607][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:36.748433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:36.748443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:36.781209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:36.948675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:36.948722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:36.948729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:36.948738] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:36.981317] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:37.148981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:37.149025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:37.149032] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:37.149062] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:37.185741] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4321, replace_start_pos=10500000, replace_num=100000) [2024-09-11 16:25:37.185779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:37.349292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:37.349339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:37.349346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:37.349355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:37.385858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:37.436333] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:37.528699] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726043137528695, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:25:37.530070] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043137530067, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:25:37.549654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:37.549699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:37.549707] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:37.549717] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:37.564316] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:37.585975] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:37.750049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:37.750094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:37.750102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:37.750112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:37.786105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:37.950405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:37.950449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:37.950457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:37.950467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:37.959053] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8572, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:25:37.986310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:38.159330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:38.159372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:38.159380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:38.159389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:38.186502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:38.359615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:38.359675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:38.359683] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:38.359692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:38.386629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:38.436533] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:38.536318] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043138536313, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:25:38.537690] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043138537688, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:25:38.559956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:38.560001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:38.560009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:38.560018] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:38.565101] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:38.586749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:38.760314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:38.760359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:38.760367] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:38.760377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:38.786855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:38.960623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:38.960667] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:38.960674] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:38.960683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:38.987023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:39.160936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:39.160978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:39.160985] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:39.160994] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:39.187229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:39.361297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:39.361344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:39.361352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:39.361362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:39.391698] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4250, replace_start_pos=10600000, replace_num=100000) [2024-09-11 16:25:39.391744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:39.436741] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:39.543930] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043139543925, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:25:39.545301] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043139545299, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:25:39.561597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:39.561642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:39.561650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:39.561659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:39.565994] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:39.591933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:39.761993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:39.762041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:39.762049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:39.762059] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:39.792067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:39.962291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:39.962337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:39.962345] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:39.962377] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:39.969313] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6922, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:25:39.992251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:40.169631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:40.169672] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:40.169680] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:40.169690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:40.192381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:40.370025] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:40.370071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:40.370080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:40.370090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:40.392565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:40.436862] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:40.551497] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043140551492, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:25:40.552913] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726043140552912, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:25:40.566773] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:40.570395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:40.570432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:40.570440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:40.570450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:40.592690] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:40.770755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:40.770801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:40.770809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:40.770819] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:40.792826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:40.971130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:40.971173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:40.971182] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:40.971191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:40.992944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:41.171500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:41.171548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:41.171556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:41.171565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:41.193072] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:41.371879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:41.371959] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:41.371992] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:41.372003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:41.393194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:41.437041] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=92] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:41.559104] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043141559100, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:25:41.560591] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043141560588, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:25:41.567536] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:41.572342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:41.572376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:41.572384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:41.572393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:41.597676] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4372, replace_start_pos=10700000, replace_num=100000) [2024-09-11 16:25:41.597721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:41.772691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:41.772733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:41.772741] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:41.772750] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:41.797816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:41.973092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:41.973135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:41.973143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:41.973153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:41.981105] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7937, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:25:41.998011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:42.181401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:42.181441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:42.181449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:42.181458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:42.198148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:42.381761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:42.381806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:42.381814] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:42.381825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:42.398344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:42.437164] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:42.566720] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043142566716, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:25:42.568150] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043142568148, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:25:42.568251] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:42.582151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:42.582195] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:42.582203] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:42.582213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:42.598464] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:42.782447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:42.782490] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:42.782498] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:42.782525] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:42.798621] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:42.982840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:42.982881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:42.982888] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:42.982896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:42.998804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:43.183142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:43.183190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:43.183198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:43.183207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:43.198989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:43.383515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:43.383560] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:43.383568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:43.383578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:43.399112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:43.411291] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:43.411342] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:43.411422] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=216, max_check_version=217, global_version=218) [2024-09-11 16:25:43.413462] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2039 [2024-09-11 16:25:43.413503] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:43.413539] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:25:43.413577] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:25:43.413679] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:43.413786] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:25:43.413842] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:25:43.413853] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:25:43.413864] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:25:43.413919] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:25:43.413980] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:25:43.414002] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:25:43.437345] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:43.569031] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:43.574341] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043143574338, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:25:43.575868] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043143575866, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007718, add_bytes: 0 [2024-09-11 16:25:43.583940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:43.583976] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:43.583984] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:43.583993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:43.599260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:43.784246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:43.784297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:43.784307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:43.784317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:43.803832] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4394, replace_start_pos=10800000, replace_num=100000) [2024-09-11 16:25:43.803893] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:43.984539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:43.984584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:43.984590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:43.984597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:43.991464] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6855, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:25:44.004073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:44.191708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:44.191766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:44.191773] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:44.191781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:44.204257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:44.392028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:44.392074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:44.392082] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:44.392090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:44.404378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:44.437519] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:44.569932] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:44.582008] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043144582004, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:25:44.583369] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043144583368, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007502, add_bytes: 0 [2024-09-11 16:25:44.592326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:44.592380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:44.592387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:44.592396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:44.604563] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:44.792617] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:44.792659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:44.792666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:44.792674] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:44.804672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:44.992951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:44.992999] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:44.993006] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:44.993015] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:45.004788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:45.193230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:45.195552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=2319][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:45.195572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:45.195582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:45.204919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:45.395812] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:45.395852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:45.395858] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:45.395866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:45.405032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:45.437657] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:45.570999] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:45.589661] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043145589656, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007652, add_bytes: 0 [2024-09-11 16:25:45.590994] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043145590991, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:25:45.596169] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:45.596199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:45.596207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:45.596215] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:45.605258] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:45.796517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:45.796564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:45.796572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:45.796582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:45.805433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:45.996799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:45.996843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:45.996871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:45.996879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:46.004183] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7292, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:25:46.009873] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4319, replace_start_pos=10900000, replace_num=100000) [2024-09-11 16:25:46.009929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:46.204434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:46.204476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:46.204484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:46.204492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:46.210024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:46.404702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:46.404749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:46.404762] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:46.404770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:46.410137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:46.437919] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:46.572877] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:46.597189] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043146597185, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007529, add_bytes: 0 [2024-09-11 16:25:46.598668] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043146598666, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:25:46.605006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:46.605037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:46.605043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:46.605051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:46.610233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:46.805266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:46.805308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:46.805315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:46.805322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:46.810387] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:47.005543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:47.005579] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:47.005585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:47.005592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:47.010583] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:47.205818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:47.205865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:47.205873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:47.205882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:47.210766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:47.406097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:47.406153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:47.406159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:47.406167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:47.410879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:47.438112] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:47.573634] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=98] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:47.604793] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043147604789, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:25:47.606219] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043147606218, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:25:47.606374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:47.606402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:47.606407] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:47.606415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:47.611023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:47.806627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:47.806670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:47.806678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:47.806687] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:47.811134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:48.006935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:48.006978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:48.006986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:48.006996] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:48.011248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:48.015500] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8492, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:25:48.215423] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4050, replace_start_pos=11000000, replace_num=100000) [2024-09-11 16:25:48.215471] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:48.215761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:48.215793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:48.215802] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:48.215811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:48.415551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:48.416104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:48.416135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:48.416143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:48.416153] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:48.438226] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:48.574392] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:48.612421] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043148612417, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:25:48.613927] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043148613925, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007707, add_bytes: 0 [2024-09-11 16:25:48.615721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:48.616391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:48.616425] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:48.616434] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:48.616444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:48.815832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:48.816739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:48.816778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:48.816786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:48.816795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:49.015988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:49.017086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:49.017120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:49.017128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:49.017137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:49.216105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:49.217434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:49.217468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:49.217476] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:49.217486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:49.416221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:49.417778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:49.417810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:49.417836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:49.417846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:49.438347] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:49.575284] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:49.616339] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:49.618137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:49.618165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:49.618172] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:49.618181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:49.620023] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043149620021, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:25:49.621510] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043149621508, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007583, add_bytes: 0 [2024-09-11 16:25:49.816527] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:49.818420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:49.818448] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:49.818456] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:49.818466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:50.016644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:50.018699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:50.018725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:50.018733] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:50.018741] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:50.027242] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8488, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:25:50.216773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:50.227561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:50.227600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:50.227608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:50.227617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:50.421264] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4362, replace_start_pos=11100000, replace_num=100000) [2024-09-11 16:25:50.421314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:50.427863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:50.427934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:50.427948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:50.427964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:50.438577] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:50.576017] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:50.621397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:50.627700] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043150627697, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:25:50.628319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:50.628352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:50.628359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:50.628369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:50.629076] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043150629075, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:25:50.821570] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:50.828677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:50.828718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:50.828727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:50.828759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:51.021696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:51.029094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:51.029137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:51.029146] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:51.029156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:51.221818] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:51.229472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:51.229510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:51.229518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:51.229527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:51.422008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:51.429827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:51.429873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:51.429882] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:51.429891] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:51.438738] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:51.576775] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:51.622204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:51.630215] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:51.630258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:51.630266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:51.630295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:51.635277] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043151635274, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007577, add_bytes: 0 [2024-09-11 16:25:51.636765] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726043151636763, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:25:51.822323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:51.830535] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:51.830570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:51.830578] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:51.830587] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:52.022440] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:52.030821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:52.030859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:52.030866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:52.030876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:52.038041] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7151, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:25:52.222619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:52.238387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:52.238433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:52.238460] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:52.238472] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:52.422753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:52.438779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:52.438838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:52.438846] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:52.438856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:52.438866] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:52.577695] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:52.626676] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3802, replace_start_pos=11200000, replace_num=100000) [2024-09-11 16:25:52.626715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:52.639170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:52.639214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:52.639222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:52.639231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:52.642941] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043152642938, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:25:52.644306] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043152644305, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:25:52.826847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:52.839478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:52.839513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:52.839521] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:52.839530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:53.027039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:53.039829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:53.039870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:53.039878] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:53.039887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:53.227242] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:53.240249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:53.240294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:53.240302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:53.240312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:53.427370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:53.429575] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:53.429608] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:25:53.429694] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=217, max_check_version=218, global_version=219) [2024-09-11 16:25:53.431723] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2028 [2024-09-11 16:25:53.431778] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:53.431813] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:25:53.431851] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:25:53.431949] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:25:53.432058] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:25:53.432115] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:25:53.432126] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:25:53.432137] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:25:53.432180] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:25:53.432228] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:25:53.432246] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:25:53.439045] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:53.440562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:53.440587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:53.440595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:53.440604] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:53.578488] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:53.627488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:53.640853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:53.640897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:53.640939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:53.640953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:53.641171] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14] Wash time detail, (compute_wash_size_time=121, refresh_score_time=64, wash_time=0) [2024-09-11 16:25:53.650566] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043153650562, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:25:53.652034] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726043153652032, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007727, add_bytes: 0 [2024-09-11 16:25:53.827688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:53.841417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:53.841461] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:53.841469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:53.841478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:54.027879] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:54.041741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:54.041807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:54.041815] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:54.041825] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:54.048987] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7148, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:25:54.228088] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:54.249259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:54.249304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:54.249312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:54.249321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:54.428277] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:54.439161] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=28] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:54.449622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:54.449669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:54.449677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:54.449686] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:54.581100] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:54.628461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:54.650016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:54.650060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:54.650068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:54.650078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:54.658166] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043154658162, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:25:54.659601] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043154659598, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:25:54.831921] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3324, replace_start_pos=11300000, replace_num=100000) [2024-09-11 16:25:54.831965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:54.850292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:54.850337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:54.850343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:54.850352] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:55.032122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:55.050600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:55.050646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:55.050653] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:55.050662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:55.232249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:55.250932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:55.250972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:55.250980] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:55.250989] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:55.432447] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:55.439365] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:55.451316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:55.451362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:55.451371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:55.451380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:55.581841] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:55.632653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:55.651685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:55.651730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:55.651738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:55.651748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:55.665728] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043155665724, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:25:55.667215] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043155667213, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:25:55.832837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:55.852084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:55.852128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:55.852136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:55.852146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:56.032978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:56.052449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:56.052493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:56.052502] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:56.052512] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:56.061083] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8539, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:25:56.233172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:56.261412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:56.261456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:56.261464] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:56.261474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:56.433376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:56.439527] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:56.461778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:56.461822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:56.461830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:56.461839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:56.584357] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:56.633605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:56.662157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:56.662204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:56.662212] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:56.662222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:56.673349] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043156673346, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:25:56.674759] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043156674758, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:25:56.833799] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:56.862515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:56.862577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:56.862586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:56.862596] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:57.038247] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4315, replace_start_pos=11400000, replace_num=100000) [2024-09-11 16:25:57.038295] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:57.062896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:57.062985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=89][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:57.062994] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:57.063004] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:57.238492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:57.263304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:57.263341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:57.263349] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:57.263358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:57.438620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:57.439719] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:57.463655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:57.463694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:57.463719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:57.463730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:57.585120] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:57.638816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:57.664059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:57.664121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:57.664130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:57.664140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:57.680962] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043157680958, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:25:57.682378] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043157682375, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:25:57.838937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:25:57.864444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:57.864485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:57.864493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:57.864503] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:58.039142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:25:58.064808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:58.064854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:58.064861] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:58.064871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:58.073375] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8489, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:25:58.239266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:25:58.273631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:58.273670] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:58.273678] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:58.273688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:58.439475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:25:58.439888] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:58.473946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:58.473989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:58.473997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:58.474006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:58.585831] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:58.639651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:25:58.674237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:58.674281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:58.674288] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:58.674298] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:58.688630] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043158688626, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:25:58.690059] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043158690057, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:25:58.839836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:25:58.874676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:58.874726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:58.874734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:58.874745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:59.040020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:25:59.075092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:59.075135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:59.075142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:59.075152] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:59.244632] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4480, replace_start_pos=11500000, replace_num=100000) [2024-09-11 16:25:59.244678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:25:59.275453] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:59.275501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:59.275509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:59.275519] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:59.440095] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:25:59.444831] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:25:59.475821] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:59.475865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:59.475873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:59.475883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:59.586698] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=93] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:25:59.645011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:25:59.676217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:59.676255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:59.676263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:59.676289] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:25:59.696251] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043159696247, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:25:59.697679] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043159697677, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:25:59.845209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:25:59.876591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:25:59.876638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:25:59.876646] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:25:59.876655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:00.045344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:00.076866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:00.076893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:00.076899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:00.076928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:00.083623] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6682, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:26:00.245536] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:00.283995] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:00.284041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:00.284049] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:00.284082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:00.440307] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:00.445663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:00.484458] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:00.484502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:00.484510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:00.484520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:00.588070] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:00.645786] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:00.684830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:00.684876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:00.684884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:00.684895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:00.693347] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:26:00.699281] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:26:00.703809] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043160703806, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:26:00.703839] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:26:00.705286] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043160705285, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:26:00.705310] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:26:00.845972] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:00.885161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:00.885197] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:00.885204] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:00.885232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:01.046166] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:01.085531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:01.085566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:01.085573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:01.085581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:01.246392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:01.285966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:01.286013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:01.286021] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:01.286031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:01.440525] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:01.450939] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=11600000, replace_num=100000) [2024-09-11 16:26:01.450988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:01.486289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:01.486337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:01.486345] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:01.486372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:01.588876] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:01.651135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:01.686621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:01.686662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:01.686684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:01.686693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:01.711425] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726043161711421, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:26:01.712920] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726043161712917, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:26:01.851321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:01.887026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:01.887073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:01.887081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:01.887090] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:02.051461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:02.087344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:02.087389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:02.087397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:02.087406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:02.094935] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7515, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:26:02.251588] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:02.295276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:02.295338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:02.295348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:02.295358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:02.295549] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:26:02.440720] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:02.451712] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:02.495851] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:02.495897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:02.495928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:02.495938] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:02.589644] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:02.651896] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:02.696256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:02.696302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:02.696310] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:02.696319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:02.719030] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043162719025, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:26:02.720470] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043162720467, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:26:02.852105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:02.896619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:02.896662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:02.896670] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:02.896680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:03.052286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:03.097045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:03.097089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:03.097096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:03.097105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:03.252480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:03.297416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:03.297456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:03.297465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:03.297475] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:03.440851] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:03.447385] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:03.447420] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:03.447506] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=218, max_check_version=219, global_version=220) [2024-09-11 16:26:03.449520] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2014 [2024-09-11 16:26:03.449593] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=59] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:03.449629] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:26:03.449666] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:26:03.449751] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:03.449858] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,344 used= 76,295,092 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:26:03.449925] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:26:03.449937] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:26:03.449948] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:26:03.449985] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:26:03.450045] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:26:03.450067] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:26:03.452665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:03.497784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:03.497825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:03.497833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:03.497843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:03.590600] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:03.657207] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4369, replace_start_pos=11700000, replace_num=100000) [2024-09-11 16:26:03.657251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:03.698141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:03.698186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:03.698194] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:03.698210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:03.726658] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043163726654, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:26:03.728138] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043163728136, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:26:03.857405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:03.898456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:03.898514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:03.898525] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:03.898535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:04.057603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:04.098840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:04.098885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:04.098894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:04.098930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:04.107414] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8466, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:26:04.257809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:04.307737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:04.307775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:04.307784] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:04.307793] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:04.440971] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:04.457996] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:04.508100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:04.508145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:04.508153] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:04.508163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:04.591387] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:04.658185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:04.708471] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:04.708519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:04.708528] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:04.708538] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:04.734275] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043164734271, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:26:04.735763] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043164735760, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:26:04.858408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:04.908787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:04.908832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:04.908839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:04.908849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:05.058639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:05.109173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:05.109219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:05.109227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:05.109237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:05.258815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:05.309539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:05.309585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:05.309593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:05.309602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:05.441114] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:05.459047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:05.509930] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:05.509969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:05.509976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:05.509986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:05.592153] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:05.659228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:05.710288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:05.710332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:05.710340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:05.710349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:05.741968] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043165741964, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007693, add_bytes: 0 [2024-09-11 16:26:05.743321] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043165743320, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:26:05.863803] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4392, replace_start_pos=11800000, replace_num=100000) [2024-09-11 16:26:05.863851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:05.910652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:05.910697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:05.910706] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:05.910715] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:06.064006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:06.111037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:06.111083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:06.111111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:06.111120] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:06.119620] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8486, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:26:06.264197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:06.319891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:06.319952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:06.319960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:06.319969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:06.441351] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=90] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:06.464388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:06.520319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:06.520369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:06.520378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:06.520388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:06.592955] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:06.664592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:06.720704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:06.720748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:06.720757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:06.720767] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:06.749499] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043166749495, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007531, add_bytes: 0 [2024-09-11 16:26:06.750986] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043166750983, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:26:06.864716] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:06.921066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:06.921111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:06.921119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:06.921128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:07.064861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:07.121370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:07.121409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:07.121416] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:07.121426] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:07.265003] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:07.321669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:07.321714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:07.321722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:07.321731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:07.441490] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:07.465124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:07.521993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:07.522034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:07.522058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:07.522068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:07.593808] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:07.665234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:07.722292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:07.722325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:07.722332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:07.722340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:07.757125] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043167757122, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:26:07.758623] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043167758620, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:26:07.865370] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:07.922680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:07.922721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:07.922729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:07.922737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:08.069881] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4377, replace_start_pos=11900000, replace_num=100000) [2024-09-11 16:26:08.069935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:08.123007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:08.123053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:08.123061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:08.123070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:08.130943] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7858, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:26:08.270019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:08.331234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:08.331276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:08.331284] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:08.331294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:08.441617] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:08.470215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:08.531544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:08.531590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:08.531598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:08.531607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:08.594766] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:08.670334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:08.731867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:08.731939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:08.731948] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:08.731958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:08.764796] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043168764791, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:26:08.766163] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043168766162, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:26:08.870453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:08.932189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:08.932237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:08.932262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:08.932271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:09.070578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:09.132520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:09.132564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:09.132571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:09.132581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:09.270764] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:09.332839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:09.332886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:09.332894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:09.332924] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:09.441738] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:09.470887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:09.533163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:09.533206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:09.533213] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:09.533222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:09.595735] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:09.671032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:09.733485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:09.733527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:09.733535] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:09.733563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:09.772428] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043169772420, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:26:09.773891] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043169773888, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007726, add_bytes: 0 [2024-09-11 16:26:09.871146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:09.933802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:09.933854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:09.933864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:09.933878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:10.071257] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:10.134174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:10.134229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:10.134241] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:10.134255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:10.142763] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8494, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:26:10.275761] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4394, replace_start_pos=12000000, replace_num=100000) [2024-09-11 16:26:10.275811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:10.343051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:10.343114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:10.343122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:10.343131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:10.441848] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:10.475915] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:10.543436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:10.543483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:10.543491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:10.543500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:10.596931] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:10.676034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:10.743808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:10.743858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:10.743866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:10.743876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:10.779955] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=71] PNIO [ratelimit] time: 1726043170779950, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007530, add_bytes: 0 [2024-09-11 16:26:10.781381] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043170781379, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007491, add_bytes: 0 [2024-09-11 16:26:10.876161] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:10.944179] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:10.944228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:10.944236] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:10.944247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:11.076347] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:11.144488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:11.144534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:11.144541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:11.144550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:11.276549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:11.344872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:11.344950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=78][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:11.344961] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:11.344975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:11.442008] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=89] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:11.476675] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:11.545224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:11.545281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:11.545289] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:11.545298] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:11.598170] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:11.676859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:11.745561] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:11.745608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:11.745615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:11.745624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:11.787570] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043171787565, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:26:11.789008] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=16] PNIO [ratelimit] time: 1726043171789005, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:26:11.876999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:11.945861] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:11.945931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:11.945943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:11.945955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:12.077191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:12.146196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:12.146238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:12.146246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:12.146255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:12.153878] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7609, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:26:12.277313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:12.354208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:12.354270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:12.354283] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:12.354297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:12.442205] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:12.481752] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4320, replace_start_pos=12100000, replace_num=100000) [2024-09-11 16:26:12.481801] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:12.554628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:12.554673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:12.554682] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:12.554692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:12.599224] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:12.681930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:12.755015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:12.755060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:12.755068] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:12.755077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:12.795250] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726043172795246, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:26:12.796628] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043172796627, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:26:12.882121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:12.955376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:12.955417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:12.955425] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:12.955434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:13.082330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:13.155742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:13.155786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:13.155811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:13.155821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:13.282518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:13.356123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:13.356163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:13.356171] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:13.356181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:13.442331] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:13.464393] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:13.464430] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:13.464510] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=219, max_check_version=220, global_version=221) [2024-09-11 16:26:13.466529] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2018 [2024-09-11 16:26:13.466566] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:13.466623] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:26:13.466661] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:26:13.466745] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:13.466853] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,232 used= 76,302,780 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:26:13.466927] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:26:13.466939] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:26:13.466950] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:26:13.466987] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:26:13.467047] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:26:13.467070] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:26:13.482707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:13.556498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:13.556545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:13.556553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:13.556563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:13.600217] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:13.682932] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:13.756871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:13.756931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:13.756939] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:13.756949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:13.802802] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043173802798, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:26:13.804249] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043173804246, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:26:13.883057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:13.957189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:13.957229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:13.957237] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:13.957246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:13.957463] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=73, refresh_score_time=66, wash_time=0) [2024-09-11 16:26:14.083174] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:14.157716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:14.157761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:14.157769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:14.157778] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:14.165971] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8160, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:26:14.283356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:14.366234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:14.366278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:14.366286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:14.366295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:14.442564] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:14.483537] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:14.566548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:14.566592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:14.566600] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:14.566609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:14.601208] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:14.687095] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3366, replace_start_pos=12200000, replace_num=100000) [2024-09-11 16:26:14.687142] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:14.766934] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:14.766975] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:14.766983] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:14.766992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:14.810425] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043174810422, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:26:14.811940] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043174811937, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007691, add_bytes: 0 [2024-09-11 16:26:14.887282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:14.967298] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:14.967338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:14.967346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:14.967355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:15.087418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:15.167708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:15.167755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:15.167763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:15.167772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:15.287546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:15.368074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:15.368117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:15.368126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:15.368135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:15.442693] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:15.487676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:15.568443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:15.568485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:15.568510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:15.568520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:15.602295] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:15.687853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:15.768836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:15.768877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:15.768886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:15.768895] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:15.818049] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043175818045, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:26:15.819545] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043175819543, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:26:15.888071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=83] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:15.969226] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:15.969278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:15.969287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:15.969297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:16.088247] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:16.169546] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:16.169589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:16.169598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:16.169608] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:16.178044] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8422, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:26:16.288366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:16.378283] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:16.378316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:16.378323] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:16.378332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:16.442822] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:16.488548] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:16.578583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:16.578629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:16.578637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:16.578646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:16.603505] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:16.688664] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:16.778977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:16.779020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:16.779027] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:16.779035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:16.825668] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043176825664, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:26:16.827079] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043176827078, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007535, add_bytes: 0 [2024-09-11 16:26:16.893191] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4341, replace_start_pos=12300000, replace_num=100000) [2024-09-11 16:26:16.893240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:16.979345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:16.979393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:16.979401] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:16.979429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:17.093400] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:17.179740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:17.179789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:17.179798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:17.179808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:17.293598] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:17.380111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:17.380158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:17.380166] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:17.380176] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:17.442995] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:17.493812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:17.580479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:17.580523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:17.580531] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:17.580541] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:17.604649] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:17.693995] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:17.780864] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:17.780929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:17.780937] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:17.780961] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:17.833347] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043177833344, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:26:17.834702] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726043177834701, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:26:17.894180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:17.981198] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:17.981236] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:17.981244] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:17.981253] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:18.094294] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:18.181485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:18.181531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:18.181539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:18.181549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:18.188660] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7096, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:26:18.294410] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:18.388951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:18.388992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:18.389017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:18.389028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:18.443223] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:18.494659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:18.589331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:18.589375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:18.589383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:18.589393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:18.605695] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:18.694791] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:18.789659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:18.789705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:18.789714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:18.789725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:18.840955] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043178840951, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:26:18.842377] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043178842374, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:26:18.894940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:18.990019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:18.990062] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:18.990070] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:18.990080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:19.099531] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4411, replace_start_pos=12400000, replace_num=100000) [2024-09-11 16:26:19.099582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:19.190387] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:19.190434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:19.190443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:19.190453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:19.299752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:19.390690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:19.390739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:19.390747] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:19.390756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:19.443357] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:19.500005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:19.591067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:19.591111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:19.591120] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:19.591130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:19.606757] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:19.700134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:19.791348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:19.791385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:19.791391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:19.791399] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:19.848564] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043179848559, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:26:19.849930] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043179849928, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:26:19.900266] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:19.991710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:19.991757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:19.991766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:19.991775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:20.100388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:20.192075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:20.192120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:20.192128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:20.192138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:20.199691] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7539, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:26:20.300603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:20.400046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:20.400093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:20.400102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:20.400112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:20.443547] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:20.500732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:20.600347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:20.600392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:20.600400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:20.600409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:20.607868] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:20.700932] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:20.800642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:20.800688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:20.800696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:20.800706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:20.856117] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=71] PNIO [ratelimit] time: 1726043180856112, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:26:20.857551] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043180857548, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:26:20.901122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:21.001033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:21.001080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:21.001088] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:21.001097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:21.101306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:21.201340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:21.201384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:21.201391] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:21.201400] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:21.305129] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3638, replace_start_pos=12500000, replace_num=100000) [2024-09-11 16:26:21.305178] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:21.401745] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:21.401789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:21.401797] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:21.401807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:21.443715] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=95] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:21.505268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:21.602070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:21.602112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:21.602119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:21.602128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:21.609091] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:21.705491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:21.802372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:21.802415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:21.802423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:21.802433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:21.863737] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043181863733, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:26:21.865228] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043181865225, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007677, add_bytes: 0 [2024-09-11 16:26:21.905680] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:22.002677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:22.002739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:22.002747] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:22.002755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:22.105871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:22.203065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:22.203109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:22.203117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:22.203127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:22.211281] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8141, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:26:22.306087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:22.411627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:22.411673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:22.411681] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:22.411691] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:22.443840] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:22.506273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:22.610207] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:22.611942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:22.611973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:22.611980] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:22.611989] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:22.706462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:22.812292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:22.812337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:22.812346] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:22.812355] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:22.871361] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043182871357, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:26:22.872782] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043182872780, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:26:22.906603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:23.012585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:23.012630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:23.012637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:23.012646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:23.106721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:23.212991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:23.213038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:23.213045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:23.213055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:23.306927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:23.413292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:23.413355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:23.413363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:23.413372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:23.443975] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:23.481152] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:23.481206] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:23.481309] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=220, max_check_version=221, global_version=222) [2024-09-11 16:26:23.483340] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2030 [2024-09-11 16:26:23.483378] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:23.483413] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:26:23.483468] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:26:23.483552] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:23.483660] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,725,008 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 237,856 used= 224,576 count= 28 avg_used= 8,020 block_cnt= 28 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,725,008 used= 76,310,348 count= 1,555 avg_used= 49,074 mod=SUMMARY [2024-09-11 16:26:23.483712] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:26:23.483727] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:26:23.483738] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:26:23.483778] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:26:23.483838] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:26:23.483861] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:26:23.511471] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4338, replace_start_pos=0, replace_num=100000) [2024-09-11 16:26:23.511519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:23.611282] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:23.613606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:23.613637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:23.613645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:23.613653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:23.711673] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:23.813858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:23.813922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:23.813950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:23.813959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:23.879033] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043183879028, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:26:23.880409] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043183880407, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:26:23.911866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:24.014261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:24.014308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:24.014316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:24.014326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:24.112004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:24.214668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:24.214714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:24.214722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:24.214731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:24.223076] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8332, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:26:24.312130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:24.423406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:24.423472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:24.423481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:24.423491] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:24.444173] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:24.512319] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:24.612336] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:24.623800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:24.623842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:24.623850] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:24.623861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:24.712524] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:24.824158] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:24.824199] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:24.824207] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:24.824217] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:24.886587] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043184886583, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007555, add_bytes: 0 [2024-09-11 16:26:24.888023] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043184888020, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:26:24.912656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:25.024517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:25.024563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:25.024571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:25.024580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:25.112777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:25.224810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:25.224855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:25.224862] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:25.224871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:25.312921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:25.425176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:25.425222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:25.425230] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:25.425239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:25.444387] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:25.513039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:25.613289] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:25.625559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:25.625603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:25.625611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:25.625621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:25.717583] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4437, replace_start_pos=100000, replace_num=100000) [2024-09-11 16:26:25.717631] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:25.825942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:25.825981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:25.825989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:25.825998] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:25.894197] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043185894192, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:26:25.895630] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043185895627, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:26:25.917718] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:26.026305] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:26.026350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:26.026358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:26.026367] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:26.117841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:26.226681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:26.226726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:26.226734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:26.226744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:26.235135] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8378, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:26:26.317957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:26.435450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:26.435497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:26.435505] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:26.435514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:26.444552] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:26.518075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:26.614312] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:26.635836] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:26.635881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:26.635925] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:26.635936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:26.718259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:26.836234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:26.836289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:26.836297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:26.836307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:26.901810] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726043186901806, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:26:26.903246] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043186903243, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:26:26.918454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:27.036619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:27.036664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:27.036673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:27.036682] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:27.118593] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:27.236944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:27.236991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:27.237016] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:27.237026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:27.318774] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:27.437326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:27.437366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:27.437374] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:27.437384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:27.444689] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:27.518899] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:27.615582] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:27.637593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:27.637636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:27.637643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:27.637652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:27.719091] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:27.837881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:27.837947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:27.837955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:27.837964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:27.909431] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043187909427, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:26:27.910860] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043187910857, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:26:27.922563] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3350, replace_start_pos=200000, replace_num=100000) [2024-09-11 16:26:27.922601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:28.038304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:28.038354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:28.038361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:28.038371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:28.122707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:28.238624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:28.238668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:28.238676] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:28.238685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:28.246662] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7964, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:26:28.322830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:28.444798] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:28.447015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:28.447049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:28.447057] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:28.447066] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:28.522960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:28.616563] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:28.647304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:28.647348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:28.647355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:28.647364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:28.723126] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:28.847693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:28.847736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:28.847744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:28.847754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:28.917040] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043188917037, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:26:28.918478] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043188918475, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:26:28.923312] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:29.048070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:29.048117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:29.048126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:29.048136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:29.123417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:29.248449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:29.248493] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:29.248501] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:29.248510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:29.323525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:29.444931] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:29.448813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:29.448848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:29.448856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:29.448865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:29.523817] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=134] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:29.617595] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:29.649162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:29.649207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:29.649215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:29.649225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:29.724007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:29.849528] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:29.849574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:29.849582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:29.849592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:29.924132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:29.924663] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043189924660, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:26:29.926090] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726043189926088, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:26:30.049845] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:30.049891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:30.049899] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:30.049928] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:30.127617] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3379, replace_start_pos=300000, replace_num=100000) [2024-09-11 16:26:30.127661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:30.250233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:30.250278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:30.250286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:30.250295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:30.258272] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7963, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:26:30.327746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:30.445121] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:30.458611] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:30.458656] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:30.458665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:30.458675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:30.527935] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:30.618673] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:30.659001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:30.659043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:30.659051] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:30.659060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:30.728064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:30.859359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:30.859405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:30.859430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:30.859440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:30.928187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:30.932269] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043190932267, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:26:30.933767] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043190933764, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:26:31.059740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:31.059784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:31.059792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:31.059802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:31.128308] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:31.260101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:31.260146] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:31.260154] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:31.260164] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:31.328487] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:31.445340] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:31.460411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:31.460470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:31.460478] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:31.460487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:31.528703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:31.619597] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:31.660788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:31.660835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:31.660844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:31.660854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:31.728829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:31.861090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:31.861149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:31.861180] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:31.861191] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:31.928958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:31.939959] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043191939955, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:26:31.941401] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043191941398, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:26:32.061436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:32.061480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:32.061488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:32.061497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:32.129083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:32.261799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:32.261855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:32.261864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:32.261873] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:32.270068] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8180, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:26:32.332508] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3315, replace_start_pos=400000, replace_num=100000) [2024-09-11 16:26:32.332553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:32.445532] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:32.470337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:32.470376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:32.470384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:32.470393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:32.470577] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:26:32.532703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:32.620763] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=97] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:32.670891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:32.670953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:32.670960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:32.670970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:32.732839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:32.871304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:32.871345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:32.871354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:32.871380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:32.932960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:32.947555] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043192947549, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:26:32.949004] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043192949001, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:26:33.071682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:33.071727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:33.071735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:33.071744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:33.133151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:33.272082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:33.272128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:33.272136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:33.272145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:33.333325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:33.445669] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:33.472416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:33.472464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:33.472475] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:33.472511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:33.498559] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:33.498609] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:33.498686] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=221, max_check_version=222, global_version=223) [2024-09-11 16:26:33.500837] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2150 [2024-09-11 16:26:33.500872] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:33.500927] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:26:33.500966] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:26:33.501061] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:33.501162] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:26:33.501211] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:26:33.501222] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:26:33.501235] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:26:33.501270] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:26:33.501326] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:26:33.501347] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:26:33.533461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:33.621678] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:33.672824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:33.672870] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:33.672879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:33.672888] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:33.733733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:33.873211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:33.873258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:33.873266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:33.873276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:33.933873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:33.955191] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043193955187, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007638, add_bytes: 0 [2024-09-11 16:26:33.956556] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043193956553, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:26:34.073627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:34.073676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:34.073684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:34.073694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:34.134121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=81] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:34.274024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:34.274068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:34.274075] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:34.274084] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:34.274300] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=77, refresh_score_time=63, wash_time=0) [2024-09-11 16:26:34.281088] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6775, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:26:34.334306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:34.445849] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:34.481400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:34.481443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:34.481451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:34.481480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:34.538866] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4371, replace_start_pos=500000, replace_num=100000) [2024-09-11 16:26:34.538923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:34.622555] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:34.681792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:34.681833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:34.681841] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:34.681850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:34.739075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:34.882164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:34.882211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:34.882219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:34.882228] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:34.939291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:34.962750] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043194962746, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007559, add_bytes: 0 [2024-09-11 16:26:34.964229] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043194964228, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:26:35.082607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:35.082648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:35.082657] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:35.082667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:35.139478] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:35.283009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:35.283074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:35.283083] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:35.283093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:35.339603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:35.446081] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:35.483393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:35.483437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:35.483445] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:35.483454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:35.539821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:35.623705] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:35.683775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:35.683818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:35.683826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:35.683836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:35.740010] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:35.884083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:35.884128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:35.884135] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:35.884144] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:35.940149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:35.970375] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043195970370, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:26:35.971847] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043195971845, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:26:36.084381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:36.084413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:36.084420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:36.084429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:36.140381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:36.284736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:36.284781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:36.284789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:36.284798] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:36.293331] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8519, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:26:36.340573] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:36.446229] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:36.493715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:36.493759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:36.493768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:36.493778] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:36.540767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:36.624998] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:36.694086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:36.694134] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:36.694142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:36.694151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:36.745396] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4420, replace_start_pos=600000, replace_num=100000) [2024-09-11 16:26:36.745446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:36.894472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:36.894529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:36.894543] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:36.894554] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:36.945527] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:36.977978] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043196977975, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:26:36.979463] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043196979461, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:26:37.094788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:37.094833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:37.094839] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:37.094846] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:37.145634] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:37.295084] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:37.295130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:37.295137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:37.295147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:37.345741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:37.446415] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:37.495474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:37.495541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:37.495550] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:37.495559] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:37.545854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:37.626005] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:37.695799] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:37.695844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:37.695852] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:37.695861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:37.745974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:37.896098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:37.896139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:37.896148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:37.896157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:37.946099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:37.985656] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043197985651, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:26:37.987030] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043197987028, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:26:38.096357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:38.096400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:38.096430] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:38.096437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:38.146220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:38.296684] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:38.296728] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:38.296736] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:38.296744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:38.303729] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6972, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:26:38.346322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:38.446535] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:38.504089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:38.504128] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:38.504136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:38.504145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:38.546438] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:38.627082] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:38.704359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:38.704403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:38.704410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:38.704419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:38.746559] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:38.904675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:38.904719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:38.904745] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:38.904754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:38.951052] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4375, replace_start_pos=700000, replace_num=100000) [2024-09-11 16:26:38.951102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:38.993204] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043198993200, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:26:38.994633] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043198994631, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:26:39.105093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:39.105137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:39.105145] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:39.105155] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:39.151187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:39.305385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:39.305429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:39.305435] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:39.305443] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:39.351389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:39.446717] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:39.505787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:39.505832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:39.505840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:39.505850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:39.551520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:39.628333] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:39.706157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:39.706208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:39.706216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:39.706225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:39.751655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:39.906466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:39.906507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:39.906515] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:39.906523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:39.951783] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:40.000889] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043200000884, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:26:40.002260] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=14] PNIO [ratelimit] time: 1726043200002259, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:26:40.106772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:40.106816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:40.106824] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:40.106834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:40.151977] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:40.307089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:40.307133] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:40.307142] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:40.307151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:40.315711] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8545, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:26:40.352108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:40.447077] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:40.516070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:40.516111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:40.516118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:40.516126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:40.552228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:40.629505] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:40.716424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:40.716470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:40.716478] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:40.716488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:40.752350] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:40.916807] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:40.916858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:40.916867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:40.916876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:40.952542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:41.008444] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1726043201008440, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:26:41.009928] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043201009925, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:26:41.117163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:41.117208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:41.117216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:41.117225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:41.157061] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4392, replace_start_pos=800000, replace_num=100000) [2024-09-11 16:26:41.157110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:41.317525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:41.317571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:41.317579] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:41.317588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:41.357194] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:41.447241] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=83] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:41.517850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:41.517893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:41.517923] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:41.517950] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:41.557395] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:41.630515] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=117] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:41.718186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:41.718234] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:41.718259] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:41.718268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:41.757604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:41.918518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:41.918580] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:41.918587] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:41.918595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:41.957729] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:42.016070] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043202016065, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:26:42.017493] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043202017490, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 16:26:42.118887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:42.118945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:42.118951] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:42.118959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:42.157930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:42.319281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:42.319326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:42.319355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:42.319364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:42.326074] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6696, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:26:42.358179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:42.447415] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:42.526346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:42.526388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:42.526395] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:42.526404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:42.558301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:42.631347] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:42.726774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:42.726818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:42.726826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:42.726835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:42.758480] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:42.927069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:42.927107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:42.927114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:42.927123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:42.958598] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:43.023733] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043203023730, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:26:43.025157] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043203025155, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:26:43.127422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:43.127466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:43.127474] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:43.127484] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:43.158702] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:43.327717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:43.327759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:43.327767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:43.327776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:43.362179] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3370, replace_start_pos=900000, replace_num=100000) [2024-09-11 16:26:43.362214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:43.447540] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:43.516183] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:43.516256] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=71] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:43.516409] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] update_check_range(min_check_version=222, max_check_version=223, global_version=224) [2024-09-11 16:26:43.518505] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2095 [2024-09-11 16:26:43.518553] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:43.518588] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:26:43.518626] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:26:43.518709] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:43.518815] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 10 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:26:43.518869] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:26:43.518881] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:26:43.518892] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:26:43.518939] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:26:43.519006] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:26:43.519025] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:26:43.528053] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:43.528079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:43.528086] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:43.528093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:43.562297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:43.632188] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:43.728379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:43.728423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:43.728432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:43.728441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:43.762477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:43.928736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:43.928781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:43.928789] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:43.928799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:43.962598] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:44.031349] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726043204031346, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:26:44.032780] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043204032778, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:26:44.129026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:44.129074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:44.129080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:44.129088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:44.162771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:44.329319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:44.329353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:44.329360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:44.329369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:44.337257] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7876, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:26:44.362897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:44.447709] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:44.537550] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:44.537591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:44.537598] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:44.537607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:44.563074] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:44.633045] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:44.737940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:44.737981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:44.737988] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:44.737997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:44.763183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:44.938282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:44.938318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:44.938326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:44.938336] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:44.963313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:45.038915] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043205038912, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:26:45.040393] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043205040391, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:26:45.138565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:45.138600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:45.138608] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:45.138616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:45.163418] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:45.338921] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:45.338957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:45.338965] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:45.338974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:45.363578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:45.447885] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:45.539207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:45.539249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:45.539257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:45.539267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:45.568111] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4416, replace_start_pos=1000000, replace_num=100000) [2024-09-11 16:26:45.568155] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:45.633893] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:45.739489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:45.739532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:45.739539] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:45.739549] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:45.768297] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:45.939778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:45.939819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:45.939827] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:45.939837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:45.968408] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:46.046521] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043206046517, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:26:46.048004] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043206048001, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:26:46.140130] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:46.140175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:46.140183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:46.140193] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:46.168595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:46.340491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:46.340533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:46.340541] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:46.340551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:46.349133] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8569, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:26:46.368717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:46.448113] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=95] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:46.549436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:46.549477] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:46.549485] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:46.549495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:46.568822] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:46.635139] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=107] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:46.749805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:46.749848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:46.749856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:46.749866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:46.768962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:46.950100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:46.950137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:46.950144] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:46.950163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:46.969129] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:47.054194] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043207054190, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:26:47.055569] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043207055568, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:26:47.150464] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:47.150501] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:47.150509] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:47.150518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:47.169303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:47.350733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:47.350771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:47.350779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:47.350789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:47.369470] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:47.448224] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:47.551032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:47.551074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:47.551081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:47.551108] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:47.569577] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:47.636680] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=657] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:47.751406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:47.751465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:47.751473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:47.751482] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:47.774007] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4238, replace_start_pos=1100000, replace_num=100000) [2024-09-11 16:26:47.774042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:47.951717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:47.951753] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:47.951761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:47.951770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:47.974185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:48.061745] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043208061742, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:26:48.063245] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726043208063242, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:26:48.151998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:48.152035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:48.152043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:48.152052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:48.174359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:48.352278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:48.352330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:48.352338] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:48.352348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:48.360393] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8032, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:26:48.374525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:48.448326] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=31] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:48.560636] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:48.560685] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:48.560693] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:48.560703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:48.574691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:48.637635] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:48.760949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:48.760993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:48.761001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:48.761010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:48.774877] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:48.961247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:48.961284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:48.961292] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:48.961301] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:48.975015] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:49.069417] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043209069413, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:26:49.070799] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043209070796, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:26:49.161531] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:49.161574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:49.161582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:49.161591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:49.175236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:49.361832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:49.361878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:49.361887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:49.361898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:49.375406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:49.448500] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:49.562151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:49.562207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:49.562216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:49.562225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:49.575518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:49.638366] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:49.762459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:49.762510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:49.762517] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:49.762526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:49.775733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:49.962782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:49.962825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:49.962832] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:49.962842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:49.980257] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4393, replace_start_pos=1200000, replace_num=100000) [2024-09-11 16:26:49.980307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:50.076979] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043210076974, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:26:50.078477] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043210078474, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:26:50.163082] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:50.163129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:50.163137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:50.163146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:50.180472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:50.363376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:50.363423] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:50.363429] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:50.363453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:50.370132] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6667, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:26:50.380679] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:50.448632] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:50.570382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:50.570426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:50.570433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:50.570440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:50.580804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:50.639356] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:50.770681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:50.770726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:50.770733] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:50.770741] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:50.780922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:50.971055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:50.971098] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:50.971105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:50.971112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:50.981039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:51.084677] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043211084673, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007699, add_bytes: 0 [2024-09-11 16:26:51.086041] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043211086040, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:26:51.171356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:51.171420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:51.171428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:51.171437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:51.181149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:51.371742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:51.371785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:51.371793] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:51.371803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:51.381254] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:51.448791] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=81] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:51.572032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:51.572075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:51.572081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:51.572089] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:51.581358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:51.640475] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:51.772328] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:51.772373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:51.772380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:51.772389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:51.781459] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:51.972683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:51.972744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:51.972752] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:51.972762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:51.981558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:52.092306] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043212092302, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:26:52.093731] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043212093728, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007688, add_bytes: 0 [2024-09-11 16:26:52.173119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:52.173166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:52.173174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:52.173184] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:52.185889] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4219, replace_start_pos=1300000, replace_num=100000) [2024-09-11 16:26:52.185943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:52.373433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:52.373476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:52.373484] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:52.373493] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:52.381553] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8045, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:26:52.386089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:52.448917] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:52.581844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:52.581889] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:52.581897] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:52.581929] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:52.586189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:52.641486] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:52.782181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:52.782224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:52.782231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:52.782240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:52.786286] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:52.982485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:52.982527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:52.982534] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:52.982543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:52.986391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:53.099847] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726043213099843, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007541, add_bytes: 0 [2024-09-11 16:26:53.101272] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=91] PNIO [ratelimit] time: 1726043213101270, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:26:53.182773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:53.182819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:53.182825] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:53.182850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:53.186489] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:53.383066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:53.383104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:53.383110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:53.383117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:53.386617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:53.449062] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:53.532961] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:53.533015] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:26:53.533098] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=223, max_check_version=224, global_version=225) [2024-09-11 16:26:53.535110] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2012 [2024-09-11 16:26:53.535142] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:53.535192] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:26:53.535224] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:26:53.535298] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:26:53.535380] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,232 used= 76,302,780 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:26:53.535428] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:26:53.535438] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:26:53.535446] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:26:53.535477] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:26:53.535525] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:26:53.535547] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:26:53.583353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:53.583424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:53.583432] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:53.583440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:53.586785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:53.642500] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:53.783692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:53.783738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:53.783746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:53.783754] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:53.786978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:53.984072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:53.984115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:53.984123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:53.984133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:53.987076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:54.107447] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043214107444, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:26:54.108953] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043214108949, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:26:54.184356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:54.184398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:54.184404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:54.184412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:54.187172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:54.384720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:54.384768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:54.384776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:54.384786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:54.391614] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4311, replace_start_pos=1400000, replace_num=100000) [2024-09-11 16:26:54.391657] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:54.391690] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6891, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:26:54.449177] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:54.591739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:54.591936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:54.591968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:54.591974] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:54.591982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:54.592155] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash time detail, (compute_wash_size_time=58, refresh_score_time=57, wash_time=0) [2024-09-11 16:26:54.643516] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:54.791816] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:54.792354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:54.792374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:54.792379] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:54.792387] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:54.991944] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:54.992607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:54.992629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:54.992654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:54.992663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:55.115143] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043215115139, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 16:26:55.116505] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043215116503, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:26:55.192071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:55.192877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:55.192894] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:55.192917] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:55.192926] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:55.392197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:55.393154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:55.393175] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:55.393183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:55.393192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:55.449308] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:55.592321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:55.593418] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:55.593440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:55.593466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:55.593476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:55.644689] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:55.792513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:55.793689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:55.793714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:55.793721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:55.793730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:55.992746] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:55.993963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:55.993988] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:55.993994] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:55.994002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:56.122672] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043216122668, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007529, add_bytes: 0 [2024-09-11 16:26:56.124196] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043216124193, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:26:56.192860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:56.194222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:56.194245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:56.194252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:56.194261] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:56.393110] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:56.394530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:56.394583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:56.394590] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:56.394599] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:56.401807] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7195, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:26:56.449452] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:56.597800] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4544, replace_start_pos=1500000, replace_num=100000) [2024-09-11 16:26:56.597847] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:56.602050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:56.602091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:56.602097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:56.602105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:56.645857] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:56.797938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:56.802402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:56.802440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:56.802448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:56.802458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:56.998128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:57.002788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:57.002835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:57.002844] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:57.002854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:57.130313] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043217130309, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2024-09-11 16:26:57.131734] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043217131731, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007538, add_bytes: 0 [2024-09-11 16:26:57.198253] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:57.203123] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:57.203161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:57.203168] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:57.203178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:57.398381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:57.403416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:57.403452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:57.403459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:57.403468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:57.449651] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:57.598566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:57.603732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:57.603770] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:57.603777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:57.603786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:57.646878] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=100] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:57.798751] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:26:57.804067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:57.804104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:57.804112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:57.804137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:57.998884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:26:58.004438] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:58.004485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:58.004493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:58.004508] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:58.137973] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726043218137969, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007660, add_bytes: 0 [2024-09-11 16:26:58.139355] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=371] PNIO [ratelimit] time: 1726043218139353, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:26:58.199012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:26:58.204830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:58.204881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:58.204893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:58.204932] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:58.399143] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:26:58.405242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:58.405286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:58.405294] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:58.405304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:58.412714] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7378, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:26:58.449763] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:58.599268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:26:58.613070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:58.613117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:58.613125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:58.613135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:58.647948] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:58.802795] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3397, replace_start_pos=1600000, replace_num=100000) [2024-09-11 16:26:58.802836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:26:58.813431] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:58.813474] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:58.813481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:58.813488] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:59.002930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:26:59.013785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:59.013830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:59.013838] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:59.013848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:59.145547] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043219145541, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007572, add_bytes: 0 [2024-09-11 16:26:59.146977] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043219146974, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:26:59.203060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:26:59.214144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:59.214190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:59.214198] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:59.214207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:59.403250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:26:59.414502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:59.414545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:59.414553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:59.414563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:59.449918] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:26:59.603389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:26:59.614784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:59.614829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:59.614835] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:59.614843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:26:59.649041] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:26:59.803574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:26:59.815132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:26:59.815174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:26:59.815183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:26:59.815192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:00.003762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:00.015513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:00.015555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:00.015563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:00.015572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:00.142641] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:27:00.148701] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:27:00.153207] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043220153204, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:27:00.153248] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:27:00.154651] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043220154650, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:27:00.154674] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:27:00.203979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:00.215819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:00.215865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:00.215873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:00.215882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:00.404114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:00.416112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:00.416155] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:00.416181] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:00.416190] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:00.423702] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7499, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:27:00.450145] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:00.604298] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:00.624071] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:00.624117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:00.624126] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:00.624135] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:00.650213] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:00.804430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:00.824363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:00.824407] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:00.824413] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:00.824420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:01.009012] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4406, replace_start_pos=1700000, replace_num=100000) [2024-09-11 16:27:01.009056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:01.024715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:01.024760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:01.024768] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:01.024776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:01.160832] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726043221160829, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:27:01.162196] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726043221162195, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:27:01.209209] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:01.225083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:01.225129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:01.225138] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:01.225147] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:01.409393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:01.425452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:01.425492] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:01.425500] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:01.425510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:01.450300] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=76] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:01.609601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:01.625742] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:01.625785] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:01.625792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:01.625799] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:01.651520] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:01.809722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:01.826061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:01.826106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:01.826113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:01.826122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:02.009926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:02.026437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:02.026479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:02.026487] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:02.026496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:02.168378] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726043222168374, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:27:02.169815] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043222169813, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:27:02.210066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:02.226788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:02.226830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:02.226837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:02.226845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:02.410197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:02.427096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:02.427139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:02.427147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:02.427157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:02.434897] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7724, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:27:02.450542] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:02.610389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:02.635246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:02.635292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:02.635300] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:02.635310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:02.635503] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:27:02.652756] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:02.810579] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:02.835876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:02.835947] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:02.835957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:02.835967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:03.010796] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:03.036269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:03.036314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:03.036322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:03.036331] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:03.176008] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726043223176003, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:27:03.177431] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=172] PNIO [ratelimit] time: 1726043223177429, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:27:03.214399] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3384, replace_start_pos=1800000, replace_num=100000) [2024-09-11 16:27:03.214444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:03.236628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:03.236674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:03.236683] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:03.236692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:03.414622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:03.437022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:03.437063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:03.437071] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:03.437081] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:03.450678] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:03.549114] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:03.549166] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:03.549252] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=224, max_check_version=225, global_version=226) [2024-09-11 16:27:03.551275] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2023 [2024-09-11 16:27:03.551341] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:03.551379] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:27:03.551417] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:27:03.551500] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:03.551608] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:27:03.551665] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:27:03.551676] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:27:03.551687] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:27:03.551724] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:27:03.551784] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:27:03.551806] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:27:03.614757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:03.637330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:03.637380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:03.637388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:03.637397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:03.653787] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:03.814950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:03.837645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:03.837690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:03.837698] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:03.837706] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:04.015137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:04.038055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:04.038101] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:04.038109] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:04.038119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:04.183622] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043224183618, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:27:04.185045] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043224185044, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:27:04.215366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:04.238422] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:04.238468] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:04.238495] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:04.238506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:04.415505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:04.438809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:04.438852] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:04.438860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:04.438870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:04.447414] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8530, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:27:04.450867] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:04.615691] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:04.647744] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:04.647789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:04.647797] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:04.647807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:04.654918] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:04.815829] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:04.848104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:04.848144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:04.848150] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:04.848159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:05.015965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:05.048399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:05.048443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:05.048468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:05.048478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:05.191288] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043225191284, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:27:05.192668] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043225192667, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:27:05.216153] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:05.248794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:05.248840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:05.248848] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:05.248857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:05.419660] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3375, replace_start_pos=1900000, replace_num=100000) [2024-09-11 16:27:05.419709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:05.449104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:05.449153] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:05.449161] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:05.449171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:05.451003] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:05.619881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:05.649402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:05.649441] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:05.649448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:05.649456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:05.656012] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:05.820047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:05.849760] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:05.849803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:05.849811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:05.849821] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:06.020176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:06.050066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:06.050108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:06.050116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:06.050125] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:06.198923] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043226198918, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:27:06.200261] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043226200259, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007592, add_bytes: 0 [2024-09-11 16:27:06.220311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:06.250347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:06.250391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:06.250397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:06.250405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:06.420457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:06.450652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:06.450696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:06.450704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:06.450713] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:06.451192] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:06.459122] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8396, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:27:06.620592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:06.657209] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:06.659363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:06.659392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:06.659398] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:06.659405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:06.820850] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:06.859713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:06.859758] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:06.859766] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:06.859776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:07.020973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:07.060038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:07.060081] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:07.060089] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:07.060098] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:07.206473] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043227206470, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:27:07.207889] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043227207887, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:27:07.221108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:07.260346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:07.260397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:07.260403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:07.260411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:07.421235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:07.451321] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:07.460710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:07.460749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:07.460757] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:07.460766] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:07.625430] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4016, replace_start_pos=2000000, replace_num=100000) [2024-09-11 16:27:07.625473] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:07.658450] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:07.661020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:07.661045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:07.661052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:07.661061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:07.825564] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:07.861301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:07.861346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:07.861371] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:07.861380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:08.025688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:08.061681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:08.061726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:08.061734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:08.061744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:08.214087] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726043228214083, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:27:08.215507] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043228215505, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:27:08.225861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:08.262091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:08.262135] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:08.262143] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:08.262151] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:08.426012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:08.451448] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:08.462463] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:08.462527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:08.462535] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:08.462544] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:08.471106] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8548, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:27:08.626141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:08.659806] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:08.671433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:08.671479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:08.671488] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:08.671497] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:08.826260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:08.871741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:08.871786] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:08.871794] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:08.871803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:09.026383] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:09.072107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:09.072155] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:09.072163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:09.072174] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:09.221702] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043229221699, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:27:09.223131] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043229223130, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:27:09.226509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:09.272429] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:09.272473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:09.272481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:09.272490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:09.426617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:09.451577] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:09.472715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:09.472757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:09.472763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:09.472772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:09.626741] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:09.661034] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:09.673018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:09.673061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:09.673069] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:09.673078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:09.830322] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3343, replace_start_pos=2100000, replace_num=100000) [2024-09-11 16:27:09.830369] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:09.873388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:09.873434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:09.873443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:09.873453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:10.030516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:10.073724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:10.073764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:10.073772] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:10.073781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:10.229315] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043230229312, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:27:10.230643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:10.230793] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043230230791, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 16:27:10.274044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:10.274090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:10.274096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:10.274103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:10.430745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=23] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:10.451689] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:10.474334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:10.474378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:10.474384] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:10.474392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:10.481526] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7106, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:27:10.630873] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:10.662335] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:10.681828] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:10.681872] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:10.681900] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:10.681931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:10.831014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:10.882230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:10.882275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:10.882284] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:10.882293] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:11.031193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:11.082518] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:11.082562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:11.082568] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:11.082576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:11.231413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:11.236984] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043231236980, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:27:11.238353] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043231238351, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:27:11.282826] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:11.282873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:11.282929] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:11.282941] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:11.431628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:11.451893] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:11.483248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:11.483291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:11.483297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:11.483305] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:11.631739] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:11.663612] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:11.683543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:11.683586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:11.683594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:11.683603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:11.831860] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:11.883835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:11.883887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:11.883893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:11.883924] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:12.036496] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4390, replace_start_pos=2200000, replace_num=100000) [2024-09-11 16:27:12.036541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:12.084151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:12.084217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:12.084224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:12.084231] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:12.236694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:12.244598] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043232244595, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:27:12.246021] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043232246019, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007668, add_bytes: 0 [2024-09-11 16:27:12.284455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:12.284489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:12.284496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:12.284505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:12.436846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:12.452037] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:12.484855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:12.484898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:12.484922] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:12.484930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:12.491482] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6540, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:27:12.637112] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:12.664616] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:12.691741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:12.691787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:12.691795] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:12.691803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:12.837326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:12.892065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:12.892111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:12.892118] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:12.892127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:13.037528] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:13.092369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:13.092415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:13.092423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:13.092432] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:13.237655] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:13.252212] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043233252207, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:27:13.253582] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043233253581, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:27:13.292660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:13.292705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:13.292714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:13.292723] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:13.437776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:13.452177] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:13.492994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:13.493047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:13.493053] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:13.493060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:13.567013] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:13.567066] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:13.567151] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=225, max_check_version=226, global_version=227) [2024-09-11 16:27:13.569155] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2004 [2024-09-11 16:27:13.569188] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:13.569223] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:27:13.569283] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:27:13.569368] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:13.569495] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:27:13.569554] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:27:13.569570] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:27:13.569581] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:27:13.569617] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:27:13.569677] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:27:13.569700] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:27:13.637916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:13.665390] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:13.693289] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:13.693334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:13.693342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:13.693351] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:13.838044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:13.893590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:13.893654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:13.893663] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:13.893672] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:14.038233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:14.093927] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:14.093970] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:14.093978] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:14.093986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:14.242310] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3887, replace_start_pos=2300000, replace_num=100000) [2024-09-11 16:27:14.242350] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:14.259838] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043234259835, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:27:14.261269] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043234261267, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:27:14.294280] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:14.294325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:14.294333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:14.294343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:14.442499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:14.452298] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:14.494669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:14.494710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:14.494718] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:14.494727] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:14.501636] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6894, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:27:14.642684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:14.666763] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:14.701993] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:14.702037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:14.702046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:14.702055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:14.842874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:14.902362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:14.902421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:14.902433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:14.902447] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:14.902664] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=15] Wash time detail, (compute_wash_size_time=107, refresh_score_time=63, wash_time=0) [2024-09-11 16:27:15.043015] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:15.102890] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:15.102939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:15.102945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:15.102952] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:15.243136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:15.267449] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043235267445, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:27:15.268815] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043235268813, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:27:15.303190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:15.303240] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:15.303247] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:15.303255] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:15.443262] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:15.452513] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:15.503498] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:15.503544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:15.503552] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:15.503561] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:15.643376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:15.668080] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:15.703802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:15.703844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:15.703851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:15.703861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:15.843491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:15.904203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:15.904245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:15.904253] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:15.904276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:16.043644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:16.104543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:16.104590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:16.104597] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:16.104607] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:16.243735] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:16.275087] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043236275082, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007637, add_bytes: 0 [2024-09-11 16:27:16.276499] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043236276497, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:27:16.304820] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:16.304848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:16.304854] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:16.304862] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:16.448255] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4397, replace_start_pos=2400000, replace_num=100000) [2024-09-11 16:27:16.448296] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:16.452732] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:16.505163] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:16.505206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:16.505229] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:16.505239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:16.512814] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7561, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:27:16.648384] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:16.669366] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:16.713077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:16.713120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:16.713128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:16.713137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:16.848520] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:16.913437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:16.913483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:16.913491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:16.913501] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:17.048653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:17.113733] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:17.113778] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:17.113786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:17.113795] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:17.248781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:17.282682] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1726043237282678, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:27:17.284109] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043237284107, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:27:17.314066] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:17.314111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:17.314119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:17.314128] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:17.448926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:17.452923] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:17.514360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:17.514406] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:17.514414] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:17.514424] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:17.649116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:17.670586] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:17.714655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:17.714703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:17.714709] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:17.714716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:17.849246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:17.914965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:17.915005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:17.915011] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:17.915019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:18.049445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:18.115332] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:18.115380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:18.115388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:18.115398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:18.249608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=85] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:18.290313] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043238290308, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:27:18.291672] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043238291669, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:27:18.315622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:18.315664] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:18.315671] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:18.315678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:18.449825] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:18.453027] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:18.515955] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:18.516001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:18.516008] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:18.516016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:18.523681] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7652, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:27:18.654397] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4385, replace_start_pos=2500000, replace_num=100000) [2024-09-11 16:27:18.654448] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:18.671624] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:18.724059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:18.724105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:18.724136] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:18.724145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:18.854547] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:18.924373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:18.924416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:18.924423] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:18.924431] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:19.054734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:19.124717] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:19.124761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:19.124767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:19.124775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:19.254863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:19.297862] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043239297858, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:27:19.299270] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043239299267, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:27:19.325034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:19.325076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:19.325098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:19.325106] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:19.453160] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:19.455064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:19.525408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:19.525457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:19.525465] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:19.525474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:19.655185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:19.672796] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:19.725781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:19.725825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:19.725833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:19.725842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:19.855322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:19.926072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:19.926117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:19.926123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:19.926132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:20.055450] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:20.126365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:20.126414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:20.126422] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:20.126451] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:20.255595] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:20.305541] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726043240305536, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:27:20.306886] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043240306883, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:27:20.326943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:20.326990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:20.326996] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:20.327004] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:20.453349] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:20.455778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:20.527256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:20.527295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:20.527302] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:20.527311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:20.534244] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6917, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:27:20.655923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:20.674186] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:20.734505] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:20.734553] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:20.734560] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:20.734569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:20.860031] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3875, replace_start_pos=2600000, replace_num=100000) [2024-09-11 16:27:20.860096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:20.934886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:20.934956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:20.934964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:20.934973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:21.060240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:21.135223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:21.135271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:21.135278] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:21.135287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:21.260458] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:21.313095] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043241313090, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:27:21.314502] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043241314500, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:27:21.335590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:21.335632] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:21.335640] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:21.335650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:21.453564] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:21.460581] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:21.535969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:21.536014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:21.536025] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:21.536035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:21.660772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:21.675391] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:21.736334] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:21.736379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:21.736387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:21.736398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:21.860924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:21.936616] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:21.936659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:21.936665] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:21.936673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:22.061042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:22.136928] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:22.136968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:22.136976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:22.136985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:22.261180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:22.320694] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=151] PNIO [ratelimit] time: 1726043242320689, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:27:22.322128] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043242322127, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007627, add_bytes: 0 [2024-09-11 16:27:22.337245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:22.337288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:22.337295] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:22.337304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:22.453714] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:22.461321] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:22.537517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:22.537556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:22.537562] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:22.537570] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:22.544135] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6553, clean_start_pos=0, clean_num=200000) [2024-09-11 16:27:22.661519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:22.676290] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:22.744408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:22.744455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:22.744462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:22.744470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:22.861701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:22.944710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:22.944750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:22.944758] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:22.944787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:23.066176] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4290, replace_start_pos=2700000, replace_num=100000) [2024-09-11 16:27:23.066217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:23.145033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:23.145069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:23.145074] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:23.145082] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:23.266365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:23.328329] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043243328325, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007636, add_bytes: 0 [2024-09-11 16:27:23.329732] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=248] PNIO [ratelimit] time: 1726043243329730, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:27:23.345300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:23.345335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:23.345341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:23.345349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:23.453843] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:23.466545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:23.545648] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:23.545712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:23.545720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:23.545729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:23.585150] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:23.585205] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:23.585289] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=226, max_check_version=227, global_version=228) [2024-09-11 16:27:23.587357] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2068 [2024-09-11 16:27:23.587395] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:23.587431] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:27:23.587474] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:27:23.587582] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:23.587690] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:27:23.587743] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:27:23.587754] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:27:23.587769] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:27:23.587807] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:27:23.587867] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:27:23.587889] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:27:23.666732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:23.677260] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:23.746011] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:23.746057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:23.746065] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:23.746074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:23.866854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:23.946324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:23.946369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:23.946377] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:23.946386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:24.067048] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:24.146725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:24.146771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:24.146779] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:24.146788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:24.267238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:24.335994] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043244335990, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007665, add_bytes: 0 [2024-09-11 16:27:24.337347] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043244337345, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:27:24.347055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:24.347091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:24.347098] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:24.347107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:24.453964] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:24.467397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:24.547353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:24.547401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:24.547416] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:24.547425] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:24.554493] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7032, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:27:24.667610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:24.678393] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:24.754804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:24.754848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:24.754873] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:24.754882] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:24.867727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:24.955143] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:24.955187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:24.955195] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:24.955204] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:25.067897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:25.155433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:25.155476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:25.155483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:25.155490] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:25.272399] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4352, replace_start_pos=2800000, replace_num=100000) [2024-09-11 16:27:25.272441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:25.343554] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043245343550, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:27:25.344964] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043245344961, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:27:25.355721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:25.355789] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:25.355797] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:25.355806] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:25.454111] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:25.472591] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:25.556129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:25.556177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:25.556185] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:25.556194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:25.672788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:25.679399] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:25.756500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:25.756547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:25.756556] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:25.756565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:25.872988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:25.956805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:25.956848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:25.956856] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:25.956865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:26.073113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:26.157159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:26.157217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:26.157224] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:26.157232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:26.273303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:26.351220] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043246351216, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:27:26.352585] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043246352583, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:27:26.357480] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:26.357515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:26.357522] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:26.357531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:26.454258] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:26.473516] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:26.557773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:26.557819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:26.557826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:26.557835] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:26.565108] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7259, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:27:26.673709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:26.680652] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:26.765394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:26.765439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:26.765447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:26.765456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:26.873862] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:26.965677] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:26.965713] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:26.965724] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:26.965734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:27.074013] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:27.166044] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:27.166090] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:27.166101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:27.166115] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:27.274140] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:27.358884] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043247358879, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007663, add_bytes: 0 [2024-09-11 16:27:27.360197] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043247360195, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:27:27.366339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:27.366369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:27.366375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:27.366383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:27.454396] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:27.478599] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4340, replace_start_pos=2900000, replace_num=100000) [2024-09-11 16:27:27.478639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:27.566635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:27.566681] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:27.566688] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:27.566697] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:27.678730] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:27.681598] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:27.766973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:27.767019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:27.767026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:27.767036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:27.878841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:27.967279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:27.967319] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:27.967326] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:27.967335] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:28.078966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:28.167574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:28.167615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:28.167622] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:28.167631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:28.279171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:28.366450] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=74] PNIO [ratelimit] time: 1726043248366446, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:27:28.367812] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=568] PNIO [ratelimit] time: 1726043248367810, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:27:28.367962] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:28.367990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:28.367997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:28.368005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:28.454521] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:28.479359] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:28.568302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:28.568347] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:28.568355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:28.568365] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:28.576932] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8554, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:27:28.679496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:28.682837] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:28.777193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:28.777238] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:28.777245] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:28.777254] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:28.879616] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:28.977503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:28.977568] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:28.977576] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:28.977585] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:29.079750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:29.177891] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:29.177961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:29.177968] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:29.177977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:29.279888] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:29.374081] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043249374078, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:27:29.375428] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043249375427, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:27:29.378229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:29.378261] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:29.378268] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:29.378277] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:29.454733] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:29.480094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:29.578628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:29.578689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:29.578696] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:29.578705] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:29.683596] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3364, replace_start_pos=3000000, replace_num=100000) [2024-09-11 16:27:29.683644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:29.683995] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=106] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:29.778987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:29.779033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:29.779040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:29.779049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:29.883726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:29.979279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:29.979325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:29.979332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:29.979341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:30.083937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:30.179642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:30.179687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:30.179694] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:30.179702] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:30.284076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:30.379978] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:30.380049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:30.380058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:30.380067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:30.381689] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043250381687, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:27:30.383045] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043250383043, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:27:30.454931] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:30.484214] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:30.580320] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:30.580365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:30.580373] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:30.580382] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:30.589059] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8663, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:27:30.684442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:30.685194] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:30.789324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:30.789366] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:30.789372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:30.789379] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:30.884586] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:30.989606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:30.989645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:30.989651] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:30.989661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:31.084786] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:31.189990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:31.190034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:31.190042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:31.190052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:31.284992] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:31.389316] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043251389312, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:27:31.390294] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:31.390327] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:31.390333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:31.390341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:31.390662] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043251390660, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:27:31.455084] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:31.485145] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:31.590574] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:31.590619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:31.590625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:31.590633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:31.685291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:31.686127] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:31.790980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:31.791023] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:31.791029] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:31.791055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:31.889259] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3834, replace_start_pos=3100000, replace_num=100000) [2024-09-11 16:27:31.889306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:31.991286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:31.991331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:31.991339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:31.991348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:32.089403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:32.191650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:32.191697] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:32.191705] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:32.191714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:32.289554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:32.392034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:32.392093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:32.392101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:32.392111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:32.396862] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043252396857, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:27:32.398283] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043252398281, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:27:32.455193] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:32.489674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:32.592365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:32.592412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:32.592419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:32.592429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:32.600985] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8543, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:27:32.687320] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:32.689876] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:32.801237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:32.801281] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:32.801287] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:32.801294] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:32.801445] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:27:32.890002] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:33.001749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:33.001793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:33.001801] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:33.001811] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:33.090145] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:33.202063] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:33.202106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:33.202114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:33.202124] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:33.290288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:33.402421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:33.402465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:33.402473] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:33.402483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:33.404534] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043253404531, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:27:33.405965] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043253405962, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:27:33.455317] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:33.490414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:33.602722] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:33.602766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:33.602773] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:33.602783] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:33.603514] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:33.603577] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=62] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:33.603662] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] update_check_range(min_check_version=227, max_check_version=228, global_version=229) [2024-09-11 16:27:33.605686] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2023 [2024-09-11 16:27:33.605718] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:33.605754] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:27:33.605791] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:27:33.605875] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:33.606009] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:27:33.606063] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:27:33.606074] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:27:33.606085] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:27:33.606126] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:27:33.606186] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:27:33.606208] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:27:33.688429] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:33.690610] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:33.803046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:33.803089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:33.803097] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:33.803107] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:33.890713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:34.003398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:34.003440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:34.003449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:34.003458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:34.094864] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3939, replace_start_pos=3200000, replace_num=100000) [2024-09-11 16:27:34.094916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:34.203687] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:34.203750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:34.203759] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:34.203768] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:34.295071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:34.404049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:34.404095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:34.404102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:34.404112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:34.412153] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043254412150, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:27:34.413509] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043254413508, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:27:34.455441] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:34.495267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:34.604395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:34.604440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:34.604448] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:34.604458] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:34.613004] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8530, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:27:34.689609] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:34.695391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:34.813257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:34.813300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:34.813306] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:34.813315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:34.895502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:35.013572] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:35.013618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:35.013625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:35.013634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:35.095626] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:35.213863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:35.213918] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:35.213926] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:35.213935] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:35.214150] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=87, refresh_score_time=65, wash_time=0) [2024-09-11 16:27:35.295767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:35.414388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:35.414433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:35.414440] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:35.414448] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:35.419771] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043255419767, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:27:35.421123] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043255421122, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:27:35.455578] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:35.495962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:35.614675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:35.614718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:35.614725] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:35.614733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:35.690599] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:35.696103] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:35.814979] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:35.815022] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:35.815028] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:35.815036] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:35.896281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:36.015259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:36.015299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:36.015305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:36.015313] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:36.096413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:36.215559] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:36.215598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:36.215604] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:36.215613] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:36.300950] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4406, replace_start_pos=3300000, replace_num=100000) [2024-09-11 16:27:36.300998] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:36.415856] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:36.415915] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:36.415924] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:36.415934] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:36.427332] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726043256427328, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:27:36.428738] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043256428737, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:27:36.455778] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:36.501169] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:36.616152] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:36.616190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:36.616196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:36.616205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:36.624023] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7805, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:27:36.691815] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=149] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:36.701310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:36.824269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:36.824309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:36.824316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:36.824325] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:36.901507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:37.024532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:37.024566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:37.024572] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:37.024580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:37.101703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:37.224783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:37.224815] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:37.224822] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:37.224831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:37.301884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:37.425046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:37.425089] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:37.425095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:37.425123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:37.434996] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043257434992, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:27:37.436357] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1726043257436355, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:27:37.455920] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:37.502020] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:37.625331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:37.625370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:37.625375] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:37.625384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:37.693068] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:37.702223] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:37.825595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:37.825631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:37.825637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:37.825645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:37.902405] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:38.025862] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:38.025896] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:38.025930] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:38.025943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:38.102576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:38.226154] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:38.226189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:38.226195] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:38.226203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:38.302752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:38.426424] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:38.426479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:38.426486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:38.426494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:38.442614] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726043258442611, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:27:38.444038] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043258444037, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:27:38.456033] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=33] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:38.507331] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4408, replace_start_pos=3400000, replace_num=100000) [2024-09-11 16:27:38.507379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:38.626712] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:38.626749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:38.626755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:38.626763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:38.634268] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7493, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:27:38.694297] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:38.707530] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:38.834515] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:38.834552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:38.834559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:38.834568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:38.907648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:39.034793] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:39.034839] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:39.034848] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:39.034876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:39.107821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:39.235102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:39.235142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:39.235148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:39.235156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:39.307956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:39.435381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:39.435426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:39.435433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:39.435442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:39.450181] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043259450177, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:27:39.451589] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043259451588, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007551, add_bytes: 0 [2024-09-11 16:27:39.456304] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:39.508076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:39.635682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:39.635729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:39.635736] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:39.635765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:39.695535] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:39.708199] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:39.836013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:39.836069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:39.836091] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:39.836100] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:39.908371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:40.036316] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:40.036356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:40.036363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:40.036371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:40.108502] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:40.236592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:40.236639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:40.236646] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:40.236655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:40.308627] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:40.436939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:40.436985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:40.436993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:40.437002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:40.456415] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:40.457783] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043260457781, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:27:40.459213] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043260459212, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:27:40.508881] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:40.637258] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:40.637301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:40.637309] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:40.637318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:40.644599] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7268, clean_start_pos=1800000, clean_num=200000) [2024-09-11 16:27:40.696637] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:40.713223] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4180, replace_start_pos=3500000, replace_num=100000) [2024-09-11 16:27:40.713267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:40.844848] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:40.844883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:40.844889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:40.844897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:40.913358] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:41.045147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:41.045186] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:41.045193] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:41.045201] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:41.113488] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:41.245417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:41.245455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:41.245461] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:41.245470] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:41.313711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:41.445703] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:41.445748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:41.445755] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:41.445763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:41.456622] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:41.465410] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043261465407, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:27:41.466827] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726043261466825, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:27:41.513843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:41.646009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:41.646070] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:41.646080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:41.646091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:41.697631] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:41.713965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:41.846318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:41.846355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:41.846361] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:41.846369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:41.914082] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:42.046608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:42.046647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:42.046654] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:42.046662] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:42.114206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:42.246897] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:42.246957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:42.246964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:42.246973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:42.314326] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:42.447202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:42.447257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:42.447265] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:42.447274] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:42.456751] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:42.473081] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043262473078, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007671, add_bytes: 0 [2024-09-11 16:27:42.474502] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043262474500, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:27:42.514464] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:42.647500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:42.647541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:42.647548] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:42.647557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:42.655457] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7887, clean_start_pos=2000000, clean_num=200000) [2024-09-11 16:27:42.698934] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:42.714602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:42.855730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:42.855776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:42.855786] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:42.855800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:42.919131] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4349, replace_start_pos=3600000, replace_num=100000) [2024-09-11 16:27:42.919179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:43.056059] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:43.056097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:43.056104] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:43.056113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:43.119281] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:43.256349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:43.256395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:43.256403] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:43.256433] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:43.319406] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:43.456674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:43.456716] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:43.456723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:43.456732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:43.456887] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:43.480697] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043263480692, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:27:43.482119] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043263482117, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:27:43.519538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:43.620285] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:43.620329] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=43] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:43.620410] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=228, max_check_version=229, global_version=230) [2024-09-11 16:27:43.622443] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2033 [2024-09-11 16:27:43.622501] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=44] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:43.622537] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:27:43.622574] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:27:43.622656] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:43.622764] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,344 used= 76,295,092 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:27:43.622820] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:27:43.622832] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:27:43.622843] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:27:43.622880] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:27:43.622952] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:27:43.622975] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:27:43.656985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:43.657031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:43.657038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:43.657048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:43.700106] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:43.719726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:43.857340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:43.857386] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:43.857394] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:43.857404] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:43.919855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:44.057630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:44.057676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:44.057684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:44.057693] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:44.119997] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:44.257941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:44.257984] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:44.257991] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:44.258000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:44.320108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:44.457024] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:44.458296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:44.458331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:44.458340] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:44.458349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:44.488241] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043264488237, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:27:44.489686] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043264489684, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:27:44.520307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:44.658593] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:44.658638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:44.658646] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:44.658655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:44.666834] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8166, clean_start_pos=2200000, clean_num=200000) [2024-09-11 16:27:44.701143] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:44.720495] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:44.867100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:44.867137] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:44.867145] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:44.867154] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:44.920635] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:45.067400] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:45.067447] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:45.067454] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:45.067481] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:45.124054] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3303, replace_start_pos=3700000, replace_num=100000) [2024-09-11 16:27:45.124099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:45.267706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:45.267749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:45.267756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:45.267765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:45.324248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:45.457150] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:45.468008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:45.468040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:45.468046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:45.468054] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:45.495925] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043265495922, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007685, add_bytes: 0 [2024-09-11 16:27:45.497351] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043265497350, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:27:45.524375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:45.668342] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:45.668404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:45.668412] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:45.668422] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:45.702114] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:45.724510] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:45.868665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:45.868708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:45.868715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:45.868724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:45.924728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:46.068980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:46.069019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:46.069028] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:46.069038] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:46.124855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:46.269263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:46.269308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:46.269315] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:46.269324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:46.324988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:46.457389] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:46.469639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:46.469683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:46.469715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:46.469726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:46.503488] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043266503484, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:27:46.504976] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043266504975, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:27:46.525130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:46.670074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:46.670121] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:46.670129] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:46.670138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:46.678627] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8476, clean_start_pos=2400000, clean_num=200000) [2024-09-11 16:27:46.703248] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:46.725261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:46.878887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:46.878956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:46.878964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:46.878974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:46.925382] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:47.079213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:47.079259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:47.079266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:47.079275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:47.125525] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:47.279571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:47.279613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:47.279621] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:47.279631] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:47.328988] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3337, replace_start_pos=3800000, replace_num=100000) [2024-09-11 16:27:47.329031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:47.457532] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:47.479875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:47.479936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:47.479945] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:47.479955] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:47.511168] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043267511165, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:27:47.512538] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043267512536, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:27:47.529111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:47.680252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:47.680299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:47.680307] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:47.680317] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:47.704099] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:47.729229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:47.880627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:47.880668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:47.880677] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:47.880703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:47.929351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:48.080964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:48.081009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:48.081017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:48.081026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:48.129499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:48.281354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:48.281401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:48.281410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:48.281420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:48.329615] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:48.457655] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:48.481671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:48.481715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:48.481723] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:48.481733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:48.518714] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043268518709, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007544, add_bytes: 0 [2024-09-11 16:27:48.520149] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043268520148, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:27:48.529725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:48.682074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:48.682120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:48.682128] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:48.682138] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:48.690705] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8553, clean_start_pos=2600000, clean_num=200000) [2024-09-11 16:27:48.705109] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:48.729838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:48.891067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:48.891115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:48.891123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:48.891132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:48.929951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:49.091368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:49.091413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:49.091420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:49.091429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:49.130087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:49.291654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:49.291696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:49.291703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:49.291729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:49.330211] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:49.457850] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:49.492050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:49.492087] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:49.492095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:49.492105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:49.526432] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043269526426, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007717, add_bytes: 0 [2024-09-11 16:27:49.527762] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043269527761, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:27:49.534627] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4300, replace_start_pos=3900000, replace_num=100000) [2024-09-11 16:27:49.534662] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:49.692349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:49.692388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:49.692396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:49.692405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:49.706079] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:49.734745] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:49.892708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:49.892755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:49.892763] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:49.892773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:49.934868] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:50.093028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:50.093072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:50.093079] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:50.093088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:50.135042] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=94] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:50.293333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:50.293380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:50.293387] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:50.293396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:50.335158] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:50.457969] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:50.493692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:50.493739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:50.493747] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:50.493757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:50.533949] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043270533945, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007519, add_bytes: 0 [2024-09-11 16:27:50.535268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:50.535387] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043270535386, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:27:50.694028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:50.694079] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:50.694087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:50.694096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:50.702445] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8336, clean_start_pos=2800000, clean_num=200000) [2024-09-11 16:27:50.707070] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:50.735376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:50.902765] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:50.902810] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:50.902818] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:50.902828] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:50.935491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:51.103076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:51.103114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:51.103122] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:51.103131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:51.135689] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:51.303357] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:51.303398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:51.303404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:51.303413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:51.335855] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:51.458127] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:51.503638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:51.503682] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:51.503689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:51.503699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:51.536077] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:51.541629] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043271541625, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:27:51.543003] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043271543001, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:27:51.703960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:51.704001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:51.704007] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:51.704016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:51.708084] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:51.740511] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4314, replace_start_pos=4000000, replace_num=100000) [2024-09-11 16:27:51.740562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:51.904255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:51.904311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:51.904319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:51.904329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:51.940800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:52.104577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:52.104622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:52.104630] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:52.104657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:52.140928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:52.304943] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:52.304994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:52.305001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:52.305011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:52.341057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:52.458255] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:52.505265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:52.505322] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:52.505331] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:52.505341] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:52.541187] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:52.549242] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043272549239, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:27:52.550613] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043272550612, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:27:52.705646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:52.705694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:52.705719] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:52.705730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:52.709173] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:52.714244] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8501, clean_start_pos=3000000, clean_num=200000) [2024-09-11 16:27:52.741301] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:52.914500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:52.914540] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:52.914547] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:52.914557] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:52.941482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:53.114808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:53.114853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:53.114860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:53.114869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:53.141603] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:53.315085] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:53.315119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:53.315125] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:53.315132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:53.341728] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:53.458442] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:53.515373] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:53.515408] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:53.515428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:53.515437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:53.541863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:53.556869] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043273556863, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:27:53.558220] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043273558218, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:27:53.637652] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:53.637707] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:27:53.637788] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=229, max_check_version=230, global_version=231) [2024-09-11 16:27:53.639888] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2099 [2024-09-11 16:27:53.639953] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:53.639989] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:27:53.640046] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:27:53.640129] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:27:53.640236] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:27:53.640289] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:27:53.640305] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:27:53.640316] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:27:53.640352] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:27:53.640412] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:27:53.640437] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:27:53.710260] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:53.715718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:53.715761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:53.715769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:53.715779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:53.742004] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:53.916050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:53.916097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:53.916105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:53.916133] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:53.945618] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3380, replace_start_pos=4100000, replace_num=100000) [2024-09-11 16:27:53.945663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:54.116372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:54.116420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:54.116428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:54.116438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:54.145762] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:54.316680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:54.316726] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:54.316734] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:54.316743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:54.345875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:54.458569] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:54.516994] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:54.517039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:54.517045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:54.517068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:54.545999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:54.564474] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726043274564470, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:27:54.565837] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043274565835, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:27:54.711468] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:54.717303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:54.717333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:54.717341] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:54.717350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:54.724405] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7041, clean_start_pos=3200000, clean_num=200000) [2024-09-11 16:27:54.746124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:54.924657] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:54.924705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:54.924712] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:54.924722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:54.946250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:55.125052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:55.125097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:55.125105] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:55.125114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:55.146375] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:55.325416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:55.325481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:55.325489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:55.325499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:55.346500] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:55.458714] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:55.525732] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:55.525775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:55.525781] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:55.525788] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:55.525995] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=72, refresh_score_time=60, wash_time=0) [2024-09-11 16:27:55.546632] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:55.572027] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043275572023, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007553, add_bytes: 0 [2024-09-11 16:27:55.573458] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043275573456, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:27:55.712590] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:55.726230] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:55.726269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:55.726277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:55.726286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:55.746753] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:55.926615] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:55.926660] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:55.926668] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:55.926678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:55.946872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:56.126972] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:56.127015] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:56.127023] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:56.127032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:56.150342] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3340, replace_start_pos=4200000, replace_num=100000) [2024-09-11 16:27:56.150389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:56.327362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:56.327410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:56.327419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:56.327428] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:56.350483] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:56.458888] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=89] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:56.527736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:56.527784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:56.527792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:56.527802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:56.550599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:56.579655] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043276579651, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:27:56.581159] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043276581156, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 16:27:56.713514] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:56.728162] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:56.728208] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:56.728232] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:56.728242] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:56.736052] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7795, clean_start_pos=3400000, clean_num=200000) [2024-09-11 16:27:56.750715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:56.936382] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:56.936426] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:56.936433] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:56.936444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:56.950832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:57.136777] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:57.136842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:57.136851] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:57.136861] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:57.150952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:57.337189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:57.337237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:57.337246] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:57.337280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:57.351116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:57.459040] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=70] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:57.537583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:57.537627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:57.537635] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:57.537644] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:57.551272] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:57.587252] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043277587248, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:27:57.588692] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043277588689, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007533, add_bytes: 0 [2024-09-11 16:27:57.714608] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:57.737980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:57.738027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:57.738035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:57.738045] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:57.751403] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:27:57.938360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:57.938402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:57.938409] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:57.938418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:57.951589] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:27:58.138719] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:58.138782] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:58.138792] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:58.138803] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:58.151769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:27:58.339104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:58.339148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:58.339156] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:58.339166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:58.355245] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3347, replace_start_pos=4300000, replace_num=100000) [2024-09-11 16:27:58.355288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:27:58.459244] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:58.539476] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:58.539521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:58.539529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:58.539539] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:58.555426] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:27:58.594877] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043278594873, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:27:58.596370] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043278596367, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:27:58.715676] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=88] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:58.739844] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:58.739926] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:58.739936] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:58.739947] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:58.748471] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8493, clean_start_pos=3600000, clean_num=200000) [2024-09-11 16:27:58.755636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:27:58.948804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:58.948850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:58.948859] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:58.948869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:58.955759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:27:59.149173] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:59.149219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:59.149227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:59.149237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:59.155897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:27:59.349536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:59.349584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:59.349594] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:59.349604] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:59.356138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=86] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:27:59.459397] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:27:59.549859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:59.549929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:59.549938] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:59.549947] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:59.556291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:27:59.602505] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1726043279602501, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:27:59.603958] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726043279603955, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007588, add_bytes: 0 [2024-09-11 16:27:59.716896] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:27:59.750209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:59.750257] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:59.750265] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:59.750275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:59.756416] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:27:59.950523] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:27:59.950567] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:27:59.950575] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:27:59.950585] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:27:59.956538] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:00.150888] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:00.150960] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:00.150967] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:00.150977] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:00.156667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:00.351300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:00.351340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:00.351348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:00.351359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:00.356787] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:00.459536] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:00.551661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:00.551707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:00.551716] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:00.551725] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:00.561262] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4310, replace_start_pos=4400000, replace_num=100000) [2024-09-11 16:28:00.561310] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:00.599607] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:28:00.605606] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:28:00.610105] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043280610101, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:28:00.610143] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:28:00.611535] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043280611533, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007578, add_bytes: 0 [2024-09-11 16:28:00.611567] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:28:00.717935] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=96] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:00.752057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:00.752105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:00.752113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:00.752141] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:00.759262] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7107, clean_start_pos=3800000, clean_num=200000) [2024-09-11 16:28:00.761409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:00.959591] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:00.959638] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:00.959646] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:00.959656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:00.961572] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:01.159986] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:01.160031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:01.160040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:01.160049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:01.161742] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:01.360299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:01.360345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:01.360352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:01.360362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:01.361923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:01.459681] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:01.560693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:01.560741] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:01.560749] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:01.560759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:01.562033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:01.617713] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043281617709, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:28:01.619149] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726043281619146, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:28:01.719002] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:01.761041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:01.761088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:01.761095] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:01.761104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:01.762151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:01.961365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:01.961402] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:01.961410] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:01.961419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:01.962256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:02.161725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:02.161767] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:02.161775] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:02.161801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:02.162353] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:02.362119] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:02.362165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:02.362174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:02.362183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:02.362532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:02.459813] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:02.562435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:02.562483] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:02.562491] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:02.562500] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:02.562636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:02.625400] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043282625395, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:28:02.626768] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043282626766, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:28:02.720000] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:02.762808] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:02.762858] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:02.762866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:02.762876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:02.766162] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3395, replace_start_pos=4500000, replace_num=100000) [2024-09-11 16:28:02.766202] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:02.771532] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8642, clean_start_pos=4000000, clean_num=200000) [2024-09-11 16:28:02.966300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:02.971794] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:02.971829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:02.971836] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:02.971845] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:02.972044] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:28:03.166417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:03.172270] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:03.172304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:03.172311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:03.172319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:03.366534] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:03.372543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:03.372573] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:03.372580] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:03.372589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:03.459939] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:03.566653] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:03.572918] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:03.572952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:03.572960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:03.572970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:03.633014] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1726043283633010, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:28:03.634375] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=808] PNIO [ratelimit] time: 1726043283634372, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:28:03.653129] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:03.653177] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=48] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:03.653247] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] update_check_range(min_check_version=230, max_check_version=231, global_version=232) [2024-09-11 16:28:03.655315] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2067 [2024-09-11 16:28:03.655358] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:03.655413] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:28:03.655453] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:28:03.655537] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:03.655644] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:28:03.655706] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=33] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:28:03.655717] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:28:03.655729] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:28:03.655766] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:28:03.655827] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:28:03.655849] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:28:03.720938] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:03.766770] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:03.773266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:03.773303] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:03.773311] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:03.773321] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:03.966977] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:03.973571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:03.973604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:03.973611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:03.973621] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:04.167114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:04.173948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:04.173990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:04.173998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:04.174007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:04.367236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:04.374330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:04.374370] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:04.374378] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:04.374388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:04.460116] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:04.567350] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:04.574702] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:04.574768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:04.574776] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:04.574785] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:04.640579] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043284640574, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007564, add_bytes: 0 [2024-09-11 16:28:04.642054] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043284642053, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007681, add_bytes: 0 [2024-09-11 16:28:04.721807] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:04.767481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:04.775048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:04.775092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:04.775099] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:04.775109] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:04.782197] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7075, clean_start_pos=4200000, clean_num=200000) [2024-09-11 16:28:04.972042] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4378, replace_start_pos=4600000, replace_num=100000) [2024-09-11 16:28:04.972102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:04.982513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:04.982558] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:04.982566] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:04.982576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:05.172251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:05.182882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:05.182948] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:05.182957] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:05.182990] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:05.372446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:05.383217] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:05.383262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:05.383270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:05.383279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:05.460252] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:05.572569] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:05.583552] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:05.583597] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:05.583605] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:05.583614] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:05.648257] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043285648252, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:28:05.649684] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043285649682, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:28:05.722953] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:05.772684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:05.783929] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:05.783968] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:05.783976] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:05.783985] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:05.972803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:05.984210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:05.984249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:05.984274] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:05.984283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:06.172918] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:06.184602] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:06.184646] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:06.184655] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:06.184665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:06.373034] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:06.384887] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:06.384938] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:06.384944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:06.384952] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:06.460402] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:06.573144] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:06.585251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:06.585297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:06.585305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:06.585332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:06.655818] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043286655814, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:28:06.657240] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043286657238, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:28:06.724063] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:06.773300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:06.785539] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:06.785581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:06.785587] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:06.785594] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:06.792254] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6647, clean_start_pos=4400000, clean_num=200000) [2024-09-11 16:28:06.973442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:06.992584] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:06.992629] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:06.992637] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:06.992646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:07.177633] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4066, replace_start_pos=4700000, replace_num=100000) [2024-09-11 16:28:07.177676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:07.192971] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:07.193018] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:07.193026] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:07.193035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:07.377757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:07.393271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:07.393314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:07.393321] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:07.393328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:07.460535] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:07.577916] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:07.593622] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:07.593661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:07.593669] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:07.593678] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:07.663485] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043287663481, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007667, add_bytes: 0 [2024-09-11 16:28:07.664855] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043287664854, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:28:07.725238] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:07.778039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:07.793998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:07.794038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:07.794046] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:07.794056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:07.978163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:07.994416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:07.994466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:07.994474] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:07.994483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:08.178279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:08.194731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:08.194773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:08.194780] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:08.194790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:08.378389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:08.395051] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:08.395088] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:08.395096] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:08.395105] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:08.460652] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:08.578543] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:08.595351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:08.595394] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:08.595402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:08.595411] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:08.671045] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043288671042, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:28:08.672466] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=445] PNIO [ratelimit] time: 1726043288672464, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:28:08.726296] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:08.778758] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:08.795771] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:08.795817] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:08.795826] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:08.795854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:08.804354] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8484, clean_start_pos=4600000, clean_num=200000) [2024-09-11 16:28:08.978951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:09.004614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:09.004659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:09.004666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:09.004673] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:09.179167] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:09.205005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:09.205050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:09.205058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:09.205068] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:09.383747] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4389, replace_start_pos=4800000, replace_num=100000) [2024-09-11 16:28:09.383801] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:09.405323] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:09.405368] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:09.405376] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:09.405403] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:09.460844] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:09.583884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:09.605651] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:09.605701] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:09.605709] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:09.605719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:09.678642] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043289678638, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2024-09-11 16:28:09.680145] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043289680142, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:28:09.727577] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:09.784019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:09.805989] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:09.806029] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:09.806035] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:09.806042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:09.984141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:10.006290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:10.006336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:10.006344] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:10.006353] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:10.184264] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:10.206655] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:10.206718] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:10.206727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:10.206737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:10.384413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:10.407001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:10.407050] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:10.407058] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:10.407067] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:10.460957] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:10.584550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:10.607302] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:10.607345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:10.607352] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:10.607361] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:10.686274] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043290686270, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:28:10.687763] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043290687761, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:28:10.728743] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:10.784678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:10.807596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:10.807642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:10.807649] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:10.807657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:10.815256] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7586, clean_start_pos=4800000, clean_num=200000) [2024-09-11 16:28:10.984799] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:11.015524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:11.015564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:11.015570] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:11.015578] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:11.184927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:11.215880] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:11.215941] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:11.215950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:11.215959] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:11.385051] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:11.416207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:11.416255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:11.416262] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:11.416271] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:11.461106] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:11.589506] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4330, replace_start_pos=4900000, replace_num=100000) [2024-09-11 16:28:11.589569] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:11.616506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:11.616557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:11.616564] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:11.616574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:11.693943] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043291693939, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:28:11.695321] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043291695318, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:28:11.729920] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:11.789660] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:11.816942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:11.816980] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:11.816986] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:11.816993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:11.989792] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:12.017231] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:12.017278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:12.017286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:12.017295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:12.189987] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:12.217624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:12.217665] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:12.217673] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:12.217683] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:12.390118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:12.418012] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:12.418057] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:12.418064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:12.418074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:12.461220] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:12.590315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:12.618375] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:12.618420] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:12.618428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:12.618437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:12.701560] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043292701557, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:28:12.702986] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043292702984, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007666, add_bytes: 0 [2024-09-11 16:28:12.731314] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:12.790453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:12.818690] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:12.818736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:12.818744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:12.818753] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:12.827265] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8497, clean_start_pos=5000000, clean_num=200000) [2024-09-11 16:28:12.990640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:13.027544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:13.027606] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:13.027614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:13.027624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:13.190819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:13.227878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:13.227944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:13.227952] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:13.227962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:13.390996] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:13.428288] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:13.428330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:13.428337] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:13.428345] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:13.461335] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:13.591177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:13.628653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:13.628696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:13.628704] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:13.628734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:13.669467] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:13.669522] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:13.669628] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=231, max_check_version=232, global_version=233) [2024-09-11 16:28:13.671638] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2008 [2024-09-11 16:28:13.671674] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:13.671709] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:28:13.671748] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:28:13.671854] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:13.671975] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:28:13.672029] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:28:13.672040] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:28:13.672056] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:28:13.672107] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:28:13.672168] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:28:13.672190] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:28:13.709201] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726043293709197, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 16:28:13.710554] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=1247] PNIO [ratelimit] time: 1726043293710552, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 16:28:13.732501] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:13.795715] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4360, replace_start_pos=5000000, replace_num=100000) [2024-09-11 16:28:13.795763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:13.829061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:13.829103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:13.829111] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:13.829121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:13.995926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:14.029449] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:14.029495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:14.029503] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:14.029530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:14.196064] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:14.229772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:14.229824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:14.229830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:14.229838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:14.396188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:14.430147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:14.430193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:14.430200] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:14.430209] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:14.461453] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:14.596381] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:14.630533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:14.630578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:14.630586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:14.630596] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:14.716820] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043294716816, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:28:14.718170] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043294718169, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:28:14.733687] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:14.796497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:14.830963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:14.831031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:14.831040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:14.831050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:14.838896] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7833, clean_start_pos=5200000, clean_num=200000) [2024-09-11 16:28:14.996628] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:15.039223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:15.039268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:15.039276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:15.039286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:15.196778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:15.239594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:15.239637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:15.239645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:15.239654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:15.396962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:15.439996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:15.440040] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:15.440048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:15.440073] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:15.461586] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:15.597092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:15.640333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:15.640381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:15.640388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:15.640395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:15.724422] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043295724417, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2024-09-11 16:28:15.725775] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043295725773, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:28:15.734894] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:15.797224] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:15.840647] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:15.840700] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:15.840708] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:15.840718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:15.840960] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=88, refresh_score_time=65, wash_time=0) [2024-09-11 16:28:16.000785] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3372, replace_start_pos=5100000, replace_num=100000) [2024-09-11 16:28:16.000824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:16.041308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:16.041354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:16.041362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:16.041372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:16.200968] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:16.241678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:16.241720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:16.241727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:16.241735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:16.401162] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:16.441963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:16.441992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:16.441998] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:16.442006] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:16.461723] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:16.601344] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:16.642241] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:16.642286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:16.642294] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:16.642303] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:16.731971] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043296731966, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:28:16.733400] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043296733397, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:28:16.736069] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:16.801465] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:16.842533] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:16.842575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:16.842582] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:16.842609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:16.850219] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7596, clean_start_pos=5400000, clean_num=200000) [2024-09-11 16:28:17.001651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:17.050549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:17.050594] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:17.050602] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:17.050611] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:17.201838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:17.250850] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:17.250898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:17.250931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:17.250939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:17.401958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:17.451148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:17.451190] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:17.451196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:17.451204] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:17.461848] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:17.602090] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:17.651526] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:17.651570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:17.651577] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:17.651586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:17.737364] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:17.739582] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043297739579, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:28:17.741027] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043297741025, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2024-09-11 16:28:17.802275] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:17.851884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:17.851965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:17.851974] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:17.851983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:18.002452] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:18.052306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:18.052351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:18.052359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:18.052368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:18.206967] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4317, replace_start_pos=5200000, replace_num=100000) [2024-09-11 16:28:18.207011] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:18.252675] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:18.252721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:18.252746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:18.252757] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:18.407098] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:18.452998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:18.453038] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:18.453045] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:18.453052] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:18.462014] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:18.607230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:18.653309] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:18.653351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:18.653359] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:18.653368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:18.738497] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:18.747256] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043298747253, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:28:18.748696] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043298748695, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:28:18.807360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:18.853691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:18.853736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:18.853744] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:18.853755] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:18.862211] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8442, clean_start_pos=5600000, clean_num=200000) [2024-09-11 16:28:19.007492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:19.062587] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:19.062635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:19.062643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:19.062653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:19.207604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:19.262877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:19.262935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:19.262941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:19.262949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:19.407715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:19.462142] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:19.463178] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:19.463206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:19.463213] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:19.463223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:19.607898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:19.663527] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:19.663590] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:19.663599] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:19.663610] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:19.739582] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:19.754872] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043299754868, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:28:19.756299] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO [ratelimit] time: 1726043299756297, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2024-09-11 16:28:19.808048] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:19.863843] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:19.863886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:19.863894] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:19.863921] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:20.008176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:20.064174] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=13][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:20.064218] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:20.064226] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:20.064235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:20.208360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:20.264465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:20.264510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:20.264518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:20.264527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:20.411861] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3380, replace_start_pos=5300000, replace_num=100000) [2024-09-11 16:28:20.411923] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:20.462316] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:20.464855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:20.464883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:20.464891] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:20.464917] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:20.612101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:20.665148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:20.665188] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:20.665196] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:20.665205] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:20.740717] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:20.762491] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=72] PNIO [ratelimit] time: 1726043300762487, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:28:20.763928] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043300763926, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:28:20.812243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:20.865470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:20.865517] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:20.865524] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:20.865534] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:20.873634] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8088, clean_start_pos=5800000, clean_num=200000) [2024-09-11 16:28:21.012419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:21.073899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:21.073965] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:21.073987] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:21.073997] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:21.212549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:21.274297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:21.274346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:21.274355] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:21.274366] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:21.412681] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:21.462460] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:21.474607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:21.474654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:21.474661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:21.474670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:21.612807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:21.674990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:21.675031] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:21.675039] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:21.675063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:21.741750] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:21.770098] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043301770094, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:28:21.771536] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043301771534, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:28:21.812925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:21.875306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:21.875352] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:21.875360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:21.875369] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:22.013062] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:22.075599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:22.075642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:22.075650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:22.075659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:22.213188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:22.275886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:22.275952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:22.275959] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:22.275967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:22.413366] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:22.462638] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:22.476202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:22.476245] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:22.476270] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:22.476280] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:22.616897] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3399, replace_start_pos=5400000, replace_num=100000) [2024-09-11 16:28:22.616950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:22.676513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:22.676557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:22.676565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:22.676574] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:22.742636] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:22.777665] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043302777660, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:28:22.779147] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043302779145, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:28:22.817047] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:22.876809] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:22.876846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:22.876852] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:22.876859] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:22.884667] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7796, clean_start_pos=6000000, clean_num=200000) [2024-09-11 16:28:23.017177] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:23.084957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:23.085001] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:23.085009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:23.085018] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:23.217309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:23.285415] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:23.285459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:23.285466] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:23.285474] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:23.417550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:23.462865] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:23.485709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:23.485752] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:23.485760] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:23.485769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:23.617726] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:23.686069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:23.686111] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:23.686119] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:23.686129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:23.686641] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:23.686699] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=55] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:23.686778] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=232, max_check_version=233, global_version=234) [2024-09-11 16:28:23.688782] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2004 [2024-09-11 16:28:23.688815] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:23.688850] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:28:23.688887] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:28:23.688984] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:23.689109] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 12 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:28:23.689160] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:28:23.689172] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:28:23.689183] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:28:23.689225] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:28:23.689285] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:28:23.689307] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:28:23.743632] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=98] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:23.785338] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043303785333, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007673, add_bytes: 0 [2024-09-11 16:28:23.786714] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043303786712, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:28:23.817927] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:23.886343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:23.886384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:23.886390] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:23.886398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:24.018050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:24.086631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:24.086676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:24.086684] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:24.086694] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:24.218176] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:24.286936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:24.286997] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:24.287003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:24.287010] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:24.418313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:24.463021] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=71] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:24.487335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:24.487381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:24.487389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:24.487398] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:24.618444] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:24.687725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:24.687773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:24.687781] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:24.687790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:24.744728] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:24.792896] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043304792891, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:28:24.794318] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043304794315, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:28:24.822908] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4335, replace_start_pos=5500000, replace_num=100000) [2024-09-11 16:28:24.822957] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:24.888097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:24.888141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:24.888149] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:24.888160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:24.895426] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7231, clean_start_pos=6200000, clean_num=200000) [2024-09-11 16:28:25.023055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:25.095750] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:25.095792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:25.095800] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:25.095810] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:25.223191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:25.296120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:25.296166] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:25.296174] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:25.296183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:25.423314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:25.463254] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:25.496411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:25.496452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:25.496458] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:25.496466] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:25.623434] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:25.696688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:25.696731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:25.696738] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:25.696746] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:25.745918] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:25.800565] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1726043305800560, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007669, add_bytes: 0 [2024-09-11 16:28:25.801993] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043305801991, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007676, add_bytes: 0 [2024-09-11 16:28:25.823562] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:25.897065] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:25.897109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:25.897117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:25.897127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:26.023677] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:26.097359] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:26.097404] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:26.097411] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:26.097420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:26.223794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:26.297635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:26.297678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:26.297685] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:26.297692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:26.423921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:26.463456] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:26.498032] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:26.498076] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:26.498084] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:26.498094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:26.624043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:26.698318] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:26.698360] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:26.698366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:26.698374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:26.746917] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:26.808126] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043306808122, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:28:26.809611] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043306809609, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:28:26.824175] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:26.898668] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:26.898714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:26.898722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:26.898733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:26.907294] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8547, clean_start_pos=6400000, clean_num=200000) [2024-09-11 16:28:27.028720] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4409, replace_start_pos=5600000, replace_num=100000) [2024-09-11 16:28:27.028772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:27.107570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:27.107614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:27.107623] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:27.107632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:27.228878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:27.307873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:27.307936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:27.307944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:27.307953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:27.429023] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:27.463663] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:27.508219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:27.508265] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:27.508273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:27.508282] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:27.629164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:27.708545] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:27.708589] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:27.708614] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:27.708624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:27.747860] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=79] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:27.815750] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043307815746, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:28:27.817172] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043307817170, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007561, add_bytes: 0 [2024-09-11 16:28:27.829309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:27.908963] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:27.909008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:27.909015] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:27.909025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:28.029505] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:28.109269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:28.109311] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:28.109319] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:28.109328] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:28.229636] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:28.309571] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:28.309619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:28.309627] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:28.309635] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:28.429833] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:28.463793] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:28.509961] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:28.510008] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:28.510017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:28.510026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:28.629946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:28.710312] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:28.710358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:28.710366] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:28.710375] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:28.749059] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:28.823346] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726043308823341, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 16:28:28.824778] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043308824775, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:28:28.830052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:28.910614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:28.910659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:28.910667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:28.910676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:28.918162] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7471, clean_start_pos=6600000, clean_num=200000) [2024-09-11 16:28:29.030154] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:29.118409] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:29.118455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:29.118463] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:29.118473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:29.234714] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4368, replace_start_pos=5700000, replace_num=100000) [2024-09-11 16:28:29.234763] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:29.318749] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:29.318790] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:29.318797] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:29.318807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:29.434975] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:29.463951] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:29.519103] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:29.519149] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:29.519158] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:29.519167] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:29.635102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:29.719465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:29.719500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:29.719506] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:29.719514] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:29.750101] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:29.830976] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043309830972, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:28:29.832456] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043309832455, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:28:29.835228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:29.919759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:29.919825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:29.919833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:29.919842] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:30.035387] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=24] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:30.120077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:30.120122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:30.120130] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:30.120139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:30.235523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:30.320369] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:30.320419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:30.320427] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:30.320437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:30.435656] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:30.464069] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:30.520674] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:30.520721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:30.520729] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:30.520775] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:30.635779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:30.721034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:30.721080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:30.721088] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:30.721096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:30.751018] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:30.835960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:30.838601] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043310838597, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:28:30.840024] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043310840022, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007567, add_bytes: 0 [2024-09-11 16:28:30.921330] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:30.921372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:30.921380] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:30.921389] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:30.929538] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8135, clean_start_pos=6800000, clean_num=200000) [2024-09-11 16:28:31.036097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:31.129788] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:31.129832] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:31.129840] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:31.129849] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:31.236220] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:31.330069] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:31.330131] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:31.330137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:31.330146] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:31.440270] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3872, replace_start_pos=5800000, replace_num=100000) [2024-09-11 16:28:31.440306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:31.464276] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:31.530363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:31.530399] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:31.530406] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:31.530415] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:31.640393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:31.730608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:31.730642] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:31.730647] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:31.730654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:31.752006] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:31.840584] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:31.846262] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043311846257, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007660, add_bytes: 0 [2024-09-11 16:28:31.847688] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043311847686, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007664, add_bytes: 0 [2024-09-11 16:28:31.930883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:31.930942] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:31.930950] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:31.930960] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:32.040705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:32.131204] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:32.131246] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:32.131252] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:32.131260] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:32.240882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:32.331473] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:32.331510] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:32.331516] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:32.331523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:32.441082] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:32.464398] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:32.531779] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:32.531825] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:32.531833] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:32.531843] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:32.641217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:32.732064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:32.732109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:32.732115] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:32.732123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:32.752913] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:32.841423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:32.853882] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043312853877, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:28:32.855320] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043312855318, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2024-09-11 16:28:32.932354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:32.932390] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:32.932397] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:32.932406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:32.941183] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8762, clean_start_pos=7000000, clean_num=200000) [2024-09-11 16:28:33.041644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:33.141529] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:33.141577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:33.141585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:33.141594] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:33.141789] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:28:33.241838] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:33.342092] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:33.342136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:33.342164] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:33.342177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:33.442029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:33.464522] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:33.542479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:33.542524] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:33.542532] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:33.542542] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:33.645813] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3661, replace_start_pos=5900000, replace_num=100000) [2024-09-11 16:28:33.645863] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:33.701610] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:33.701661] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:33.701742] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=233, max_check_version=234, global_version=235) [2024-09-11 16:28:33.703746] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2002 [2024-09-11 16:28:33.703800] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:33.703838] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:28:33.703875] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:28:33.703976] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:33.704085] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:28:33.704142] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:28:33.704154] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:28:33.704165] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:28:33.704201] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:28:33.704261] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:28:33.704282] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:28:33.742757] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:33.742802] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:33.742808] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:33.742817] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:33.753959] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:33.846026] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:33.861507] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1726043313861502, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:28:33.862880] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043313862878, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:28:33.943148] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:33.943196] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:33.943204] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:33.943213] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:34.046219] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:34.143511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:34.143551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:34.143560] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:34.143569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:34.246340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:34.343806] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:34.343849] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:34.343857] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:34.343866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:34.446518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:34.464698] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:34.544117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:34.544161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:34.544169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:34.544177] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:34.646645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:34.744401] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:34.744442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:34.744449] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:34.744456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:34.754895] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:34.846766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:34.869112] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043314869107, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:28:34.870474] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043314870473, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2024-09-11 16:28:34.944683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:34.944729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:34.944736] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:34.944745] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:34.952460] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7701, clean_start_pos=7200000, clean_num=200000) [2024-09-11 16:28:35.046991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:35.152804] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:35.152871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:35.152880] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:35.152890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:35.247183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:35.353213] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:35.353259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:35.353266] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:35.353276] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:35.447324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:35.464885] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:35.553604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:35.553652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:35.553661] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:35.553670] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:35.647518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:35.754013] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:35.754056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:35.754064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:35.754094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:35.756022] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:35.852053] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4353, replace_start_pos=6000000, replace_num=100000) [2024-09-11 16:28:35.852097] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:35.876668] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043315876664, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:28:35.878093] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043315878090, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:28:35.954335] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:35.954381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:35.954389] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:35.954397] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:36.052260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:36.154653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:36.154705] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:36.154713] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:36.154722] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:36.154968] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=86, refresh_score_time=61, wash_time=0) [2024-09-11 16:28:36.252390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:36.355279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:36.355324] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:36.355332] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:36.355342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:36.452509] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:36.465046] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=84] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:36.555581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:36.555624] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:36.555632] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:36.555642] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:36.652740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=83] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:36.755860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:36.755899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:36.755925] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:36.755932] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:36.756873] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=46] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:36.852950] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:36.884370] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043316884366, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007702, add_bytes: 0 [2024-09-11 16:28:36.885708] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043316885705, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:28:36.956229] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:36.956277] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:36.956285] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:36.956295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:36.964816] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8508, clean_start_pos=7400000, clean_num=200000) [2024-09-11 16:28:37.053130] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:37.165075] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:37.165116] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:37.165123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:37.165145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:37.253260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:37.365456] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:37.365502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:37.365510] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:37.365520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:37.453437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:37.465188] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:37.565819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:37.565859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:37.565866] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:37.565874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:37.653620] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:37.761681] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:37.766177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:37.766207] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:37.766215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:37.766224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:37.853755] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:37.892001] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043317891997, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:28:37.893390] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043317893388, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:28:37.966472] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:37.966541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:37.966549] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:37.966558] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:38.058241] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4364, replace_start_pos=6100000, replace_num=100000) [2024-09-11 16:28:38.058292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:38.166803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:38.166854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:38.166863] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:38.166871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:38.258411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:38.367100] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:38.367141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:38.367148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:38.367158] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:38.458540] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:38.465378] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:38.567396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:38.567442] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:38.567469] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:38.567478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:38.658682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:38.762517] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:38.767699] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:38.767755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:38.767761] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:38.767769] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:38.858808] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:38.899506] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726043318899502, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007505, add_bytes: 0 [2024-09-11 16:28:38.901007] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=631] PNIO [ratelimit] time: 1726043318901004, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:28:38.968006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:38.968049] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:38.968055] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:38.968063] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:38.974596] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6521, clean_start_pos=7600000, clean_num=200000) [2024-09-11 16:28:39.058933] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:39.174846] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:39.174892] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:39.174921] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:39.174931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:39.259056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:39.375144] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:39.375187] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:39.375194] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:39.375201] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:39.459195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:39.465503] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:39.575427] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:39.575469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:39.575477] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:39.575486] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:39.659328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:39.763247] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:39.775708] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:39.775736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:39.775743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:39.775752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:39.859467] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:39.907237] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043319907234, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007732, add_bytes: 0 [2024-09-11 16:28:39.908548] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043319908546, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007542, add_bytes: 0 [2024-09-11 16:28:39.975992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:39.976024] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:39.976030] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:39.976037] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:40.059651] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:40.176276] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:40.176321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:40.176328] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:40.176337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:40.264183] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4339, replace_start_pos=6200000, replace_num=100000) [2024-09-11 16:28:40.264233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:40.376556] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:40.376603] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:40.376610] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:40.376618] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:40.464328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:40.465617] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:40.576951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:40.576990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:40.576997] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:40.577007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:40.664445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:40.763995] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:40.777242] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:40.777284] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:40.777291] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:40.777315] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:40.864575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:40.914800] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043320914796, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:28:40.916170] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043320916166, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:28:40.977543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:40.977586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:40.977593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:40.977603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:40.985027] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7411, clean_start_pos=7800000, clean_num=200000) [2024-09-11 16:28:41.064694] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:41.185279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:41.185326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:41.185333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:41.185340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:41.264823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:41.385581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:41.385625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:41.385633] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:41.385660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:41.464952] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:41.465860] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:41.585944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:41.585987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:41.585993] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:41.586000] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:41.665083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:41.764856] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:41.786232] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:41.786266] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:41.786272] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:41.786281] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:41.865210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:41.922431] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043321922426, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007630, add_bytes: 0 [2024-09-11 16:28:41.923790] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043321923788, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:28:41.986536] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:41.986581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:41.986589] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:41.986597] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:42.065338] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:42.186838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:42.186924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=85][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:42.186934] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:42.186943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:42.265428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:42.387176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:42.387220] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:42.387227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:42.387236] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:42.466033] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=32] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:42.468846] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3295, replace_start_pos=6300000, replace_num=100000) [2024-09-11 16:28:42.468871] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:42.587487] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:42.587532] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:42.587540] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:42.587548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:42.668924] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:42.765777] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=99] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:42.787762] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:42.787803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:42.787809] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:42.787816] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:42.869081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:42.929965] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043322929960, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007534, add_bytes: 0 [2024-09-11 16:28:42.931392] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=25] PNIO [ratelimit] time: 1726043322931391, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2024-09-11 16:28:42.988041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:42.988083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:42.988090] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:42.988097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:42.995548] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7438, clean_start_pos=8000000, clean_num=200000) [2024-09-11 16:28:43.069230] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:43.195818] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:43.195865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:43.195872] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:43.195880] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:43.269446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:43.396115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:43.396160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:43.396167] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:43.396176] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:43.466157] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:43.469587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:43.596410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:43.596455] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:43.596462] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:43.596471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:43.669700] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:43.720446] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:43.720500] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:43.720580] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=234, max_check_version=235, global_version=236) [2024-09-11 16:28:43.722584] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2003 [2024-09-11 16:28:43.722621] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:43.722655] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:28:43.722716] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:28:43.722798] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:43.722918] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:28:43.722972] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:28:43.722988] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:28:43.722999] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:28:43.723035] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:28:43.723095] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:28:43.723116] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:28:43.766646] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:43.796723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:43.796761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:43.796769] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:43.796779] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:43.869824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:43.937585] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726043323937581, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:28:43.939079] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=257] PNIO [ratelimit] time: 1726043323939078, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007687, add_bytes: 0 [2024-09-11 16:28:43.997033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:43.997077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:43.997085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:43.997095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:44.069940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:44.197337] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:44.197379] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:44.197386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:44.197395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:44.270071] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:44.397634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:44.397680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:44.397687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:44.397696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:44.466292] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:44.470183] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:44.597944] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:44.597985] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:44.598017] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:44.598025] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:44.673622] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3326, replace_start_pos=6400000, replace_num=100000) [2024-09-11 16:28:44.673663] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:44.767469] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:44.798262] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:44.798306] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:44.798312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:44.798320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:44.873754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:44.945212] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043324945207, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:28:44.946699] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1726043324946697, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:28:44.998564] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:44.998610] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:44.998617] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:44.998626] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:45.006249] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7611, clean_start_pos=8200000, clean_num=200000) [2024-09-11 16:28:45.073884] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:45.206577] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:45.206621] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:45.206629] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:45.206639] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:45.274080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:45.406881] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:45.406957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:45.406965] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:45.406973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:45.466430] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:45.474216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:45.607304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:45.607351] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:45.607358] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:45.607368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:45.674407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:45.768452] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:45.807613] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:45.807659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:45.807666] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:45.807675] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:45.874529] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:45.952889] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043325952885, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:28:45.954245] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043325954243, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007546, add_bytes: 0 [2024-09-11 16:28:46.007914] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:46.007949] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:46.007956] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:46.007982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:46.074650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:46.208228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:46.208271] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:46.208278] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:46.208288] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:46.274771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:46.408588] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:46.408635] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:46.408643] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:46.408653] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:46.466590] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=69] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:46.474928] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:46.608981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:46.609026] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:46.609034] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:46.609043] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:46.675058] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:46.769672] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:46.809263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:46.809307] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:46.809314] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:46.809343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:46.878691] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3516, replace_start_pos=6500000, replace_num=100000) [2024-09-11 16:28:46.878743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:46.960456] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1726043326960453, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007568, add_bytes: 0 [2024-09-11 16:28:46.961928] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043326961927, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:28:47.009673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:47.009721] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:47.009728] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:47.009736] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:47.017063] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7313, clean_start_pos=8400000, clean_num=200000) [2024-09-11 16:28:47.078841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=11] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:47.217314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:47.217354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:47.217362] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:47.217371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:47.278977] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:47.417671] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:47.417737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:47.417746] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:47.417756] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:47.466735] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:47.479094] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:47.618009] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:47.618054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:47.618061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:47.618070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:47.679207] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:47.770703] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:47.818286] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:47.818336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:47.818342] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:47.818350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:47.879315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:47.968081] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043327968075, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:28:47.969486] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043327969484, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007557, add_bytes: 0 [2024-09-11 16:28:48.018565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:48.018605] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:48.018612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:48.018636] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:48.079428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:48.218855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:48.218915] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:48.218923] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:48.218930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:48.279571] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:48.419222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:48.419269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:48.419277] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:48.419286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:48.466916] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:48.479689] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:48.619497] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:48.619538] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:48.619544] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:48.619551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:48.679799] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:48.771639] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:48.819792] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:48.819840] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:48.819848] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:48.819857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:48.879912] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:48.975670] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1726043328975666, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007591, add_bytes: 0 [2024-09-11 16:28:48.977165] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=291] PNIO [ratelimit] time: 1726043328977162, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:28:49.020157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:49.020203] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:49.020211] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:49.020221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:49.029022] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8787, clean_start_pos=8600000, clean_num=200000) [2024-09-11 16:28:49.083396] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3344, replace_start_pos=6600000, replace_num=100000) [2024-09-11 16:28:49.083441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:49.229372] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:49.229416] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:49.229424] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:49.229434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:49.283531] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:49.429673] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:49.429714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:49.429720] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:49.429729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:49.467050] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:49.483645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:49.630007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:49.630056] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:49.630064] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:49.630074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:49.683761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:49.772796] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:49.830315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:49.830364] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:49.830372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:49.830381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:49.883882] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:49.983354] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043329983349, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007683, add_bytes: 0 [2024-09-11 16:28:49.984718] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043329984716, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007554, add_bytes: 0 [2024-09-11 16:28:50.030592] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:50.030631] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:50.030638] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:50.030645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:50.084005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:50.230956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:50.230996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:50.231001] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:50.231028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:50.284128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:50.431256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:50.431301] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:50.431308] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:50.431318] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:50.467161] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:50.484256] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:50.631628] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:50.631680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:50.631689] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:50.631698] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:50.684432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:50.774002] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:50.832043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:50.832086] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:50.832093] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:50.832101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:50.884551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:50.990961] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726043330990957, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:28:50.992334] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043330992332, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:28:51.032348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:51.032412] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:51.032420] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:51.032430] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:51.039677] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7236, clean_start_pos=8800000, clean_num=200000) [2024-09-11 16:28:51.084676] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:51.240028] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:51.240074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:51.240081] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:51.240091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:51.288194] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3390, replace_start_pos=6700000, replace_num=100000) [2024-09-11 16:28:51.288243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:51.440317] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:51.440362] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:51.440370] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:51.440379] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:51.467301] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:51.488303] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:51.640599] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:51.640639] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:51.640645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:51.640652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:51.688446] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:51.775190] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:51.840882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:51.840939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:51.840946] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:51.840956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:51.888574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:51.998607] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043331998602, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007645, add_bytes: 0 [2024-09-11 16:28:52.000015] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726043332000014, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:28:52.041176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:52.041209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:52.041216] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:52.041225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:52.088706] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:52.241435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:52.241475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:52.241481] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:52.241489] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:52.288832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:52.441737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:52.441783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:52.441791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:52.441800] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:52.467414] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:52.488953] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:52.642058] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:52.642104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:52.642112] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:52.642121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:52.689063] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:52.776064] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:52.842363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:52.842411] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:52.842419] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:52.842429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:52.889180] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:53.006145] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1726043333006141, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007539, add_bytes: 0 [2024-09-11 16:28:53.007576] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043333007574, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007560, add_bytes: 0 [2024-09-11 16:28:53.042725] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:53.042769] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:53.042777] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:53.042787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:53.050526] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7698, clean_start_pos=9000000, clean_num=200000) [2024-09-11 16:28:53.089285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:53.250773] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:53.250814] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:53.250820] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:53.250827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:53.289475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:53.451060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:53.451094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:53.451101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:53.451110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:53.467539] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:53.494065] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4401, replace_start_pos=6800000, replace_num=100000) [2024-09-11 16:28:53.494111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:53.651333] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:53.651381] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:53.651388] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:53.651418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:53.694204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:53.736718] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:53.736766] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:28:53.736846] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=235, max_check_version=236, global_version=237) [2024-09-11 16:28:53.738854] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2007 [2024-09-11 16:28:53.738897] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:53.738948] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:28:53.738986] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:28:53.739094] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:28:53.739201] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,232 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 222,080 used= 209,200 count= 26 avg_used= 8,046 block_cnt= 26 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,232 used= 76,294,972 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:28:53.739255] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:28:53.739267] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:28:53.739282] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:28:53.739318] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:28:53.739378] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:28:53.739400] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:28:53.777179] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:53.851653] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:53.851696] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:53.851703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:53.851712] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:53.894335] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:54.013767] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726043334013762, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:28:54.015182] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=394] PNIO [ratelimit] time: 1726043334015179, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007605, add_bytes: 0 [2024-09-11 16:28:54.052083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:54.052132] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:54.052140] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:54.052149] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:54.094461] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:54.252479] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:54.252521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:54.252529] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:54.252539] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:54.294606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:54.452838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:54.452885] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:54.452893] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:54.452925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:54.467658] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:54.494727] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:54.653222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:54.653264] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:54.653273] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:54.653283] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:54.694852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:54.778404] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:54.853525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:54.853565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:54.853573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:54.853582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:54.895021] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=91] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:55.021456] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043335021451, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007689, add_bytes: 0 [2024-09-11 16:28:55.022796] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043335022794, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2024-09-11 16:28:55.053931] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:55.053977] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:55.053985] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:55.053994] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:55.062269] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8259, clean_start_pos=9200000, clean_num=200000) [2024-09-11 16:28:55.095135] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:55.262520] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:55.262565] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:55.262573] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:55.262582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:55.295244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:55.462801] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:55.462841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:55.462849] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:55.462858] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:55.467847] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:55.495368] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:55.663097] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:55.663140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:55.663147] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:55.663156] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:55.699847] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4343, replace_start_pos=6900000, replace_num=100000) [2024-09-11 16:28:55.699895] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:55.779497] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:55.863392] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:55.863435] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:55.863443] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:55.863452] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:55.900052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:56.029050] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043336029045, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:28:56.030410] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043336030407, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:28:56.063669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:56.063714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:56.063721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:56.063729] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:56.100274] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:56.264046] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:56.264109] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:56.264117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:56.264126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:56.300411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:56.464349] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:56.464393] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:56.464400] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:56.464409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:56.464638] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Wash time detail, (compute_wash_size_time=77, refresh_score_time=63, wash_time=0) [2024-09-11 16:28:56.468066] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:56.500542] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:56.664878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:56.664940] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:56.664955] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:56.664970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:56.700768] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:56.780520] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=91] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:56.865206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=14][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:56.865249] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:56.865257] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:56.865266] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:56.900930] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:57.036594] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043337036590, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007545, add_bytes: 0 [2024-09-11 16:28:57.038104] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043337038102, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007695, add_bytes: 0 [2024-09-11 16:28:57.065509] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:57.065555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:57.065563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:57.065572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:57.073671] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8085, clean_start_pos=9400000, clean_num=200000) [2024-09-11 16:28:57.101085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:57.273957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:57.274002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:57.274009] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:57.274018] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:57.301218] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:57.468259] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:57.474255] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:57.474290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:57.474297] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:57.474306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:57.501399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:57.674576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:57.674620] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:57.674628] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:57.674637] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:57.701618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:28:57.781452] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:57.874866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:57.874932] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:57.874944] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:57.874956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:57.906048] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4289, replace_start_pos=7000000, replace_num=100000) [2024-09-11 16:28:57.906087] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:28:58.044220] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=86] PNIO [ratelimit] time: 1726043338044216, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2024-09-11 16:28:58.045726] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043338045723, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:28:58.075191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:58.075233] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:58.075240] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:58.075249] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:58.106189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:28:58.275506] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:58.275555] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:58.275563] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:58.275589] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:58.306324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:28:58.468370] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:58.475924] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:58.475957] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:58.475965] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:58.475974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:58.506453] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:28:58.676273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:58.676321] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:58.676329] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:58.676338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:58.706572] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:28:58.782418] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:58.876578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:58.876623] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:58.876631] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:58.876641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:58.906709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:28:59.051899] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1726043339051894, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007678, add_bytes: 0 [2024-09-11 16:28:59.053348] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=75] PNIO [ratelimit] time: 1726043339053346, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:28:59.076871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:59.076950] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=78][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:59.076959] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:59.076968] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:59.084978] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7996, clean_start_pos=9600000, clean_num=200000) [2024-09-11 16:28:59.106848] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:28:59.285308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:59.285354] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:59.285363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:59.285373] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:59.307113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:28:59.468501] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:28:59.485683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:59.485723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:59.485731] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:59.485740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:59.507248] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:28:59.686060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:59.686104] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:59.686132] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:59.686142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:59.707365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:28:59.783489] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:28:59.886459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:28:59.886513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:28:59.886523] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:28:59.886533] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:28:59.907545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:00.048954] INFO pn_print_diag_info (group.c:746) [74255][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:13/2782, server_queue_time=0, cnt=0 [2024-09-11 16:29:00.054994] INFO pn_print_diag_info (group.c:746) [74254][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:11/2354, server_queue_time=0, cnt=0 [2024-09-11 16:29:00.059531] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1726043340059528, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2024-09-11 16:29:00.059569] INFO pn_print_diag_info (group.c:746) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2024-09-11 16:29:00.060870] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043340060868, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007522, add_bytes: 0 [2024-09-11 16:29:00.060892] INFO pn_print_diag_info (group.c:746) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=21] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:10/2140, server_queue_time=0, cnt=0 [2024-09-11 16:29:00.086833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:00.086877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:00.086884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:00.086892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:00.111317] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3644, replace_start_pos=7100000, replace_num=100000) [2024-09-11 16:29:00.111362] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:00.287145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:00.287205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:00.287213] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:00.287221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:00.311454] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:00.468613] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:00.487514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:00.487551] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:00.487559] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:00.487569] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:00.511638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:00.687876] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:00.687952] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:00.687964] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:00.687973] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:00.711840] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:00.784541] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:00.888295] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:00.888341] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:00.888348] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:00.888358] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:00.912000] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:01.067123] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=7] PNIO [ratelimit] time: 1726043341067119, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007591, add_bytes: 0 [2024-09-11 16:29:01.068495] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=6] PNIO [ratelimit] time: 1726043341068493, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:29:01.088596] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:01.088641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:01.088648] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:01.088658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:01.097271] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8601, clean_start_pos=9800000, clean_num=200000) [2024-09-11 16:29:01.112123] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:01.297543] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:01.297586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:01.297595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:01.297604] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:01.312241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:01.468759] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=72] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:01.497830] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:01.497873] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:01.497881] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:01.497890] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:01.512374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:01.698145] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:01.698191] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:01.698199] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:01.698208] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:01.712519] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:01.785496] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:01.898432] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:01.898475] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:01.898483] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:01.898492] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:01.912640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:02.074740] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043342074736, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:29:02.076112] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043342076111, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:29:02.098735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:02.098783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:02.098791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:02.098801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:02.112776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:02.299054] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:02.299099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:02.299106] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:02.299116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:02.316260] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3366, replace_start_pos=7200000, replace_num=100000) [2024-09-11 16:29:02.316316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:02.468875] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:02.499350] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:02.499385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:02.499392] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:02.499402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:02.516416] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:02.699710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:02.699756] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:02.699764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:02.699774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:02.716629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:02.786568] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:02.900052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:02.900095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:02.900102] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:02.900112] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:02.916809] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:03.082365] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043343082361, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007625, add_bytes: 0 [2024-09-11 16:29:03.083728] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726043343083727, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:29:03.100414] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:03.100462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:03.100470] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:03.100495] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:03.108593] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8083, clean_start_pos=10000000, clean_num=200000) [2024-09-11 16:29:03.116929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:03.308854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:03.308898] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:03.308928] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:03.308937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:03.309123] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:29:03.317044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:03.469013] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=66] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:03.509365] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:03.509410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:03.509418] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:03.509427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:03.517171] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:03.709654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:03.709698] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:03.709721] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:03.709731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:03.717279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:03.752719] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:03.752774] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=54] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:03.752853] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=236, max_check_version=237, global_version=238) [2024-09-11 16:29:03.754618] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1765 [2024-09-11 16:29:03.754664] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:03.754696] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:29:03.754752] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:29:03.754830] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:03.754926] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,709,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 214,192 used= 201,512 count= 25 avg_used= 8,060 block_cnt= 25 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,709,344 used= 76,295,092 count= 1,553 avg_used= 49,127 mod=SUMMARY [2024-09-11 16:29:03.754973] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:29:03.754987] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:29:03.754996] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:29:03.755032] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:29:03.755081] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:29:03.755101] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:29:03.787540] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=77] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:03.909992] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:03.910039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:03.910048] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:03.910058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:03.917399] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:04.089932] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1726043344089927, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007566, add_bytes: 0 [2024-09-11 16:29:04.091351] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=364] PNIO [ratelimit] time: 1726043344091348, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2024-09-11 16:29:04.110291] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:04.110336] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:04.110343] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:04.110370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:04.117515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:04.310662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:04.310706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:04.310715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:04.310724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:04.317630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:04.469144] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:04.511041] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:04.511080] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:04.511087] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:04.511097] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:04.521061] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3322, replace_start_pos=7300000, replace_num=100000) [2024-09-11 16:29:04.521108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:04.711338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:04.711378] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:04.711386] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:04.711408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:04.721258] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:04.788655] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:04.911783] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:04.911827] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:04.911855] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:04.911865] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:04.921376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:05.097612] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043345097607, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:29:05.098958] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043345098957, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:29:05.112107] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:05.112151] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:05.112159] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:05.112169] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:05.119236] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7054, clean_start_pos=10200000, clean_num=200000) [2024-09-11 16:29:05.121504] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:05.319500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:05.319544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:05.319553] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:05.319563] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:05.321619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:05.469281] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:05.519860] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:05.519899] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:05.519927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:05.519937] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:05.521781] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:05.720237] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:05.720282] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:05.720290] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:05.720300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:05.721960] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:05.789476] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:05.920652] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:05.920694] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:05.920703] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:05.920714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:05.922079] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:06.105146] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043346105143, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007536, add_bytes: 0 [2024-09-11 16:29:06.106638] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=17] PNIO [ratelimit] time: 1726043346106637, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007680, add_bytes: 0 [2024-09-11 16:29:06.121077] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:06.121115] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:06.121123] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:06.121132] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:06.122189] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:06.321437] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:06.321481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:06.321489] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:06.321499] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:06.322323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:06.469437] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:06.521737] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:06.521775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:06.521782] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:06.521791] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:06.522492] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:06.722096] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:06.722140] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:06.722148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:06.722159] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:06.727171] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4564, replace_start_pos=7400000, replace_num=100000) [2024-09-11 16:29:06.727217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:06.790419] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:06.922398] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:06.922439] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:06.922447] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:06.922456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:06.927309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:07.112769] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043347112765, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2024-09-11 16:29:07.114258] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=19] PNIO [ratelimit] time: 1726043347114256, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:29:07.122764] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:07.122805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:07.122813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:07.122823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:07.127423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:07.130486] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7650, clean_start_pos=10400000, clean_num=200000) [2024-09-11 16:29:07.327523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:07.330795] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:07.330822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:07.330830] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:07.330839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:07.469572] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:07.527646] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:07.531141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:07.531176] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:07.531202] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:07.531212] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:07.727760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:07.731544] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:07.731575] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:07.731583] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:07.731592] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:07.791364] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:07.927878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:07.931886] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:07.931933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:07.931941] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:07.931951] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:08.120443] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043348120439, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007674, add_bytes: 0 [2024-09-11 16:29:08.121795] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043348121793, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007537, add_bytes: 0 [2024-09-11 16:29:08.128005] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:08.132248] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:08.132275] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:08.132283] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:08.132293] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:08.328122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:08.332583] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:08.332630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:08.332639] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:08.332648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:08.469690] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:08.528234] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:08.532973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:08.533010] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:08.533018] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:08.533027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:08.728345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:08.733339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:08.733376] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:08.733385] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:08.733394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:08.792312] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:08.932886] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4417, replace_start_pos=7500000, replace_num=100000) [2024-09-11 16:29:08.932938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:08.933688] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:08.933723] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:08.933732] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:08.933742] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:09.127995] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1726043349127991, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:29:09.129432] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=525] PNIO [ratelimit] time: 1726043349129428, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:29:09.133033] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:09.134072] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:09.134102] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:09.134110] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:09.134119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:09.142208] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8075, clean_start_pos=10600000, clean_num=200000) [2024-09-11 16:29:09.333238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:09.342470] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:09.342507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:09.342514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:09.342524] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:09.469894] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:09.533355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:09.542776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:09.542822] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:09.542829] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:09.542839] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:09.733469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:09.743167] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:09.743214] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:09.743222] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:09.743232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:09.793152] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=86] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:09.933587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:09.943469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:09.943512] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:09.943520] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:09.943529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:10.133776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:10.135694] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043350135691, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007700, add_bytes: 0 [2024-09-11 16:29:10.137035] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1726043350137034, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:29:10.143842] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:10.143871] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:10.143879] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:10.143887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:10.333898] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:10.344223] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:10.344268] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:10.344276] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:10.344286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:10.470091] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:10.534092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:10.544598] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:10.544637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:10.544645] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:10.544655] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:10.734216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:10.744987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:10.745033] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:10.745040] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:10.745049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:10.793945] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:10.934329] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:10.945300] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:10.945346] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:10.945354] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:10.945364] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:11.137930] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3481, replace_start_pos=7600000, replace_num=100000) [2024-09-11 16:29:11.137978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:11.143285] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043351143281, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007590, add_bytes: 0 [2024-09-11 16:29:11.144645] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=13] PNIO [ratelimit] time: 1726043351144643, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:29:11.145715] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:11.145759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:11.145767] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:11.145776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:11.154349] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8560, clean_start_pos=10800000, clean_num=200000) [2024-09-11 16:29:11.338122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:11.354614] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:11.354659] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:11.354667] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:11.354676] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:11.470302] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=75] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:11.538240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:11.554996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:11.555039] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:11.555047] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:11.555057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:11.738388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:11.755358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:11.755403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:11.755431] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:11.755442] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:11.794969] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=84] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:11.938518] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:11.955683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:11.955729] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:11.955737] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:11.955746] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:12.138743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:12.150847] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043352150843, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007562, add_bytes: 0 [2024-09-11 16:29:12.152280] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043352152278, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:29:12.156003] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:12.156036] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:12.156044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:12.156053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:12.338931] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:12.356385] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:12.356433] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:12.356441] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:12.356450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:12.470422] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:12.539124] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:12.556787] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:12.556829] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:12.556837] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:12.556847] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:12.739289] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:12.757165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:12.757209] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:12.757217] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:12.757225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:12.795729] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=68] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:12.939419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:12.957481] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:12.957519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:12.957527] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:12.957536] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:13.139532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:13.157835] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:13.157878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:13.157887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:13.157897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:13.158469] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043353158466, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:29:13.159920] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=22] PNIO [ratelimit] time: 1726043353159918, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2024-09-11 16:29:13.166005] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8068, clean_start_pos=11000000, clean_num=200000) [2024-09-11 16:29:13.343983] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4326, replace_start_pos=7700000, replace_num=100000) [2024-09-11 16:29:13.344028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:13.366340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:13.366384] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:13.366392] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:13.366402] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:13.470553] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:13.544111] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:13.566634] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:13.566680] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:13.566687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:13.566696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:13.744241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:13.767005] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:13.767052] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:13.767061] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:13.767070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:13.768334] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:13.768371] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=36] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:13.768445] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=237, max_check_version=238, global_version=239) [2024-09-11 16:29:13.770219] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1773 [2024-09-11 16:29:13.770253] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:13.770285] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:29:13.770318] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:29:13.770415] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:13.770498] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,733,008 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 237,856 used= 224,576 count= 28 avg_used= 8,020 block_cnt= 28 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,733,008 used= 76,318,156 count= 1,556 avg_used= 49,047 mod=SUMMARY [2024-09-11 16:29:13.770543] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:29:13.770552] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:29:13.770561] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:29:13.770595] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:29:13.770643] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:29:13.770661] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:29:13.796527] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:13.944346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:13.967297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:13.967343] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:13.967350] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:13.967359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:14.144468] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:14.166131] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043354166127, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007661, add_bytes: 0 [2024-09-11 16:29:14.167525] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043354167522, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:29:14.167595] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:14.167619] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:14.167625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:14.167632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:14.344599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:14.367863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:14.367939] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:14.367947] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:14.367956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:14.470680] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:14.544736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:14.568228] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:14.568272] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:14.568280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:14.568290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:14.744869] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:14.768541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:14.768586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:14.768593] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:14.768602] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:14.797376] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:14.945001] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:14.968895] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:14.968953] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:14.968960] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:14.968970] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:15.145184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:15.169297] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:15.169344] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:15.169351] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:15.169360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:15.173744] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043355173741, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:29:15.175120] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043355175119, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007597, add_bytes: 0 [2024-09-11 16:29:15.177821] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8448, clean_start_pos=11200000, clean_num=200000) [2024-09-11 16:29:15.345388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:15.378141] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:15.378189] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:15.378197] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:15.378207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:15.470872] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:15.548864] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3359, replace_start_pos=7800000, replace_num=100000) [2024-09-11 16:29:15.548907] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:15.578444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:15.578491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:15.578499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:15.578529] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:15.748988] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:15.778759] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:15.778803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:15.778811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:15.778820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:15.798295] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:15.949246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:15.979114] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:15.979159] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:15.979168] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:15.979178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:16.149371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:16.179503] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:16.179547] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:16.179555] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:16.179565] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:16.181313] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1726043356181311, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007570, add_bytes: 0 [2024-09-11 16:29:16.182740] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO [ratelimit] time: 1726043356182738, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:29:16.349599] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:16.379866] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:16.379936] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:16.379962] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:16.379972] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:16.471139] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=89] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:16.549718] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:16.580269] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:16.580314] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:16.580322] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:16.580332] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:16.749824] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:16.780645] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:16.780693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:16.780701] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:16.780711] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:16.780950] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Wash time detail, (compute_wash_size_time=82, refresh_score_time=63, wash_time=0) [2024-09-11 16:29:16.799138] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:16.949940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:16.981252] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:16.981290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:16.981298] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:16.981307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:17.150060] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:17.181548] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:17.181586] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:17.181611] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:17.181620] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:17.188913] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043357188910, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2024-09-11 16:29:17.190151] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8518, clean_start_pos=11400000, clean_num=200000) [2024-09-11 16:29:17.190343] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043357190342, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:29:17.350188] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:17.390405] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:17.390450] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:17.390457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:17.390467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:17.471336] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=57] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:17.550314] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:17.590768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:17.590813] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:17.590821] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:17.590831] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:17.754785] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4355, replace_start_pos=7900000, replace_num=100000) [2024-09-11 16:29:17.754852] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:17.791060] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:17.791106] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:17.791113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:17.791122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:17.799932] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:17.954947] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=10] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:17.991356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:17.991396] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:17.991404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:17.991413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:18.155080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:18.191666] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:18.191714] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:18.191722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:18.191732] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:18.196529] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043358196526, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2024-09-11 16:29:18.197955] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=11] PNIO [ratelimit] time: 1726043358197954, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2024-09-11 16:29:18.355204] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:18.391991] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:18.392030] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:18.392038] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:18.392047] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:18.471514] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:18.555325] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:18.592290] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:18.592331] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:18.592339] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:18.592348] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:18.755445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:18.792581] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:18.792627] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:18.792634] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:18.792643] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:18.800985] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:18.955560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:18.992865] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:18.992922] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:18.992931] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:18.992940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:19.155682] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:19.193161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:19.193205] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:19.193213] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:19.193222] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:19.201964] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8705, clean_start_pos=11600000, clean_num=200000) [2024-09-11 16:29:19.204148] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043359204145, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:29:19.205642] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726043359205640, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007686, add_bytes: 0 [2024-09-11 16:29:19.355800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:19.402227] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:19.402278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:19.402286] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:19.402295] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:19.471777] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=105] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:19.555919] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:19.602541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:19.602585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:19.602592] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:19.602601] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:19.756039] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:19.801927] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:19.802824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:19.802855] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:19.802863] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:19.802873] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:19.802887] INFO run1 (ob_timer.cpp:374) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] dump timer info(this=0x7f529d2ad7f0, tasks_num=0, wakeup_time=104017457714) [2024-09-11 16:29:19.960369] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4214, replace_start_pos=8000000, replace_num=100000) [2024-09-11 16:29:19.960407] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:20.003118] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:20.003161] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:20.003169] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:20.003178] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:20.160515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:20.203421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:20.203465] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:20.203472] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:20.203481] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:20.211831] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=28] PNIO [ratelimit] time: 1726043360211827, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007682, add_bytes: 0 [2024-09-11 16:29:20.213190] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043360213189, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:29:20.360657] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:20.403710] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:20.403755] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:20.403764] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:20.403774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:20.471926] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:20.560837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:20.604027] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:20.604067] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:20.604073] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:20.604080] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:20.760984] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:20.802953] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:20.804313] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:20.804339] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:20.804347] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:20.804356] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:20.961114] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:21.004661] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:21.004707] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:21.004715] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:21.004724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:21.161239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:21.204998] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:21.205035] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:21.205043] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:21.205053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:21.212136] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7070, clean_start_pos=11800000, clean_num=200000) [2024-09-11 16:29:21.219380] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043361219376, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2024-09-11 16:29:21.220802] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO [ratelimit] time: 1726043361220802, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2024-09-11 16:29:21.361455] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:21.412403] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:21.412444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:21.412451] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:21.412460] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:21.472075] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:21.561576] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:21.612724] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:21.612768] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:21.612775] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:21.612786] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:21.761707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:21.803860] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:21.813095] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:21.813139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:21.813148] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:21.813157] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:21.961929] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:22.013454] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:22.013500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:22.013508] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:22.013517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:22.166434] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4366, replace_start_pos=8100000, replace_num=100000) [2024-09-11 16:29:22.166482] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:22.213867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:22.213933] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:22.213943] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:22.213953] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:22.227074] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043362227068, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007692, add_bytes: 0 [2024-09-11 16:29:22.228421] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=9] PNIO [ratelimit] time: 1726043362228419, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:29:22.366633] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:22.414247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:22.414293] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:22.414301] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:22.414311] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:22.472195] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:22.566767] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:22.614608] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:22.614654] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:22.614680] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:22.614690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:22.766958] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:22.804865] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=100] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:22.815019] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:22.815073] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:22.815080] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:22.815088] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:22.967105] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:23.015304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:23.015363] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:23.015372] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:23.015383] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:23.167246] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:23.215630] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:23.215683] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:23.215691] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:23.215701] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:23.223043] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7327, clean_start_pos=12000000, clean_num=200000) [2024-09-11 16:29:23.234610] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043363234606, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007538, add_bytes: 0 [2024-09-11 16:29:23.236111] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043363236109, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:29:23.367445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:23.423417] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:23.423459] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:23.423467] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:23.423476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:23.472322] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:23.567659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:23.623704] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:23.623748] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:23.623756] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:23.623765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:23.767848] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:23.784648] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:23.784699] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:23.784783] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] update_check_range(min_check_version=238, max_check_version=239, global_version=240) [2024-09-11 16:29:23.786798] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2012 [2024-09-11 16:29:23.786862] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:23.786898] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:29:23.786965] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=36] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:29:23.787049] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:23.787173] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:29:23.787233] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:29:23.787244] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:29:23.787255] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:29:23.787291] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:29:23.787352] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:29:23.787374] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:29:23.806324] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:23.824083] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:23.824129] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:23.824137] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:23.824168] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:23.968040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:24.024519] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:24.024566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:24.024574] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:24.024583] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:24.168231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:24.224816] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:24.224853] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:24.224860] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:24.224869] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:24.242241] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1726043364242237, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:29:24.243771] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043364243768, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007659, add_bytes: 0 [2024-09-11 16:29:24.371680] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3317, replace_start_pos=8200000, replace_num=100000) [2024-09-11 16:29:24.371724] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:24.425181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:24.425225] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:24.425258] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:24.425268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:24.472445] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:24.571827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:24.625562] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:24.625604] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:24.625612] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:24.625622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:24.771963] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:24.807283] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:24.825956] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:24.826002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:24.826010] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:24.826019] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:24.972100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:25.026326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:25.026374] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:25.026383] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:25.026392] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:25.172236] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:25.226625] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:25.226669] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:25.226699] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:25.226709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:25.234795] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8072, clean_start_pos=12200000, clean_num=200000) [2024-09-11 16:29:25.249920] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043365249916, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007679, add_bytes: 0 [2024-09-11 16:29:25.251288] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043365251286, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007518, add_bytes: 0 [2024-09-11 16:29:25.372425] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:25.435126] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:25.435170] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:25.435178] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:25.435188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:25.472567] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:25.572617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:25.635444] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:25.635491] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:25.635499] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:25.635509] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:25.772752] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:25.808430] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=93] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:25.835735] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:25.835772] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:25.835780] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:25.835790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:25.972892] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:26.036122] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:26.036164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:26.036172] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:26.036182] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:26.173138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=77] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:26.236485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:26.236530] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:26.236538] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:26.236568] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:26.257553] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1726043366257549, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007633, add_bytes: 0 [2024-09-11 16:29:26.258897] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=31] PNIO [ratelimit] time: 1726043366258895, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:29:26.373331] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:26.436811] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:26.436859] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:26.436867] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:26.436876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:26.472701] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:26.577962] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4409, replace_start_pos=8300000, replace_num=100000) [2024-09-11 16:29:26.578014] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:26.637171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:26.637210] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:26.637218] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:26.637229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:26.778122] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:26.809353] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:26.837521] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:26.837563] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:26.837571] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:26.837580] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:26.978315] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:27.037884] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:27.037951] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:27.037959] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:27.037969] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:27.178441] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:27.238263] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:27.238308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:27.238316] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:27.238326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:27.246162] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7823, clean_start_pos=12400000, clean_num=200000) [2024-09-11 16:29:27.265068] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043367265063, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007514, add_bytes: 0 [2024-09-11 16:29:27.266515] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1726043367266512, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2024-09-11 16:29:27.378582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:27.446443] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:27.446488] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:27.446496] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:27.446505] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:27.472865] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=80] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:27.578703] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:27.646739] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:27.646784] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:27.646791] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:27.646801] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:27.778826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:27.810372] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:27.847055] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:27.847099] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:27.847107] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:27.847117] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:27.978961] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:28.047348] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:28.047391] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:28.047415] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:28.047424] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:28.179083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:28.247775] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:28.247837] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:28.247847] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:28.247856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:28.272685] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043368272681, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:29:28.274227] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043368274224, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007712, add_bytes: 0 [2024-09-11 16:29:28.379208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:28.448165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:28.448211] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:28.448219] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:28.448229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:28.473065] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=34] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:28.579424] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:28.648457] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:28.648495] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:28.648518] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:28.648527] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:28.783127] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3570, replace_start_pos=8400000, replace_num=100000) [2024-09-11 16:29:28.783170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:28.811253] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:28.848766] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:28.848803] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:28.848811] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:28.848820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:28.983251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=6] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:29.049117] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:29.049165] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:29.049173] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:29.049183] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:29.183372] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:29.249419] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:29.249460] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:29.249468] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:29.249478] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:29.256743] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7251, clean_start_pos=0, clean_num=200000) [2024-09-11 16:29:29.280376] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1726043369280371, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007690, add_bytes: 0 [2024-09-11 16:29:29.281747] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=34] PNIO [ratelimit] time: 1726043369281745, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007521, add_bytes: 0 [2024-09-11 16:29:29.383501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:29.457020] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:29.457074] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:29.457085] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:29.457094] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:29.473257] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:29.583624] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:29.657389] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:29.657436] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:29.657444] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:29.657453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:29.783717] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:29.812303] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:29.857691] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:29.857731] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:29.857739] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:29.857748] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:29.983823] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:30.058000] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:30.058043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:30.058050] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:30.058058] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:30.183938] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:30.258308] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:30.258353] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:30.258360] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:30.258370] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:30.287940] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1726043370287936, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007565, add_bytes: 0 [2024-09-11 16:29:30.289422] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043370289420, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:29:30.384089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:30.458662] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:30.458706] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:30.458714] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:30.458724] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:30.473365] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:30.584231] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:30.659047] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:30.659093] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:30.659101] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:30.659111] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:30.784490] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:30.813314] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:30.859446] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:30.859489] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:30.859497] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:30.859506] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:30.989131] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4486, replace_start_pos=8500000, replace_num=100000) [2024-09-11 16:29:30.989182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:31.059761] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:31.059805] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:31.059813] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:31.059822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:31.189320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:31.260127] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:31.260172] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:31.260179] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:31.260188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:31.266817] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=6617, clean_start_pos=200000, clean_num=200000) [2024-09-11 16:29:31.295535] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043371295530, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007594, add_bytes: 0 [2024-09-11 16:29:31.296986] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043371296983, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007563, add_bytes: 0 [2024-09-11 16:29:31.389619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:31.467094] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:31.467142] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:31.467177] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:31.467188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:31.473505] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=64] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:31.589807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:31.667410] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:31.667451] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:31.667457] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:31.667465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:31.789993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:31.814325] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:31.867695] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:31.867736] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:31.867743] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:31.867752] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:31.990121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:32.068007] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:32.068045] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:32.068052] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:32.068061] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:32.190251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:32.268296] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:32.268340] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:32.268369] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:32.268379] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:32.303165] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1726043372303161, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007631, add_bytes: 0 [2024-09-11 16:29:32.304593] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=32] PNIO [ratelimit] time: 1726043372304592, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2024-09-11 16:29:32.390457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:32.468637] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:32.468678] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:32.468687] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:32.468696] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:32.473672] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:32.590652] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:32.668964] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:32.669014] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:32.669022] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:32.669031] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:32.790846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:32.815358] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:32.869279] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:32.869326] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:32.869333] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:32.869342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:32.990922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:33.069576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:33.069641] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:33.069650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:33.069660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:33.194930] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=30] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3905, replace_start_pos=8600000, replace_num=100000) [2024-09-11 16:29:33.194973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:33.269990] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:33.270034] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:33.270042] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:33.270051] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:33.278521] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8457, clean_start_pos=400000, clean_num=200000) [2024-09-11 16:29:33.310888] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043373310883, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007722, add_bytes: 0 [2024-09-11 16:29:33.312203] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=27] PNIO [ratelimit] time: 1726043373312200, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2024-09-11 16:29:33.395057] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:33.473862] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:33.478841] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:33.478878] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:33.478886] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:33.478939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:33.479134] INFO print_current_status (ob_kvcache_hazard_version.cpp:441) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=16] [KVCACHE-HAZARD] hazard version status info: current version: 0 | min_version= 0 | total thread store count: 2 | total nodes count: 0 | øøç [2024-09-11 16:29:33.595233] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:33.679466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:33.679511] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:33.679519] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:33.679528] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:33.795427] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:33.801263] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=10] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:33.801314] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:33.801396] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] update_check_range(min_check_version=239, max_check_version=240, global_version=241) [2024-09-11 16:29:33.803416] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 2018 [2024-09-11 16:29:33.803451] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=22] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:33.803507] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:29:33.803545] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=8] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:29:33.803629] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:33.803736] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,725,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 191,152 used= 187,056 count= 24 avg_used= 7,794 block_cnt= 24 chunk_cnt= 6 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,725,120 used= 76,310,468 count= 1,555 avg_used= 49,074 mod=SUMMARY [2024-09-11 16:29:33.803793] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:29:33.803804] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:29:33.803815] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:29:33.803851] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:29:33.803923] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:29:33.803948] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:29:33.816458] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=161] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:33.879824] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:33.879867] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:33.879875] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:33.879884] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:33.995608] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:34.080160] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:34.080206] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:34.080215] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:34.080224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:34.195725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:34.280469] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:34.280513] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:34.280521] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:34.280530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:34.318394] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=73] PNIO [ratelimit] time: 1726043374318390, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007507, add_bytes: 0 [2024-09-11 16:29:34.319924] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043374319899, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007699, add_bytes: 0 [2024-09-11 16:29:34.395861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:34.474087] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:34.480857] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:34.480893] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:34.480919] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:34.480931] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:34.596066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:34.681247] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=24][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:34.681292] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:34.681300] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:34.681310] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:34.796235] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:34.817253] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=80] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:34.881541] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:34.881578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:34.881585] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:34.881595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:34.996404] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:35.081833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:35.081882] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:35.081889] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:35.081898] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:35.196582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:35.282136] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:35.282177] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:35.282183] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:35.282192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:35.290804] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8599, clean_start_pos=600000, clean_num=200000) [2024-09-11 16:29:35.325999] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1726043375325996, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2024-09-11 16:29:35.327502] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043375327499, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2024-09-11 16:29:35.401077] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4316, replace_start_pos=8700000, replace_num=100000) [2024-09-11 16:29:35.401125] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:35.474301] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:35.491139] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:35.491184] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:35.491192] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:35.491201] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:35.601276] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:35.691440] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:35.691485] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:35.691493] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:35.691502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:35.801413] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:35.818402] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:35.891730] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:35.891774] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:35.891782] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:35.891790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:36.001553] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:36.092064] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:36.092112] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:36.092141] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:36.092150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:36.201695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:36.292380] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:36.292421] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:36.292428] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:36.292437] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:36.333619] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=35] PNIO [ratelimit] time: 1726043376333615, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2024-09-11 16:29:36.335052] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1726043376335051, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007552, add_bytes: 0 [2024-09-11 16:29:36.401830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:36.474456] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:36.492676] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:36.492720] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:36.492727] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:36.492735] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:36.601965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:36.692973] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:36.693016] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:36.693044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:36.693053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:36.802104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:36.819340] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=73] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:36.893278] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:36.893338] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:36.893344] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:36.893354] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:37.002225] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:37.093576] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:37.093618] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:37.093625] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:37.093634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:37.093849] INFO [COMMON] wash (ob_kvcache_store.cpp:342) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash time detail, (compute_wash_size_time=71, refresh_score_time=65, wash_time=0) [2024-09-11 16:29:37.202456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:37.294147] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:37.294193] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:37.294201] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:37.294210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:37.302357] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8134, clean_start_pos=800000, clean_num=200000) [2024-09-11 16:29:37.341247] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1726043377341244, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2024-09-11 16:29:37.342729] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1726043377342726, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007675, add_bytes: 0 [2024-09-11 16:29:37.402592] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:37.474640] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:37.502612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:37.502650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:37.502658] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:37.502667] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:37.607136] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4359, replace_start_pos=8800000, replace_num=100000) [2024-09-11 16:29:37.607185] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:37.702935] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:37.702981] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:37.702989] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:37.702999] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:37.807282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:37.820489] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:37.903222] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:37.903256] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:37.903263] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:37.903272] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:38.007420] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:38.103502] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:38.103549] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:38.103557] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:38.103566] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:38.207563] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:38.303819] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:38.303863] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:38.303871] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:38.303880] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:38.348859] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1726043378348855, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2024-09-11 16:29:38.350284] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1726043378350282, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007556, add_bytes: 0 [2024-09-11 16:29:38.407684] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:38.474819] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=35] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:38.504068] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:38.504110] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:38.504117] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:38.504127] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:38.607872] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:38.704358] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:38.704395] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:38.704402] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:38.704412] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:38.808025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:38.821474] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=83] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:38.904650] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:38.904693] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:38.904722] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:38.904731] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:39.008149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:39.105061] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:39.105108] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:39.105116] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:39.105126] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:39.208265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:39.305434] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:39.305478] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:39.305486] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:39.305496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:39.313485] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=7976, clean_start_pos=1000000, clean_num=200000) [2024-09-11 16:29:39.356480] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=89] PNIO [ratelimit] time: 1726043379356475, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2024-09-11 16:29:39.357969] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043379357966, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007684, add_bytes: 0 [2024-09-11 16:29:39.408391] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:39.474963] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:39.513738] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:39.513791] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:39.513798] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:39.513807] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:39.608769] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=298] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:39.714181] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:39.714219] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:39.714227] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:39.714237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:39.813229] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4329, replace_start_pos=8900000, replace_num=100000) [2024-09-11 16:29:39.813269] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:39.822475] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:39.914466] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:39.914507] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:39.914514] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:39.914523] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:40.013378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:40.114740] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:40.114776] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:40.114782] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:40.114790] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:40.213506] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:40.315043] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:40.315105] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:40.315113] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:40.315122] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:40.364075] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043380364073, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2024-09-11 16:29:40.365576] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043380365573, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2024-09-11 16:29:40.413622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:40.475074] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:40.515355] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:40.515397] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:40.515404] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:40.515413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:40.613733] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:40.715709] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:40.715746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:40.715754] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:40.715763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:40.813853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:40.823463] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:40.916002] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:40.916037] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:40.916044] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:40.916053] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:41.013962] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=32] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:41.116273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=12][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:41.116325] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:41.116336] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:41.116350] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:41.214085] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:41.316570] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:41.316612] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:41.316619] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:41.316628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:41.325393] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8752, clean_start_pos=1200000, clean_num=200000) [2024-09-11 16:29:41.371713] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1726043381371708, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2024-09-11 16:29:41.373134] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043381373131, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007558, add_bytes: 0 [2024-09-11 16:29:41.414265] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:41.475205] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=62] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:41.525649] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:41.525692] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:41.525700] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:41.525709] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:41.614445] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:41.725966] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=26][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:41.725996] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:41.726003] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:41.726011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:41.814629] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:41.824473] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:41.926315] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:41.926356] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:41.926363] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:41.926372] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:42.019168] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4354, replace_start_pos=9000000, replace_num=100000) [2024-09-11 16:29:42.019213] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:42.126600] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:42.126643] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:42.126650] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:42.126659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:42.219309] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=9] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:42.326875] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:42.326919] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:42.326927] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:42.326936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:42.379316] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1726043382379312, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007604, add_bytes: 0 [2024-09-11 16:29:42.380803] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043382380801, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007670, add_bytes: 0 [2024-09-11 16:29:42.419428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:42.475377] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:42.527171] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:42.527224] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:42.527231] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:42.527240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:42.619557] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:42.727462] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:42.727500] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:42.727507] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:42.727515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:42.819734] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:42.825789] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:42.927746] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:42.927781] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:42.927787] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:42.927796] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:43.019856] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:43.128048] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:43.128091] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:43.128114] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=22][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:43.128121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:43.220024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=27] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:43.328345] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:43.328388] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:43.328396] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:43.328405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:43.336897] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8478, clean_start_pos=1400000, clean_num=200000) [2024-09-11 16:29:43.386934] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1726043383386930, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2024-09-11 16:29:43.388353] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=30] PNIO [ratelimit] time: 1726043383388351, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2024-09-11 16:29:43.420147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:43.475498] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:43.537164] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:43.537202] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:43.537209] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:43.537219] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:43.620269] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:43.737525] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:43.737585] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:43.737595] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:43.737605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:43.817649] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:220) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:43.817700] INFO [COMMON] handle (memory_dump.cpp:552) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2024-09-11 16:29:43.817782] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] update_check_range(min_check_version=240, max_check_version=241, global_version=242) [2024-09-11 16:29:43.819710] INFO handle (memory_dump.cpp:679) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=9] statistics: tenant_cnt: 2, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 2 3 0 1 7 1 2 0 500 0 33 118 0 500 7 3 3 0 500 8 24 1 0 500 9 2 1 0 500 17 5 3 0 500 22 3 48 0 500 23 5 5 0 cost_time: 1928 [2024-09-11 16:29:43.819748] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant: 1, limit: 9,223,372,036,854,775,807 hold: 6,291,456 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:43.819780] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 4,194,304 used= 2,335,664 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 2,169,056 used= 408,600 count= 24,952 avg_used= 16 block_cnt= 266 chunk_cnt= 2 mod=Number [MEMORY] hold= 92,880 used= 1,280 count= 1,152 avg_used= 1 block_cnt= 12 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 73,728 used= 65,408 count= 1 avg_used= 65,408 block_cnt= 1 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 2,335,664 used= 475,288 count= 26,105 avg_used= 18 mod=SUMMARY [2024-09-11 16:29:43.819813] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,912 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 80,816 used= 59,018 count= 263 avg_used= 224 block_cnt= 22 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,912 used= 59,050 count= 264 avg_used= 223 mod=SUMMARY [2024-09-11 16:29:43.819932] INFO [LIB] operator() (ob_malloc_allocator.cpp:519) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 352,550,912 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 94,494,720 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 50,331,648 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 14,794,752 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 11,292,672 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 171,151,360 limit= 9,223,372,036,854,775,807 [2024-09-11 16:29:43.820017] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=6] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 94,494,720 used= 77,717,120 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,779,520 used= 12,760,352 count= 1 avg_used= 12,760,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 10,719,232 used= 10,670,496 count= 10 avg_used= 1,067,049 block_cnt= 10 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 6,870,176 used= 6,785,296 count= 48 avg_used= 141,360 block_cnt= 29 chunk_cnt= 11 mod=PartitTableTask [MEMORY] hold= 5,476,352 used= 5,415,744 count= 6 avg_used= 902,624 block_cnt= 6 chunk_cnt= 4 mod=KvstCachWashStr [MEMORY] hold= 4,587,520 used= 4,487,040 count= 80 avg_used= 56,088 block_cnt= 80 chunk_cnt= 13 mod=[T]ObSessionDIB [MEMORY] hold= 4,307,456 used= 4,278,711 count= 3 avg_used= 1,426,237 block_cnt= 3 chunk_cnt= 3 mod=SqlDtlMgr [MEMORY] hold= 4,214,880 used= 4,194,328 count= 2 avg_used= 2,097,164 block_cnt= 2 chunk_cnt= 2 mod=SerFuncRegHT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdUnitMa [MEMORY] hold= 2,061,680 used= 1,937,608 count= 491 avg_used= 3,946 block_cnt= 246 chunk_cnt= 3 mod=CharsetInit [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=DInsSstMgr [MEMORY] hold= 1,581,056 used= 1,572,904 count= 1 avg_used= 1,572,904 block_cnt= 1 chunk_cnt= 1 mod=IdConnMap [MEMORY] hold= 1,548,288 used= 1,507,118 count= 5 avg_used= 301,423 block_cnt= 5 chunk_cnt= 3 mod=LDIOSetup [MEMORY] hold= 1,367,296 used= 1,347,584 count= 30 avg_used= 44,919 block_cnt= 30 chunk_cnt= 11 mod=CommonArray [MEMORY] hold= 933,888 used= 917,576 count= 2 avg_used= 458,788 block_cnt= 2 chunk_cnt= 1 mod=CACHE_INST_MAP [MEMORY] hold= 544,448 used= 531,712 count= 67 avg_used= 7,936 block_cnt= 67 chunk_cnt= 2 mod=ModulePageAlloc [MEMORY] hold= 491,520 used= 261,120 count= 30 avg_used= 8,704 block_cnt= 30 chunk_cnt= 8 mod=[T]ObDSActionAr [MEMORY] hold= 475,760 used= 432,240 count= 8 avg_used= 54,030 block_cnt= 8 chunk_cnt= 4 mod=HashBucket [MEMORY] hold= 463,728 used= 416,448 count= 162 avg_used= 2,570 block_cnt= 56 chunk_cnt= 6 mod=tg [MEMORY] hold= 412,416 used= 406,848 count= 4 avg_used= 101,712 block_cnt= 4 chunk_cnt= 3 mod=TenantCtxAlloca [MEMORY] hold= 369,088 used= 330,944 count= 7 avg_used= 47,277 block_cnt= 6 chunk_cnt= 2 mod=Rpc [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=register_task [MEMORY] hold= 229,968 used= 216,888 count= 27 avg_used= 8,032 block_cnt= 27 chunk_cnt= 4 mod=MallocInfoMap [MEMORY] hold= 221,184 used= 212,992 count= 1 avg_used= 212,992 block_cnt= 1 chunk_cnt= 1 mod=TSWorker [MEMORY] hold= 212,992 used= 196,624 count= 2 avg_used= 98,312 block_cnt= 2 chunk_cnt= 1 mod=DRTaskMap [MEMORY] hold= 183,152 used= 179,248 count= 23 avg_used= 7,793 block_cnt= 23 chunk_cnt= 5 mod=HashNode [MEMORY] hold= 180,224 used= 172,064 count= 1 avg_used= 172,064 block_cnt= 1 chunk_cnt= 1 mod=TenantMBList [MEMORY] hold= 174,080 used= 158,720 count= 80 avg_used= 1,984 block_cnt= 36 chunk_cnt= 12 mod=CreateContext [MEMORY] hold= 171,312 used= 167,080 count= 22 avg_used= 7,594 block_cnt= 22 chunk_cnt= 3 mod=TenaSpaTabIdSet [MEMORY] hold= 163,840 used= 147,792 count= 2 avg_used= 73,896 block_cnt= 2 chunk_cnt= 1 mod=HashNodNexWaiMa [MEMORY] hold= 155,312 used= 151,464 count= 20 avg_used= 7,573 block_cnt= 20 chunk_cnt= 2 mod=SysTableNameMap [MEMORY] hold= 147,456 used= 130,816 count= 2 avg_used= 65,408 block_cnt= 2 chunk_cnt= 2 mod=KVCACHE_HAZARD [MEMORY] hold= 145,216 used= 125,656 count= 7 avg_used= 17,950 block_cnt= 7 chunk_cnt= 3 mod=BucketLock [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=RefrFullScheMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 1 mod=MemMgrMap [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=TenaSchForCacMa [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=MemMgrForLiboMa [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=NonPartTenMap [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=IndNameMap [MEMORY] hold= 114,688 used= 110,736 count= 2 avg_used= 55,368 block_cnt= 2 chunk_cnt= 1 mod=DepInfoTaskQ [MEMORY] hold= 114,336 used= 106,088 count= 2 avg_used= 53,044 block_cnt= 2 chunk_cnt= 2 mod=RetryCtrl [MEMORY] hold= 98,304 used= 83,072 count= 2 avg_used= 41,536 block_cnt= 2 chunk_cnt= 2 mod=IO_MGR [MEMORY] hold= 73,728 used= 65,600 count= 1 avg_used= 65,600 block_cnt= 1 chunk_cnt= 1 mod=TCREF [MEMORY] hold= 73,728 used= 61,720 count= 3 avg_used= 20,573 block_cnt= 3 chunk_cnt= 1 mod=HashBuckConfCon [MEMORY] hold= 73,728 used= 72,968 count= 1 avg_used= 72,968 block_cnt= 1 chunk_cnt= 1 mod=CommSysVarFac [MEMORY] hold= 73,728 used= 65,536 count= 1 avg_used= 65,536 block_cnt= 1 chunk_cnt= 1 mod=[T]char [MEMORY] hold= 73,728 used= 69,664 count= 1 avg_used= 69,664 block_cnt= 1 chunk_cnt= 1 mod=SuperBlockBuffe [MEMORY] hold= 73,472 used= 71,424 count= 6 avg_used= 11,904 block_cnt= 6 chunk_cnt= 2 mod=SeArray [MEMORY] hold= 65,536 used= 65,192 count= 1 avg_used= 65,192 block_cnt= 1 chunk_cnt= 1 mod=LatchStat [MEMORY] hold= 53,872 used= 53,424 count= 7 avg_used= 7,632 block_cnt= 7 chunk_cnt= 1 mod=HashNodeConfCon [MEMORY] hold= 49,152 used= 32,768 count= 2 avg_used= 16,384 block_cnt= 2 chunk_cnt= 1 mod=CACHE_TNT_LST [MEMORY] hold= 45,280 used= 12,288 count= 162 avg_used= 75 block_cnt= 93 chunk_cnt= 14 mod=Coro [MEMORY] hold= 41,264 used= 37,264 count= 2 avg_used= 18,632 block_cnt= 2 chunk_cnt= 1 mod=TaskRunnerSer [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucConRefCoM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucConPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SqlLoadData [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DDLSpeedCtrl [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=io_trace_map [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdConfMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucPooUniMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucIdPoolMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamConMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HasBucSerMigUnM [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucTenPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucNamPooMa [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucSerUniMa [MEMORY] hold= 32,512 used= 31,744 count= 4 avg_used= 7,936 block_cnt= 4 chunk_cnt= 3 mod=HashMapArray [MEMORY] hold= 25,440 used= 24,264 count= 6 avg_used= 4,044 block_cnt= 5 chunk_cnt= 2 mod=ScheObSchemAren [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=HashBuckSysConf [MEMORY] hold= 24,576 used= 18,456 count= 1 avg_used= 18,456 block_cnt= 1 chunk_cnt= 1 mod=leakMap [MEMORY] hold= 24,352 used= 21,672 count= 2 avg_used= 10,836 block_cnt= 2 chunk_cnt= 2 mod=SchemaStatuMap [MEMORY] hold= 23,552 used= 20,352 count= 16 avg_used= 1,272 block_cnt= 16 chunk_cnt= 1 mod=IO_GROUP_MAP [MEMORY] hold= 18,928 used= 18,144 count= 4 avg_used= 4,536 block_cnt= 4 chunk_cnt= 3 mod=DeviceMng [MEMORY] hold= 17,856 used= 1,896 count= 79 avg_used= 24 block_cnt= 44 chunk_cnt= 10 mod=[T]MemoryContex [MEMORY] hold= 17,152 used= 16,384 count= 4 avg_used= 4,096 block_cnt= 4 chunk_cnt= 2 mod=FixedQueue [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=HasBucTimZonInM [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=ReferedMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TbltRefreshMap [MEMORY] hold= 16,384 used= 9,336 count= 1 avg_used= 9,336 block_cnt= 1 chunk_cnt= 1 mod=InnerLobHash [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=ServerLogPool [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=GenSchemVersMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MemDumpMap [MEMORY] hold= 16,384 used= 8,192 count= 1 avg_used= 8,192 block_cnt= 1 chunk_cnt= 1 mod=LinkArray [MEMORY] hold= 16,320 used= 15,904 count= 2 avg_used= 7,952 block_cnt= 2 chunk_cnt= 2 mod=UpgProcSet [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=SqlSession [MEMORY] hold= 16,000 used= 15,872 count= 2 avg_used= 7,936 block_cnt= 2 chunk_cnt= 1 mod=CommSysVarDefVa [MEMORY] hold= 14,208 used= 13,632 count= 3 avg_used= 4,544 block_cnt= 3 chunk_cnt= 3 mod=[T]ObTraceEvent [MEMORY] hold= 11,520 used= 8,384 count= 16 avg_used= 524 block_cnt= 6 chunk_cnt= 4 mod=RpcBuffer [MEMORY] hold= 9,200 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 1 mod=RedisTypeMap [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapCn [MEMORY] hold= 8,576 used= 8,192 count= 2 avg_used= 4,096 block_cnt= 2 chunk_cnt= 2 mod=LinearHashMapDi [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=SchemaRowKey [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=RpcKeepalive [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=InneSqlConnPool [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,000 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PlanVaIdx [MEMORY] hold= 7,872 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HasNodTzInfM [MEMORY] hold= 5,376 used= 5,248 count= 2 avg_used= 2,624 block_cnt= 1 chunk_cnt= 1 mod=RootContext [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RemMasterMap [MEMORY] hold= 4,016 used= 3,816 count= 1 avg_used= 3,816 block_cnt= 1 chunk_cnt= 1 mod=RecScheHisMap [MEMORY] hold= 3,264 used= 3,200 count= 1 avg_used= 3,200 block_cnt= 1 chunk_cnt= 1 mod=TenantTZ [MEMORY] hold= 2,960 used= 2,576 count= 2 avg_used= 1,288 block_cnt= 1 chunk_cnt= 1 mod=ObGuard [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=StorageS3 [MEMORY] hold= 1,920 used= 1,536 count= 2 avg_used= 768 block_cnt= 2 chunk_cnt= 1 mod=TGTimer [MEMORY] hold= 1,648 used= 1,448 count= 1 avg_used= 1,448 block_cnt= 1 chunk_cnt= 1 mod=GtsRequestRpc [MEMORY] hold= 1,568 used= 1,344 count= 1 avg_used= 1,344 block_cnt= 1 chunk_cnt= 1 mod=SchemaService [MEMORY] hold= 1,520 used= 1,328 count= 1 avg_used= 1,328 block_cnt= 1 chunk_cnt= 1 mod=GtsRpcProxy [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GROUP_INDEX_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=INGRESS_MAP [MEMORY] hold= 1,472 used= 480 count= 5 avg_used= 96 block_cnt= 5 chunk_cnt= 1 mod=PThread [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=IO_CHANNEL_MAP [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=memdumpqueue [MEMORY] hold= 976 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=timer [MEMORY] hold= 896 used= 704 count= 1 avg_used= 704 block_cnt= 1 chunk_cnt= 1 mod=ScheMgrCacheMap [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=TsMgr [MEMORY] hold= 544 used= 480 count= 1 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=TntResourceMgr [MEMORY] hold= 80 used= 7 count= 1 avg_used= 7 block_cnt= 1 chunk_cnt= 1 mod=SqlExpr [MEMORY] hold= 77,717,120 used= 76,302,660 count= 1,554 avg_used= 49,100 mod=SUMMARY [2024-09-11 16:29:43.820062] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 500 ctx_id= GLIBC hold= 6,291,456 used= 2,331,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 1,904,960 used= 933,792 count= 13,403 avg_used= 69 block_cnt= 242 chunk_cnt= 2 mod=Buffer [MEMORY] hold= 372,688 used= 242,794 count= 930 avg_used= 261 block_cnt= 93 chunk_cnt= 3 mod=glibc_malloc [MEMORY] hold= 53,424 used= 37,757 count= 229 avg_used= 164 block_cnt= 16 chunk_cnt= 2 mod=S3SDK [MEMORY] hold= 2,331,072 used= 1,214,343 count= 14,562 avg_used= 83 mod=SUMMARY [2024-09-11 16:29:43.820072] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= CO_STACK hold= 50,331,648 used= 40,771,584 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 block_cnt= 79 chunk_cnt= 24 mod=CoStack [MEMORY] hold= 40,771,584 used= 40,695,744 count= 79 avg_used= 515,136 mod=SUMMARY [2024-09-11 16:29:43.820083] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=7] [MEMORY] tenant_id= 500 ctx_id= LIBEASY hold= 4,194,304 used= 3,589,408 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 block_cnt= 23 chunk_cnt= 2 mod=OB_TEST2_PCODE [MEMORY] hold= 3,589,408 used= 3,462,560 count= 119 avg_used= 29,097 mod=SUMMARY [2024-09-11 16:29:43.820115] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=5] [MEMORY] tenant_id= 500 ctx_id= PKT_NIO hold= 14,794,752 used= 12,847,040 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 12,699,584 used= 12,626,320 count= 6 avg_used= 2,104,386 block_cnt= 5 chunk_cnt= 5 mod=DEFAULT [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_CTX_CHUN [MEMORY] hold= 73,728 used= 48,864 count= 3 avg_used= 16,288 block_cnt= 3 chunk_cnt= 1 mod=SERVER_RESP_CHU [MEMORY] hold= 12,847,040 used= 12,724,048 count= 12 avg_used= 1,060,337 mod=SUMMARY [2024-09-11 16:29:43.820163] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=4] [MEMORY] tenant_id= 500 ctx_id= SCHEMA_SERVICE hold= 11,292,672 used= 9,600,864 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 7,098,368 used= 7,078,824 count= 1 avg_used= 7,078,824 block_cnt= 1 chunk_cnt= 1 mod=SchemaIdVersion [MEMORY] hold= 2,088,896 used= 2,087,680 count= 2 avg_used= 1,043,840 block_cnt= 2 chunk_cnt= 2 mod=TenantSchemMgr [MEMORY] hold= 294,912 used= 262,144 count= 4 avg_used= 65,536 block_cnt= 4 chunk_cnt= 1 mod=SchemaMgrCache [MEMORY] hold= 32,384 used= 31,616 count= 4 avg_used= 7,904 block_cnt= 4 chunk_cnt= 1 mod=ScheTenaInfoVec [MEMORY] hold= 16,832 used= 16,064 count= 4 avg_used= 4,016 block_cnt= 4 chunk_cnt= 1 mod=SchemaSysVariab [MEMORY] hold= 16,192 used= 15,808 count= 2 avg_used= 7,904 block_cnt= 2 chunk_cnt= 1 mod=ScheTablInfoVec [MEMORY] hold= 2,560 used= 1,024 count= 8 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeCompo [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=SchePackIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheRoutIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablIdMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheTablNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=ScheIndeNameMap [MEMORY] hold= 2,432 used= 2,048 count= 2 avg_used= 1,024 block_cnt= 2 chunk_cnt= 1 mod=HiddenTblNames [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSePolic [MEMORY] hold= 1,920 used= 768 count= 6 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabeSeLabel [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtNameMap [MEMORY] hold= 1,408 used= 1,024 count= 2 avg_used= 512 block_cnt= 2 chunk_cnt= 1 mod=ScheUdtIdMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaProfile [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 4 chunk_cnt= 1 mod=RLS_GROUP_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSynonym [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheLabSeUserLe [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DBLINK_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=DIRECTORY_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_CONTEXT_MGR [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlSqlMap [MEMORY] hold= 1,280 used= 512 count= 4 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=RLS_POLICY_MGR [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenSchMemMgrFoL [MEMORY] hold= 784 used= 584 count= 1 avg_used= 584 block_cnt= 1 chunk_cnt= 1 mod=TenaScheMemMgr [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSequence [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheDataNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheAuxVpNameVe [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=MockFkParentTab [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaContext [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheForKeyNamMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheConsNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheOutlNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriTabPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=PRIV_ROUTINE [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaTablespac [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchePriObjPriMa [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigIdMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=ScheTrigNameMap [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaUdf [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaKeystore [MEMORY] hold= 640 used= 256 count= 2 avg_used= 128 block_cnt= 2 chunk_cnt= 1 mod=SchemaSecurAudi [MEMORY] hold= 9,600,864 used= 9,523,512 count= 131 avg_used= 72,698 mod=SUMMARY [2024-09-11 16:29:43.820182] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:178) [74231][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 500 ctx_id= UNEXPECTED_IN_500 hold= 171,151,360 used= 166,969,440 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] hold= 134,238,416 used= 134,217,736 count= 2 avg_used= 67,108,868 block_cnt= 2 chunk_cnt= 2 mod=CACHE_MAP_BKT [MEMORY] hold= 20,115,456 used= 20,096,160 count= 1 avg_used= 20,096,160 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MB_HANDLE [MEMORY] hold= 12,603,392 used= 12,582,920 count= 1 avg_used= 12,582,920 block_cnt= 1 chunk_cnt= 1 mod=CACHE_MAP_LOCK [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=BlockMap [MEMORY] hold= 4,048 used= 736 count= 46 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=ConfigChecker [MEMORY] hold= 166,969,440 used= 166,905,488 count= 51 avg_used= 3,272,656 mod=SUMMARY [2024-09-11 16:29:43.820388] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:43.926777] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:43.937838] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:43.937877] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=38][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:43.937884] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:43.937893] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:44.020501] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:44.138120] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:44.138157] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:44.138163] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:44.138171] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:44.224009] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=3396, replace_start_pos=9100000, replace_num=100000) [2024-09-11 16:29:44.224048] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:44.338413] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=23][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:44.338452] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:44.338459] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:44.338468] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:44.394544] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043384394540, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2024-09-11 16:29:44.395978] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=2310] PNIO [ratelimit] time: 1726043384395975, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2024-09-11 16:29:44.424128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=7] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:44.475621] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:44.538689] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:44.538727] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:44.538735] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:44.538743] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:44.624229] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2024-09-11 16:29:44.738969] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:44.739006] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:44.739024] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:44.739033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:44.824340] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2024-09-11 16:29:44.927599] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:44.939251] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:44.939299] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:44.939305] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:44.939312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:45.024529] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=36] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2024-09-11 16:29:45.139534] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:45.139578] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:45.139586] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:45.139595] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:45.224668] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2024-09-11 16:29:45.339833] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:45.339879] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:45.339887] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:45.339896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=5] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:45.348607] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:635) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=8669, clean_start_pos=1600000, clean_num=200000) [2024-09-11 16:29:45.402258] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1726043385402254, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007714, add_bytes: 0 [2024-09-11 16:29:45.403591] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO [ratelimit] time: 1726043385403589, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2024-09-11 16:29:45.424788] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2024-09-11 16:29:45.475731] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:45.548883] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:45.548945] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:45.548953] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:45.548962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:45.624986] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2024-09-11 16:29:45.749259] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:45.749304] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:45.749312] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:45.749322] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:45.825104] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2024-09-11 16:29:45.928315] INFO [COMMON] print_sender_status (ob_io_struct.cpp:871) [74210][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](*this=send_index: 1, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 2, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 3, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 4, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 5, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 6, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 7, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 8, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 9, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 10, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 11, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 12, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 13, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 14, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 15, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; send_index: 16, req_count: 0, reservation_ts: 9223372036854775807, group_limitation_ts: 9223372036854775807, tenant_limitation_ts: 9223372036854775807, proportion_ts: 9223372036854775807; ) [2024-09-11 16:29:45.949566] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:45.949607] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:45.949615] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:45.949624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:46.025291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2024-09-11 16:29:46.149946] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:46.149987] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:46.149995] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:46.150005] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=7] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:46.225477] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2024-09-11 16:29:46.350216] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=10][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:46.350273] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:46.350280] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:46.350287] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=4] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:46.409842] INFO eloop_run (eloop.c:144) [74256][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1726043386409838, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007584, add_bytes: 0 [2024-09-11 16:29:46.411213] INFO eloop_run (eloop.c:144) [74253][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO [ratelimit] time: 1726043386411212, bytes: 8568, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2024-09-11 16:29:46.430051] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:685) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=4451, replace_start_pos=9200000, replace_num=100000) [2024-09-11 16:29:46.430099] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2024-09-11 16:29:46.475922] INFO do_work (ob_rl_mgr.cpp:709) [74265][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=166] swc wakeup.(stat_period_=1000000, ready=false) [2024-09-11 16:29:46.550514] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=8][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:46.550557] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:46.550565] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:46.550573] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=6] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:46.630195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=8] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2024-09-11 16:29:46.750800] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mgr.cpp:119) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=11][errcode=-4006] tenant manager not init(ret=-4006) [2024-09-11 16:29:46.750854] WDIAG [COMMON] get_all_tenant_id (ob_tenant_mem_limit_getter.cpp:64) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54][errcode=-4006] get all virtual tenant id failed(ret=-4006) [2024-09-11 16:29:46.750864] WDIAG [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1006) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9][errcode=-4006] Fail to get all tenant ids, (ret=-4006) [2024-09-11 16:29:46.750878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1155) [74233][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=9] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-51949673267, global_cache_size=0, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[]) [2024-09-11 16:29:46.830334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:746) [74234][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8)